April 2007 - Darwin-kernel - lists.apple.com

Re: Help with malloc/free:
by Terry Lambert 13 Apr '07

13 Apr '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com http://www.osxbook.com/ Mac OS X Internals: A Systems Approach, by Amit Singh On Apr 12, 2007, at 2:57 AM, Michael Smith wrote: A bigger book list: Mac OS X Internals: A Systems Approach Amit Singh Addison-Wesley Professional ISBN 032127854 As a general overview, I'd recommend: UNIX Internals: The new frontiers Uresh Vahalia Prentice Hall ISBN 01310190 Solaris Internals: Core Kernel Architecture Jim Mauro, Richard McDougall Sun Microsystems Press Prentice Hall Ptr ISBN 0130224960 The Design and Implementation of the FreeBSD Operating System Marshall Kirk McKusick, George V. Neville-Neil Addison-Wesley Professional ISBN 0201702452 The Design of the UNIX Operating System (Prentice Hall Software Series) Maurice J. Bach Prentice Hall PTR ISBN 0132017997 -- Terry _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… On Apr 12, 2007, at 8:45 AM, Travis Rose wrote: Thanks for the information; helpful posts like yours and others serve to reduce/eliminate confusion; I recommend the following (to self and/or others): I would encourage you to consider a small investment in any reputable operating systems textbook. It's been long enough that I'm not in a position to make a current recommendation, unfortunately. = Mike There isn't a lot of _new_ new work in this area; Amit's book has already been mentioned by you. It's a bit daunting to some people (it has many pages, and it has a lot more collateral material posted on line at his site). For a complete rundown of MacOS X, including things not directly related to kernel operation or libc, you can't go wrong with his book, but for an introductory text on the generic idea of UNIX internals, you may want to take smaller bites. 8-). Here's a full reference for Amit's book, so that people can look for it more easily: And here's what I'd recommend you check out of the VT technical library, if you don't already own them: This is perhaps one of the best "broad overview" books for UNIX implementation internals, and how various OS implementations have gone about it. The material covered is generally "oldest implementation to current", though it's about 10 years old. The Design and Implementation of the 4.4 BSD Operating System (Unix and Open Systems Series.) Marshall Kirk McKusick, Keith Bostic, Michael J. Karel, John S. Quarterman Addison-Wesley Professional ISBN 0201549794 This is a moderately good overview of what you'll find in xnu/bsd/* sources, and a somewhat better overview than looking at FreeBSD or NetBSD sources, since the kernel side of the BSD kernel mostly comes from Net/2, Net/3, and BSD4.4-Lite sources. This is flat out one of the best UNIX internals books ever written; it's only drawback is that it's not written about MacOS X, and so a lot of things about the more modern aspects of its design are not applicable. This is an excellent overview of FreeBSD, from which MacOS X has borrowed heavily, particularly in user space and libc (libSystem). The Magic Garden Explained: The Internals of Unix System V Release 4 : An Open Systems Design Berny Goodheart, James Cox Prentice Hall ISBN 0130981389 The material is a bit dated, but it's still applicable from a design perspective. This is a seminal work; it's also rather dated at this point, but no collection would be complete without it. This email sent to site_archiver(a)lists.apple.com

1 0

Re: Help with malloc/free:
by Travis Rose 12 Apr '07

12 Apr '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Help with malloc/free:
by Michael Smith 12 Apr '07

12 Apr '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Help with malloc/free:
by Terry Lambert 11 Apr '07

11 Apr '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com --- --- -- Terry _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… On Apr 11, 2007, at 12:06 PM, Travis Rose wrote: The initialization and compression were meant to indicate two different code blocks (sorry!). So it's not a misnamed variable problem. Eventually, my colleague who was working on this problem learned about some limitations with VM management inherent in running 32-bit code (32-bit pointers) ... namely, he observes the VM is actually flushed at 4GB, although the program would crash after 3.4GB use (because of the overhead of the OS is ~0.6GB, in practice, a total 4GB allocation isn't ever achieved for 32-bit); you might think that the system would detect this problem and flush VM sooner; no such luck. As a result, when re-compiling for 64-bit, the program works (i.e., VM gets flushed before running out of memory, etc.) If this is indeed generally the case, we think this may be a problem for developers who use the 32-bit default and get surprised later by the "behavior" of VM management. This is not generally the case; your crash is undobtedly either a stack/heap collision because of a failed termination condition on your recursion, or you are missing a corresponding "free" for one or more of your "malloc" calls. I suggest using MallocDebug, the standard malloc's environment variables, or the "leaks" tool to find out what the problem is. I think you are lucking out (or using a 64 bit application) on Linux, given that the limit on a 32 bit Linux program is generall 3G, unless you specifically compile your 32 bit Linux kernel with a 4G/4G instead of the standard 1G/3G KVA/UVA split. The crash you are getting on a 32 bit MacOS X application is likely indicative of a real coding problem. (and this discussion really belongs on the porting list, rather than being posted in both places). This email sent to site_archiver(a)lists.apple.com

1 0

Re: Help with malloc/free:
by Travis Rose 11 Apr '07

11 Apr '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Help with malloc/free:
by Tony Scaminaci 11 Apr '07

11 Apr '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Domainkey-signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=sbcglobal.net; h=Received:X-YMail-OSG:Mime-Version:In-Reply-To:References:Content-Type:Message-Id:From:Subject:Date:To:X-Mailer; b=HZD6gYDW8oHXhg58tt/nCofr0Cila7+cq0Uo4zou6xNAFAksylhr+M1f/buYEq+TniCm+S9oZXP1hvloOcfEGYfalu29jZPhYnqXHOOoasvAyxdeM0dfcymQMln2iBu6gxfuYHT2DXMDTeuCaRgmvpn1gAjwZMpdgIxdBvXtQlU= ; _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Help with malloc/free:
by Ronnie Misra 11 Apr '07

11 Apr '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Help with malloc/free:
by Travis Rose 11 Apr '07

11 Apr '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Help with malloc/free:
by Michael Smith 11 Apr '07

11 Apr '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

EJUSTRETURN on connect_out
by Jones Curtis 11 Apr '07

11 Apr '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Dkim-signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:mime-version:to:message-id:content-type:from:subject:date:x-mailer; b=cgBJvB4Ub+p7wlvPqJO3oat7/RXtpCjN/8OhsEz5O0szmy584mg3xaZkiWnnMOB27cDkDhJGpphTiDKjPm4eGutz6EojV2n0Gz/l50sq/FsS35Do3BHB3H9ftys4OfregVvQ0eiwpGFkuAEkt6nWcDtdbq7l0tsf3ekCBWpnegM= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:mime-version:to:message-id:content-type:from:subject:date:x-mailer; b=LroA8JLMo2WMeJNAMdT2arf3TvCEu7nguEPQdd1o4bsgaCHmGmDhA2VmoI76kHeCzEtHXFJ3AVW0Jtz5K9ZDM9l0Bww6sDkF3E7GS+m9H0SahBRkxvEmYUAUlPJOE3MJ5vE+IiXLxJygTqca60Jn7ELkVJxvaYZFNNmLR72nPy8= Thanks. -- Curtis Jones curtis.jones(a)gmail.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com Has anyone here specifically returned "EJUSTRETURN" on connect_out in a socket filter, and then successfully received data on that socket, from the local process? I'm attempting to do that, and not succeeding, so if you have succeeded, I'm going to be prying for details. smime.p7s

1 0