September 2010 - Darwin-kernel

Re: Building the 10.6.4 Kernel
by Terry Lambert 13 Sep '10

13 Sep '10

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com No, it's just a missing header file. But I will absolutely guarantee that a kernel built from the released sources with llvm will fail to work. llvm silently stops generating code when it encounters a pointer cast of a zero that then has pointer math done on it. If you are a language-lawyer, you can find two clauses in the standard which justify the behaviour for this type of thing being "undefined" (don't ask me why it isn't "undefined to work just like gcc"). There are 14 places in the kernel sources he is using where that happens. The dtrace probes will also be problematic, since they use assembly-declared labels, and llvm's basic block replication means that some of those labels end up duplicated, resulting in duplicate label errors from the assembler. Some of the other inline assembly is also problematic for llvm compilation. You really want to use gcc-4.2. The set of links I posted the other day contain the necessary build tools which know how to build the kernel with the right compiler. Download them, use them. -- Terry On Sep 11, 2010, at 5:25 PM, James C wrote: > Hi Alex, > > No actual *details* here, just a theory: it may be that llvm and gcc > share a set of hidden files (which usually begin with a dot) for > tracking the dependency of .c files on .h files, and the stored llvm > dependencies are breaking the gcc build. > > The brutal solution would be to delete the build tree and start again > from scratch. If I have the right problem and somebody has the > details, they can probably suggest a much more sophisticated solution. > > Regards, > James. > >> Date: Sat, 11 Sep 2010 02:13:27 +0200 >> From: Alexander von Below <below(a)mac.com> >> Subject: Re: Building the 10.6.4 Kernel >> To: Terry Lambert <tlambert(a)apple.com> >> Cc: "darwin-kernel(a)lists.apple.com Kernel" >> <darwin-kernel(a)lists.apple.com> >> Message-ID: <B8EA2A65-E3F8-4749-8209-529C8D78A9BE(a)mac.com> >> Content-Type: text/plain; charset=us-ascii >> >> Thanks for your reply. >> >> However, I have no clue why the makefile thiks it should use llvm-c >> >> The error occurs even if I pass gcc-4.0 as the value for CC: >> >> % make CC=/usr/bin/gcc-4.0 >> =========== make all for libstuff ============= >> /usr/bin/gcc-4.0 -std=c99 -O -DLTO_SUPPORT -g -I../../include -Wall -fno-builtin-round -D_MACH_I386_THREAD_STATUS_FPSTATE_LEGACY_FIELD_NAMES_ -D_ARCHITECTURE_I386_FPU_FPSTATE_LEGACY_FIELD_NAMES_ -static -c \ >> -I/Developer/usr/local/include \ >> -MD -dependency-file ./lto.d \ >> -o ./lto.o ../lto.c >> ../lto.c:8:24: error: llvm-c/lto.h: No such file or directory >> >> Could anyone shed light on this? >> >> xcode-select points to /Developer, containing the current stable release of Xcode (3.2.4) >> >> Thanks >> >> Alex >> > _______________________________________________ > Do not post admin requests to the list. They will be ignored. > Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) > Help/Unsubscribe/Update your Subscription: > http://lists.apple.com/mailman/options/darwin-kernel/tlambert%40apple.com > > This email sent to tlambert(a)apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Building the 10.6.4 Kernel
by Michael Smith 12 Sep '10

12 Sep '10

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Building the 10.6.4 Kernel
by James C 12 Sep '10

12 Sep '10

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:date:message-id :subject:from:to:content-type:content-transfer-encoding; bh=F27IoQYDcQXDuQbCoTHnR0Ev04cwaAVnkZN5SKSYrc8=; b=XGTNG9S5HCYnRwTgBr37GTh+L8RYwDNctjjRsJH0EP/5LJMHYnZwVH1MhLwjxfMgo6 B2+awGBg4WCwfosj688MSOBmIF4RE3jWZrGxxAIYaBbGwSKuv/x83ppEahkAzs1C+nX4 I3sMlKMQAzroAFzOyH57PPJEBCvrd2kA4T24s= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type :content-transfer-encoding; b=gKfw/bSshFoPbgD/dXLlKY76oChleOkg3N2rDGMfMfD3ty0Tonj/5ZWEwwM4ysiQo1 u6El0kom2xrogfTmNbXZmesOektLhdqC0/fMYzMHgLLwPrI2VdDqlGs7POKmCRtnkXbJ ZEhef2kr6WkKAgsn9DsBq2a5qyLRpCjAuMZ3s= Hi Alex, No actual *details* here, just a theory: it may be that llvm and gcc share a set of hidden files (which usually begin with a dot) for tracking the dependency of .c files on .h files, and the stored llvm dependencies are breaking the gcc build. The brutal solution would be to delete the build tree and start again from scratch. If I have the right problem and somebody has the details, they can probably suggest a much more sophisticated solution. Regards, James. > Date: Sat, 11 Sep 2010 02:13:27 +0200 > From: Alexander von Below <below(a)mac.com> > Subject: Re: Building the 10.6.4 Kernel > To: Terry Lambert <tlambert(a)apple.com> > Cc: "darwin-kernel(a)lists.apple.com Kernel" > <darwin-kernel(a)lists.apple.com> > Message-ID: <B8EA2A65-E3F8-4749-8209-529C8D78A9BE(a)mac.com> > Content-Type: text/plain; charset=us-ascii > > Thanks for your reply. > > However, I have no clue why the makefile thiks it should use llvm-c > > The error occurs even if I pass gcc-4.0 as the value for CC: > > % make CC=/usr/bin/gcc-4.0 > =========== make all for libstuff ============= > /usr/bin/gcc-4.0 -std=c99 -O -DLTO_SUPPORT -g -I../../include -Wall -fno-builtin-round -D_MACH_I386_THREAD_STATUS_FPSTATE_LEGACY_FIELD_NAMES_ -D_ARCHITECTURE_I386_FPU_FPSTATE_LEGACY_FIELD_NAMES_ -static -c \ > -I/Developer/usr/local/include \ > -MD -dependency-file ./lto.d \ > -o ./lto.o ../lto.c > ../lto.c:8:24: error: llvm-c/lto.h: No such file or directory > > Could anyone shed light on this? > > xcode-select points to /Developer, containing the current stable release of Xcode (3.2.4) > > Thanks > > Alex > _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Building the 10.6.4 Kernel
by Terry Lambert 11 Sep '10

11 Sep '10

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com On Sep 10, 2010, at 5:13 PM, Alexander von Below wrote: > Thanks for your reply. > > However, I have no clue why the makefile thiks it should use llvm-c A simple google using `building darwin' as keywords yields: <http://shantonu.blogspot.com/2009/09/mac-os-x-kernel-source-xnu-has-been.ht…> <http://darwinbuild.macosforge.org/> -- Terry _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Building the 10.6.4 Kernel
by Alexander von Below 11 Sep '10

11 Sep '10

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Thanks for your reply. However, I have no clue why the makefile thiks it should use llvm-c The error occurs even if I pass gcc-4.0 as the value for CC: % make CC=/usr/bin/gcc-4.0 =========== make all for libstuff ============= /usr/bin/gcc-4.0 -std=c99 -O -DLTO_SUPPORT -g -I../../include -Wall -fno-builtin-round -D_MACH_I386_THREAD_STATUS_FPSTATE_LEGACY_FIELD_NAMES_ -D_ARCHITECTURE_I386_FPU_FPSTATE_LEGACY_FIELD_NAMES_ -static -c \ -I/Developer/usr/local/include \ -MD -dependency-file ./lto.d \ -o ./lto.o ../lto.c ../lto.c:8:24: error: llvm-c/lto.h: No such file or directory Could anyone shed light on this? xcode-select points to /Developer, containing the current stable release of Xcode (3.2.4) Thanks Alex Am 11.09.2010 um 00:30 schrieb Terry Lambert: > On Sep 10, 2010, at 3:03 PM, Alexander von Below wrote: >> Hello List, >> >> Search seems broken for the archive, so I am sorry if this is a FAQ... >> >> I am trying to build a Darwin Kernel (using the 10.6.4 source), and I am using this page as a guide: >> >> http://developer.apple.com/library/mac/#documentation/Darwin/Conceptual/Ker… >> >> My first problems are: >> >> * Libstreams does no longer seem to be part of 10.6.4. Is it no longer needed? >> >> * Compiling cctools fails: >> >> ../lto.c:8:24: error: llvm-c/lto.h: No such file or directory >> (and many more) >> >> Is there any place where I can find more hints on building my own? > > 10.6.4 is supposed to be compiled with gcc, not with llvm. You are using the wrong compiler because you have installed a newer XCode, and haven't specified gcc-4.2 should be used. > > I can't say about libstreams off the top of my head, but none of my kernels have ever linked against anything outside of xnu or the parts that came with the tar ball you use to get the Makefile working. > > -- Terry _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Building the 10.6.4 Kernel
by Terry Lambert 10 Sep '10

10 Sep '10

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com On Sep 10, 2010, at 3:03 PM, Alexander von Below wrote: > Hello List, > > Search seems broken for the archive, so I am sorry if this is a FAQ... > > I am trying to build a Darwin Kernel (using the 10.6.4 source), and I am using this page as a guide: > > http://developer.apple.com/library/mac/#documentation/Darwin/Conceptual/Ker… > > My first problems are: > > * Libstreams does no longer seem to be part of 10.6.4. Is it no longer needed? > > * Compiling cctools fails: > > ../lto.c:8:24: error: llvm-c/lto.h: No such file or directory > (and many more) > > Is there any place where I can find more hints on building my own? 10.6.4 is supposed to be compiled with gcc, not with llvm. You are using the wrong compiler because you have installed a newer XCode, and haven't specified gcc-4.2 should be used. I can't say about libstreams off the top of my head, but none of my kernels have ever linked against anything outside of xnu or the parts that came with the tar ball you use to get the Makefile working. -- Terry _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Building the 10.6.4 Kernel
by Alexander von Below 10 Sep '10

10 Sep '10

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Hello List, Search seems broken for the archive, so I am sorry if this is a FAQ... I am trying to build a Darwin Kernel (using the 10.6.4 source), and I am using this page as a guide: http://developer.apple.com/library/mac/#documentation/Darwin/Conceptual/Ker… My first problems are: * Libstreams does no longer seem to be part of 10.6.4. Is it no longer needed? * Compiling cctools fails: ../lto.c:8:24: error: llvm-c/lto.h: No such file or directory (and many more) Is there any place where I can find more hints on building my own? Thanks Alex _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: about IOMemoryDescriptor
by Michael Smith 08 Sep '10

08 Sep '10

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

about IOMemoryDescriptor
by sheetal phirke 08 Sep '10

08 Sep '10

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.co.in; s=s1024; t=1283937831; bh=daCj1E+EsSxY0Ejs6Q2P4ciOrCzfNCn9yViAhekiblM=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:MIME-Version:Content-Type; b=h0gd6TdQpGSagkiLuhdt6KCwu2dL6DZ+DTVbtMwcOVvsKmYUNIxCk0EsZdk6KmYWJ8fMT3bcuAZrE/D1P1XRb8x2NZpM8IsguTRzWd9rcAgZZ82TYL+B2nVHx82SX8P8QYXDjKEoiXZb9xwtfPa+ToW4C5kV/5fX8UJBUWnRFXg= Domainkey-signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.co.in; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:MIME-Version:Content-Type; b=H1PIUKGJ1k0KH3S2eYT/pyC64N+Y6vcRefZe8Jln1ALuNtoN8EKGQgZe8rOPAxRkIu2WqPurVVsZ/ef8+epgKi9iZB5sZvvWVRURK2u8qBCjZxjQkMqbde4FVvzqnXy59DPEqEiKpMDhdU6CbGrgzXULYgXxUedFPo6e0vE1FqE=; _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Passing up per-socket data from NKE
by Joe Lowe 06 Sep '10

06 Sep '10

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com User-agent: Thunderbird 2.0.0.16 (Windows/20080708) > Off topic perhaps, but if you've solved the issue of making sure a > socket doesn't get detached while you're calling sock_xyz() from your > kext (outside a sflt callback), I'd be interested in finding out how. http://lists.apple.com/archives/darwin-kernel/2010/Jul/msg00031.html http://lists.apple.com/archives/Macnetworkprog/2006/Dec/msg00057.html Joe L. SIOCGIFKPI sounds like an interface ioctl, which the socket level filter may not be receiving. And looking at where the ioctl call ends up (the IOCGROUP for SIOCGIFKPI is 'i' for 'interface'): ioctl soioctl /* Call the socket filter's ioctl handler for most ioctls */ if (IOCGROUP(cmd) != 'i' && IOCGROUP(cmd) != 'r') { ... } ... ifioctllocked ifioctl ifp = ifunit(ifr->ifr_name); if (ifp == 0) return ENXIO; ... if (cmd == SIOCSIFKPI) {... } ... ifnet_ioctl(...) it looks like that SIOCSIFKPI is strictly handled by interface code (and filters). You can just use getsockopt instead, for a SOL_SOCKET option. I can provide some example code but it should be straightforward. Off topic perhaps, but if you've solved the issue of making sure a socket doesn't get detached while you're calling sock_xyz() from your kext (outside a sflt callback), I'd be interested in finding out how. HTH, Bogdan ioctl(tcpSocket, SIOCGIFKPI, &myreq); The last call is failing with ENXIO, and I never see the ioctl() come through. _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/joe.lowe%40pismotechni… _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This seems related to sock_retain and sock_release not being public kernel exports. Bogdan Harjoc wrote: On Sat, Sep 4, 2010 at 2:07 PM, Matt Slot <apple_lists(a)mattslot.com> wrote: This email sent to joe.lowe(a)pismotechnic.com This email sent to site_archiver(a)lists.apple.com

1 0