November 2007 - Darwin-kernel

Re: DTrace in kernel extensions
by Michael Tuexen 05 Nov '07

05 Nov '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Hi Garth, I really want this. So I submitted a bug report: Problem ID: 5580277 Best regards Michael On Nov 5, 2007, at 7:32 PM, Garth Cummings wrote: Hi Michael, On Nov 5, 2007, at 9:57 AM, Michael Tuexen wrote: Hi Garth, since I can not look at the URL, should I file another Bug Report? Best regards Michael --gc On Nov 5, 2007, at 6:46 PM, Garth Cummings wrote: Hi Michael, --gc On Nov 5, 2007, at 6:59 AM, Michael Tuexen wrote: Dear all, Best regards Michael _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/gcummings%40apple.com ____________________________________________________________________ Garth Cummings gcummings(a)apple.com Sr. Software Engineer Apple Developer Technical Support <http://developer.apple.com/technicalsupport> ______________________________________________________________________ Garth Cummings 1 Infinite Loop, MS 303-2T Sr. Software Engineer Cupertino, CA 95014 Apple Developer Technical Support _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… It's your call. The DTrace engineers definitely want this feature, but a few duplicates from developers can help engineering management assess the demand for the feature. DTrace doesn't work with kexts at this time, unfortunately. <rdar://problem/4648477 >. I would like to use dtrace for an NKE I'm builing, like FBT and more. Is this possible? What do I have to do? Any hints or pointers to documentation is appreciated. Just loading the NKE and executing dtrace -l does not show anything from the loaded NKE. This email sent to gcummings(a)apple.com "The last good thing written in C was 408-974-7711 phone Franz Schubert's Symphony No. 9." 408-974-8101 fax —Erwin Dieterich gcummings(a)apple.com This email sent to site_archiver(a)lists.apple.com

1 0

Re: DTrace in kernel extensions
by Garth Cummings 05 Nov '07

05 Nov '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: DTrace in kernel extensions
by Michael Tuexen 05 Nov '07

05 Nov '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Hi Garth, since I can not look at the URL, should I file another Bug Report? Best regards Michael On Nov 5, 2007, at 6:46 PM, Garth Cummings wrote: Hi Michael, --gc On Nov 5, 2007, at 6:59 AM, Michael Tuexen wrote: Dear all, Best regards Michael _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/gcummings%40apple.com ____________________________________________________________________ Garth Cummings gcummings(a)apple.com Sr. Software Engineer Apple Developer Technical Support <http://developer.apple.com/technicalsupport> _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… DTrace doesn't work with kexts at this time, unfortunately. <rdar://problem/4648477 >. I would like to use dtrace for an NKE I'm builing, like FBT and more. Is this possible? What do I have to do? Any hints or pointers to documentation is appreciated. Just loading the NKE and executing dtrace -l does not show anything from the loaded NKE. This email sent to gcummings(a)apple.com This email sent to site_archiver(a)lists.apple.com

1 0

Re: DTrace in kernel extensions
by Garth Cummings 05 Nov '07

05 Nov '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Hi Michael, --gc On Nov 5, 2007, at 6:59 AM, Michael Tuexen wrote: Dear all, Best regards Michael _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/gcummings%40apple.com ____________________________________________________________________ Garth Cummings gcummings(a)apple.com Sr. Software Engineer Apple Developer Technical Support <http://developer.apple.com/technicalsupport> _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… DTrace doesn't work with kexts at this time, unfortunately. <rdar://problem/4648477 >. I would like to use dtrace for an NKE I'm builing, like FBT and more. Is this possible? What do I have to do? Any hints or pointers to documentation is appreciated. Just loading the NKE and executing dtrace -l does not show anything from the loaded NKE. This email sent to gcummings(a)apple.com This email sent to site_archiver(a)lists.apple.com

1 0

DTrace in kernel extensions
by Michael Tuexen 05 Nov '07

05 Nov '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Dear all, Best regards Michael _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… I would like to use dtrace for an NKE I'm builing, like FBT and more. Is this possible? What do I have to do? Any hints or pointers to documentation is appreciated. Just loading the NKE and executing dtrace -l does not show anything from the loaded NKE. This email sent to site_archiver(a)lists.apple.com

1 0

Re: Leopard Sources?
by Michael Tuexen 05 Nov '07

05 Nov '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Hi Quinn, thank you very much for your answer. It helps to understand why Apple is acting like it is. More comments in-line. Best regards Michael On Oct 30, 2007, at 11:29 AM, Quinn wrote: OK, I'll bite (-: I know of three main areas: - contain information related to upcoming hardware - explain workarounds for bugs in third party code, where Apple doesn't want to be seen as publicly criticising a third party - explain workarounds for Apple code, where Apple doesn't want to be seen as being critical of itself Having said that, Apple works hard to ensure that: a) Darwin can build and run as a standalone OS. * * * * * * <rdar://problem/3893228> Protocol plug-in KPI <rdar://problem/4605154> Requirement for SCTP implementation on Kernel * * * This email sent to michael.tuexen(a)lurchi.franken.de _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… At 21:00 -0600 29/10/07, William Kucharski wrote: It's not divulging trade secrets to give general areas which are/ remain closed source. o A significant chunk of what gets removed is comments. They might, for example: o Some stuff is code that we received under non-disclosure from another party, or code based on information that we received under non-disclosure from another party. o Some stuff is removed because it relates to upcoming Apple products. For an extreme example, consider that, prior to the iPhone announcement, it would have been extremely foolish to reveal full support for the ARM platform. b) You can slide a "mach_kernel" built from open source underneath Mac OS X, and things still work. So, while the Darwin kernel source is slightly different from Apple's internal source, you'd be hard pressed to find a situation where that makes any difference in practice. If you discover such a situation, please let us know by filing a bug. At 18:30 -0600 29/10/07, William Kucharski wrote: The irony is that in PPC days the kernel was fully open sourced and it was only various libraries, such as the ones having to deal with DVDs, that were closed source. This is /not/ true. The situation I've described above has existing since the first Darwin release. Obviously it is possible to improve things in this space. For example, we could have a group of engineers dedicated to keeping the open source and the internal source in close sync. Doing this, however, would require Apple to rebalance its priorities: to increase our commitment to open source requires a corresponding decrease in the cool features that we can ship to customers (and developers). Decisions like that are made well above the pay grade of the folks that read this mailing list. To be blunt, complaining in this mailing list won't help. The Apple folks who read the list are just a bunch of kernel engineers. Regardless of whether we agree or disagree with you, it's not our decision to make. What you should do is corner an Apple marketing person [1] and explain to them the consequences of the current priorities. When you do that, avoid emotional appeals; rather, explain how the current policy negatively impacts Apple (either in dollar terms, or in terms of lost opportunity). With regards SCTP, we already have plenty of bugs covering this. The two lead bugs are: The first covers the requirement for a general protocol plug-in KPI, and the second covers the specific requirement for an SCTP implementation. Again, fixing this is a matter of priorities. In the three years since I filed <rdar://problem/3893228> I've encountered /two/ third party developers that need a protocol plug-in KPI: A. The first was commercial developer with a significant source base that was dead in the water on 10.4.x without this KPI. At the time this way a major kerfuffle. After a prolonged discussion, these folks eventually decided to change their in-kernel protocol code so that it was no longer an actual protocol (IIRC they hosted it on top of a UNIX domain socket, so the majority of their code could continue to use sockets for read, write, select and so on). They're now fully hosted on KPIs, and their code is more-or-less binary compatible with Leopard. B. The second is SCTP, as built by Michael and used by Andreas. This project continues to use the kernel's protocol plug-in mechanism, even though this isn't an official KPI. As such, it doesn't get the benefits that KPIs provide. That it, it is sometimes broken by dot releases of the OS, and it pretty much always broken by a major release. And it can't be fixed without Darwin source. Michael, Andreas, you have a decision to make. You can continue down your current path, with the negative consequences that I've described above. It's possible that Apple will eventually introduce a protocol plug-in KPI, but I can't say if or when that will happen. However, given that this is /not/ in 10.5, it seems likely that you'll be suffering this pain for years to come. Alternatively, you can find some other way to implement the functionality that you need. Perhaps you can move your protocol into user space? Or perhaps rehost your in-kernel code on top of UNIX domain sockets? I realise that this will be technically challenging. Ultimately, it's a question of balancing the pain of this change with the pain that you suffer by not being hosted on supported KPIs. I already developed an SCTP implementation in userland and this is not what we want. SCTP has a standard socket API like TCP and UDP hat. Solaris, Linux and FreeBSD support it. So I want to have not only an SCTP implementation available on Mac OS X but also being able to use it via the standard socket API defined in That is why we have the pain... If the possibility of the NKE is not possible anymore in a future version of Mac OS X, I would integrate it directly in the kernel (like TCP and UDP) and would use a modified mach_kernel. However, it is much easier to use a NKE, because you can recompile/ reload the NKE without rebooting. This helps during debugging. I'm sorry to be so blunt about this. I'm sorry that we don't have a better story for you. I wish that we had infinite resources and could accommodate all of the needs of all of our developers. Alas, that just isn't the case. Share and Enjoy -- Quinn "The Eskimo!" <http://www.apple.com/ developer/> Apple Developer Relations, Developer Technical Support, Core OS/ Hardware [1] Actually, Apple Developer Relations, and hence DTS, is part of marketing, but I pride myself is being the "most technical person in marketing" (-: _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/michael.tuexen% 40lurchi.franken.de This email sent to site_archiver(a)lists.apple.com

1 0

Re: Kernel Debugging Help
by Alexander von Below 05 Nov '07

05 Nov '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Hello, Alex Am 05.11.2007 um 10:05 schrieb billy lau: Hi list, I am attempting two machine debugging using a 6-6pin Firewire cable. However, I could not figure out the command to target the test machine. Could anyone give an example or point me to the right direction on this? On ocassion of a kernel panic, the test machine says "Debugger called". Does this mean that having the connection set up correctly and using the correct command from the remote machine, I do not need to do anything else to the test machine? Do I still need to set the nvram parameters? Thanks for any help. - billy _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/below%40mac.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… to state the obvious: Did you follow the instructions in the "Read Me" for FireWire KDP in the FireWire SDK? You must install FireWire KDP on the target machine, and run a Proxy on machine you are using to debug. To get these, you need to get the FireWire SDK Available from connect.apple.com This email sent to below(a)mac.com This email sent to site_archiver(a)lists.apple.com

1 0

Re: Kernel Debugging Help
by billy lau 05 Nov '07

05 Nov '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; bh=eyQejNrDqY7EkSCXT1C9Hbo+/8jzdu8hfMFXz77Hy9U=; b=eLzx87M/DSRITdaYRFStOtOyXs4mrvBg4qHze9Gj9Jkdmgi9xxGpv65CiAubvoxiIvaLQ7ANEfWKFHZSoExmnDO387YDAzNiBBs6IDtuMGhxFxc69xZ7mdK82ZOogcxS6TseM6U0rvyXtKq22VlM4yXTEAiNYIvpyyubA++kMjY= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; b=Tsgg9EXWADCS3AeNcGKcM+wn32HgPNf5uKr2+A9DjkFR9nSFq/QT6zWzlQJVh3XjzNJutLnluUBl7m5oPmmBC1R+tTffxBs563TC4jf0mM1w1xEFEsf1+aFwNQgKMSD+t26QKQb8SFpVdrAAEuacqFhPbQW4Y9xwFPHBhfw9ZPs= Hi list, I am attempting two machine debugging using a 6-6pin Firewire cable. However, I could not figure out the command to target the test machine. Could anyone give an example or point me to the right direction on this? On ocassion of a kernel panic, the test machine says "Debugger called". Does this mean that having the connection set up correctly and using the correct command from the remote machine, I do not need to do anything else to the test machine? Do I still need to set the nvram parameters? Thanks for any help. - billy _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: simple script to build a mach_kernel
by Tom Garcia 02 Nov '07

02 Nov '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com On 2 Nov 2007, at 12:27, Andreas Fink wrote: Usage: compress-man-pages.pl [-d prefix] dir ... make[1]: *** [compress-man-pages] Error 255 make: *** [install(a)migcom.tproj] Error 2 sh-3.2# Cheers, -- Tom Garcia | tgarcia(a)hivemind.org _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… Hopefully its only a manpage which will be missing Yes, the error seems completely benign. You could replace the make; sudo make install with gcc relpath.c -o relpath; cp relpath /usr/local/ bin. My aim was just to find a sequence that builds enough tools into / usr/local/bin for it to be possible to build the kernel plus symbols. As implied, you also get lots of errors about the missing ctfconvert in compiling xnu, which probably means no dtrace support. There is source for ctfconvert.c for OpenSolaris http://cvs.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/tools/ctf/cvt… , but it seems to assume an ELF system; I see no macho version throughout the Darwin sources. But this is my first serious attempt to tackle Darwin so I'm likely missing the obvious. This email sent to site_archiver(a)lists.apple.com

1 0

Re: simple script to build a mach_kernel
by Andreas Fink 02 Nov '07

02 Nov '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com make install in bootstrap_cmds delivers ... /usr/bin/chgrp -R wheel /usr/libexec/migcom /usr/sbin/chown -R root /usr/libexec/migcom if [ ! -d "/usr/bin" ] ; then \ mkdir /usr/bin ; \ fi install -c -m 755 mig.sh /usr/bin/mig Compressing man pages... Usage: compress-man-pages.pl [-d prefix] dir ... make[1]: *** [compress-man-pages] Error 255 make: *** [install(a)migcom.tproj] Error 2 sh-3.2# Hopefully its only a manpage which will be missing On 02.11.2007, at 01:10, Tom Garcia wrote: 1. Install Xcode. 2. Download: * bootstrap_cmds-60.tar.gz * Libstreams-25.tar.gz * kext_tools-117.tar.gz * xnu-1228.tar.gz * cctools-667.3.tar.gz * IOKitUser-376.tar.gz from the 10.5 sources page and place into a directory dist/. 3. Execute in dist's parent: ----- snip ----- #!/bin/sh sudo mkdirhier /usr/local/bin mkdir build cd build tar zxf ../dist/bootstrap_cmds-*.tar.gz cd bootstrap_cmds-*/relpath.tproj/ make all sudo make install cd ../.. tar zxf ../dist/Libstreams-*.tar.gz cd Libstreams-* make all sudo make install cd .. tar zxf ../dist/cctools-*.tar.gz cd cctools-*/libstuff mv Makefile Makefile.orig sed 's,\-DKERNEL,\-I/usr/include \-DKERNEL,g' Makefile.orig >Makefile make all cd ../misc make macos_all sudo cp seg_hack.NEW /usr/local/bin/seg_hack cd ../libmacho make macos cd ../ld mv Makefile Makefile.orig sed 's,\-DKERNEL,\-I/usr/include \-DKERNEL,g' Makefile.orig >Makefile make kld_build sudo cp static_kld/libkld.a /usr/local/lib cd .. sudo mkdirhier /usr/local/include/mach-o sudo cp include/mach-o/kld.h /usr/local/include/mach-o cd .. tar zxf ../dist/kext_tools-*.tar.gz cd kext_tools-* gcc -I/usr/local/include kextsymboltool.c -o kextsymboltool sudo cp kextsymboltool /usr/local/bin cd .. tar zxf ../dist/xnu*.tar.gz cd xnu* make ----- snip ----- Kernel at build/xnu-1228/BUILD/obj/RELEASE_I386/mach_kernel . (Where is ctfconvert ?) Regards, -- Tom Garcia | tgarcia(a)hivemind.org _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/afink%40list.fink.org _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… Tried this approach but I fail on the first package already. I presume the package is buggy as it relies on a tool which isn't there or has changed. Since the source is out and last time I tried it was difficult to start from scratch, I've scribbled a script that ends up with a mach_kernel, based on the method in http://slagheap.net/ etherspoof/ . Maybe it'll entice other dilettantes. cd .. tar zxf ../dist/IOKitUser-*.tar.gz cd IOKitUser-* sudo mkdirhier /usr/local/include/IOKit/kext sudo cp kext.subproj/KXKext.h kext.subproj/KXKextManager.h kext.subproj/KXKextRepository.h /usr/local/include/IOKit/kext This email sent to afink(a)list.fink.org This email sent to site_archiver(a)lists.apple.com

1 0