December 2007 - Darwin-kernel

Re: Sparse files on Mac
by Anton Altaparmakov 08 Dec '07

08 Dec '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Hi, Hi folks, HFS/HFS+ do not support sparse files. The main question is WHY are you trying to do what you are trying to do? Best regards, Anton -- Anton Altaparmakov <aia21 at cam.ac.uk> (replace at with @) Unix Support, Computing Service, University of Cambridge, CB2 3QH, UK Linux NTFS maintainer, http://www.linux-ntfs.org/ _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… On 8 Dec 2007, at 09:33, Damir Dezeljin wrote: I have an non strictly kernel related question; however, I guess you'll be able to point me to the right resources. I developed a KEXT and I though of using sparse files functionality in user space for implementing some internal logic. I tried creating a sparse file using the same set of commands I usually use on Linux, but I found out I just create a normal file: ---- ftruncate(fd, 0); ftruncate(fd, 4*1024*1024*1024); ---- Now I'm wondering if sparse files are supported on the default file system used on OS 10.4 desktop (as I know, the HFS is used)? If yes, what I'm doing wrong? Additionally I'm wondering if is it possible to get some kind of 'holes table' as it's on Windows -> so, let suppose the sparse file has some data on an offset of 1 GB, some on 1.7 GB and so on. As far as I know, this isn't possible on Linux, but I'm sure it is on Windows. As there is no sparse support this is not relevant. You can get allocation information using the fcntl F_LOG2PHYS (see the fcntl man page) but that is quite a cumbersome interface. Also note that it will (at least on Leopard have not checked Tiger) return RANDOM JUNK for file systems supporting sparse files. Radar is down for maintenance at the moment or I would file a bug report immediately! Finally, even on HFS/HFS+ the information obtained is only a snapshot of this point in time. As soon as the call returns this information may not be accurate any more as HFS/HFS+ perform automatic online defragmentation and if that happens right after an fcntl F_LOG2PHYS call then the file will no longer be there at all. Is it possible to access above mentioned information from a KEXT? No you cannot do this from within a KEXT. (At least not in any supported way.) This email sent to site_archiver(a)lists.apple.com

1 0

Sparse files on Mac
by Damir Dezeljin 08 Dec '07

08 Dec '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:sender:to:subject:mime-version:content-type:x-google-sender-auth; bh=/MM5n1Utk7SAErij5YZ1wwh1WyF6x9MvWMqJBQ58ZJA=; b=btl6xSVMF0jUlEtXaE1YArpl5G+/MCbO9juXsUnpbukPpaOoKA2syk0GxkO0fwqas4pPq1SqJwtfQ6A6R86XRprV1Y5mOyyMugaFqJ96cQc1dPsp2sF/1LO8FZt1layyFDeglVmlKpM4IwEkBNsyFzZoOh9c/vJYpaMWAFRgqFc= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:sender:to:subject:mime-version:content-type:x-google-sender-auth; b=Gw05Oh0vyp966CgfkUQGqnGlQmVmBzoTagP5Yo7efij7WLFHruyWfv/gXvJGIBsGi+3zAZdYJ4BVlOaP8oQb3o5J7mMaAevGo/joLctIX0z2gb9+Nri9/OwJ7PnK9nsRApD1XriXipHiFSRlJMuqEmKVC5pOqicuFkKDYm0b4mA= _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Page Fault Kernel Panic on Leopard
by JanakiRam 08 Dec '07

08 Dec '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; bh=d2URpt94s1Wve+YKmuFl8f+zVcTN6vvGpBGpxRflxS8=; b=dM/2ZnhPs7H0Suf3QCjow2gnZTTN/YVxb+sSM4OxNLBELCGZIXfXDnATihNXT4oM0VKGaZrVrNA3OWUTpQBh0tRYYmReDRAPpQ0vs4/NEo2FlWRFzUSgwYBORVnXpNoGXOGSY7v6xsdK1tajvrjSlvuBz66WPBl018Xwl8ieJCg= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=citDtrql5Eb6vUfXx8Lisg6+f8eBI6S+HE2FkS8f2zV+v9JsU1scXvw/8yz6Xc8dIFAJqvfEex++TvmMINA9PHTPU8pIY+rgKt3qzxSOp1xITagh9VTKWCN8W9w8Byhf0MMk0K0KtMVGM44nzms2ykvCu7xi1JL7nBQMe6I/OYw= Hi All, My Software runs into new problems after upgrading to Leopard. My Customers/Users are complaining that my kext gets crashed in a specific flow in an inconsistent way , which didn't panic on Tiger :). I'll setup a Core-Dump server to analyze the exact panic information. Mean while any one can provide the information on the page fault panic. panic(cpu 0 caller 0x001A7BED): Kernel trap at 0x346e9f78, type 14=page fault, registers: When does a Page Fault panic appear and any reasons why it panics a system. Any pointers on these -- greatly appreciated. Thanks in Advance. -JanakiRam. _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: silly Kext naming question
by mm w 07 Dec '07

07 Dec '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=z3tXad0O4fH9U5lf+cbL/jvkpglEglCU+NVgHVlBv0Q=; b=hZtRTK+jw9BOWnh1aabB7OlQDJTdi87ML4NKlQNTK6ZvAwt5qI8IlcdkqSeVxllboqYON6fSOg6cFxkQ9ja0LNr8J+x/LLHo92sYCos5gI7qXpxCetA3xpkPgLXsfT1yHPP0PnOfcY4ATfxyI8KV73+oL6Et+mUsrH1Ys0yYskU= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=YJFZRVS9PzbjQohCuE825Ki4eY0QGGaEtUFGaU6KAubiCeOvUHViI2BNtYMKdd7fMVM3LDH53KKTR2zYJbOSAqx5HhPVk9yHeXmev49IUEJQaP97kXPBjczZEt0sRtdrq4iZGqoR06N+5eyPAEYNB/iO/YBrbqbh/jc2I/NL+2U= Hi Rick, Nothing in your case you could put: [FSNAME]V[NUM].fs/Contents/Resources/dns.name.[FSNAME]V[NUM].kext Cheers! -mmw On Dec 7, 2007 8:22 AM, Rick Macklem <rmacklem(a)uoguelph.ca> wrote: > > > On Thu, 6 Dec 2007, mm w wrote: > > > Hi, i think you are mixing the Identifier name and the filesystem name > > > Kinda. I guess I was asking if there was a filename convention separate > from the bundle identifier. > > I now see from another posting to-day that file systems can somehow > go under /Library/Filesystems. I'm gonna have to look at that and try > and figure it out. > > What I do now works and shouldn't conflict with anyone else. I'd just > like to "go with the flow" as far as practicable. > > Thanks for the response, rick > > -- -mmw _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: silly Kext naming question
by Rick Macklem 07 Dec '07

07 Dec '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com On Thu, 6 Dec 2007, mm w wrote: Hi, i think you are mixing the Identifier name and the filesystem name Kinda. I guess I was asking if there was a filename convention separate from the bundle identifier. I now see from another posting to-day that file systems can somehow go under /Library/Filesystems. I'm gonna have to look at that and try and figure it out. What I do now works and shouldn't conflict with anyone else. I'd just like to "go with the flow" as far as practicable. Thanks for the response, rick _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: [?? Probable Spam] Re: Placing Kext at custom location instead of /System/Library/Extensions
by Rick Macklem 07 Dec '07

07 Dec '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com On Fri, 7 Dec 2007, Rustam Muginov wrote: [stuff snipped] I thought of putting my Kext in /Library, but didn't for a couple of reasons: 1 - There is no /Library/Extensions folder (at least in Tiger). 2 - In "Kernel Extension Concepts" pg. 70, it states: When your KEXT is installed, it will be installed into the Extensions folder, at /System/Library/Extensions under Mac OS X. What is interesting is that they don't seem to have a naming convention for the Kext folder (see my other post). rick _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… >From the other side, this article: http://developer.apple.com/tools/installerpolicy.html explicitly prohibits to put something into /System/Library folder and recommends to use /Library instead: This email sent to site_archiver(a)lists.apple.com

1 0

Re: Placing Kext at custom location instead of /System/Library/Extensions
by Rick Macklem 07 Dec '07

07 Dec '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com On Fri, 7 Dec 2007, JanakiRam wrote: Hi All, I've developed a kext for my product . To have more control on loading the kext (after login) , i'm planning to place it at custom location ( /opt/myproductfolder) instead of /System/Library/Extensions. Can any one point out the pros & cons for the location change ? This is more a related question than an answer to your question, but... does putting the kext somewhere other than /System/Library/Extensions affect how it gets cached (in the kernel extensions cache)? I have mine in /System/Library/Extensions and I do have to remember to sudo touch /System/Library/Extensions after I replace the binary. (It's loaded by a daemon of mine that is started by Launchd. Oh, and I wasn't bothering to bump up the version# for each build.) Thanks in advance for any info, rick _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

clear_wait() using thread address
by Vishal Shetye 07 Dec '07

07 Dec '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:from:to:subject:date:message-id:mime-version:content-type:content-transfer-encoding:x-mailer:thread-index:x-mimeole; bh=SAQoB/UmesHFEuhg1tGpJyNcRsCzkTNMAczg6UN9JtA=; b=FHcgVYUXiOmv3pRXSzlYQmAonn+wTQFwh34uhr68lIaFr3rNwE9tFLExqs6GvNnUrVUNv0g7Avc3XHu7nlCs6PFYbNwhNb7Gg1dD9qJ6EvAg+9GoItX7R4RkQDtfm3yo/NTCQA+Y9zlxh8mc4qjsdBhzzbdHqyx+8uksJhEfKKo= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:to:subject:date:message-id:mime-version:content-type:content-transfer-encoding:x-mailer:thread-index:x-mimeole; b=uv47ZfbhJ6rYvqJ810w87q5P4Sb3aYSMnADTjRrweKnwC6KcywdDcPZ1xgJwbCNWvYc4aiMtmETKZ3R4CaLlWbiPUGUyYhGW71gUH6tfVJ88jxCqJubOb1+cPdeCW02idvsEqgy2lPE6gv7kmrhS64OsSdQdU6DX1OvxjgFIGp0= Thread-index: Acg157y4aUtQR4c6SjehlMqmkQ/r7gARNk2wAKVAaYA= Hi, I've written a KEXT, wherein a thread, sleeping on wait_queue is invoked by another thread using clear_wait(). For this I keep a global thread safe structure for storing thread's address. What I want to know is, * Is there a possibility that my thread reference may become invalid, because of kernel's internal memory movement (such as to defragment, I'm just guessing)? * Is there a way of invoking selected process from wait_queue by its pid (like wake_up_process() in case of linux). thanks _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Placing Kext at custom location instead of /System/Library/Extensions
by Quinn 07 Dec '07

07 Dec '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com S+E -- Quinn "The Eskimo!" <http://www.apple.com/developer/> Apple Developer Relations, Developer Technical Support, Core OS/Hardware _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… At 12:13 +0530 7/12/07, JanakiRam wrote: I've developed a kext for my product . To have more control on loading the kext (after login) , i'm planning to place it at custom location ( /opt/myproductfolder) instead of /System/Library/Extensions. The only reason you /need/ to be in "/System/Library/Extensions" is if you want the KEXT to be loaded automatically via the I/O Kit matching process. If that's not necessary, as seems to be the case here, there's no requirement to be in "/System/Library/Extensions". As to whether you /should/ be in "/System/Library/Extensions" it kinda depends on the context of your product. For example, if you were a VFS plug-in developer, I would recommend that you embed your KEXT within your file system bundle. That way there's would be a single file system object that represents your product. And, given that file system bundles are installed in a secure location ("/Library/Filesystems" on 10.5 and later, or "/System/Library/Filesystems" on earlier systems), there's now downside to putting a KEXT there. In your case, you want to load your KEXT post login. Loading the KEXT is a privileged operation, so the code that does the loading must be in a secure location. Thus, in the absence of further information, I'd recommend that put the KEXT within the bundle containing that code. I'd recommend you avoid "/opt" unless your product will only be used by UNIX geeks. Even amongst UNIX geeks, some fraction of the population hates "/opt" (-: If you need a secure location for your KEXT (and the code that loads it), I recommend that you create a root:wheel rwxr-xr-x directory within "/Library". To minimise the chance of collision, the name of the directory should be either your company or product name. Oh, yeah, /don't/ use "/Library/Application Support". That folder is not appropriate for privileged code. This email sent to site_archiver(a)lists.apple.com

1 0

Re: [?? Probable Spam] Re: Placing Kext at custom location instead of /System/Library/Extensions
by mm w 07 Dec '07

07 Dec '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=wWnFl2FpE7STN0QVktS3zoQ6JYCYK+OAdIDZtj/9xjM=; b=a+CGUF6dZ369qtJpLdyipLLqWtzOpNK8oq48LBoQf3KdAoDBM2qbVv/P/tVWjpPEWeEjByDwJ3PR1Pa3DDMplhZxVzmeAQBdrev5HdOJebtMq8u56tN9v+fNiLb58qPjIVyNIyNhVx0Ir/W5x77rkIe4IF7SJDbbEgiY1B+b/J0= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=sFWfYC94z2vtnRizfiZ2MtNH2u+g1b/6bFCz2udedRFcPNz8TjjzXrjYOsSIJuVbGOEAwXWtA27t3N8NMCJb2KcYy/6mkphXn6HXHZeT8pRnnUAKf6OY+zb62/MxgUi+7CigMQuCwRPr6qkT8zIonAf3vAkyt4A0S16uoaXpsUk= I vote for Greg, a kext is a kernel extension, Apple made this document to discourage the Guiguizes who has terrific and uggly ideas... generally some folks who are used to develop on another platform... and live in a messy world... a exception can be done for Filesystems ext /Library/Filesystems/FS.fs/Contents/Resources/FS.kext but is still respect a clean fs deployment. I never seen this kind of horrors on FB. -mmw On Dec 6, 2007 11:03 PM, Rustam Muginov <dev_lists(a)mail.ru> wrote: > > From the other side, this article: > http://developer.apple.com/tools/installerpolicy.html > explicitly prohibits to put something into /System/Library folder and > recommends to use /Library instead: > > Off Limits > > The folder /System is for Apple use only. It holds important operating > system files, and everyone using the machine relies on this folder. > Apple-provided system libraries and file systems live here. If you do not > know if your software belongs in here, chances are that it does not. Mucking > around in /System can lead to machine instability. > Use Only in Extreme Cases > > The folder /Library contains files that extend the capabilities of the > operating system. Files located here are shared among all users of the > machine. If you write your own extension, such as a file system or Open > Directory plug-in, and it absolutely must be available to everyone, it can > go here. Or, if the user specified global availability during installation, > then use it. Notice the emphasis on letting the user decide: do not assume > that this is a good location. > > -- > Sincerely, > Rustam Muginov > > > > On 07.12.2007, at 9:54, Greg wrote: > > > I've a feeling many people are going to tell you not to do that. I'm not a > kernel expert, but here are the reasons I would give: > > 1) It also goes against Apple's philosophy of having designated folders for > things. For example, Apple recommends that you put your preferences (plist) > files in ~/Library/Preferences, any support data in ~/Library/Application > Support, etc. This keeps the system consistent, easy to back up and > troubleshoot, and avoids the clutter that occurs on other systems (Microsoft > Windows comes to mind). > > 2) System upgrades (e.g. going from 10.4 to 10.5) likely look for third > party extensions in specific locations, and /opt is not one of them. > > 3) The /opt folder does not exist by default on OS X systems, and when it > does, it usually belongs to the MacPorts project (http://www.macports.org/) > > 4) People will shun your product. There are a lot of mac users that will > take personal grudge against you for doing things in a "non-Apple way", and > they'll have reasons of their own for doing so. > > There are probably a lot more (better) reasons than that, but those are just > off the top of my head. > > - Greg > > On Dec 7, 2007, at 1:43 AM, JanakiRam wrote: > > > Hi All, > > I've developed a kext for my product . To have more control on > loading the kext (after login) , i'm planning to place it at custom location > ( /opt/myproductfolder) instead of /System/Library/Extensions. > > Can any one point out the pros & cons for the location change ? > > Any help/pointers will be greatly appreciated. Thanks in Advance. > > -JanakiRam. > > > _______________________________________________ > Do not post admin requests to the list. They will be ignored. > Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) > Help/Unsubscribe/Update your Subscription: > http://lists.apple.com/mailman/options/darwin-kernel/greg%40kinostudios.com > > This email sent to greg(a)kinostudios.com > > _______________________________________________ > Do not post admin requests to the list. They will be ignored. > Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) > Help/Unsubscribe/Update your Subscription: > http://lists.apple.com/mailman/options/darwin-kernel/dev_lists%40mail.ru > > This email sent to dev_lists(a)mail.ru > > > > _______________________________________________ > Do not post admin requests to the list. They will be ignored. > Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) > Help/Unsubscribe/Update your Subscription: > http://lists.apple.com/mailman/options/darwin-kernel/openspecies%40gmail.com > > This email sent to openspecies(a)gmail.com > -- -mmw _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0