October 2009 - Darwin-dev - lists.apple.com

Re: How to work on case-sensitive projects?
by Kevin Van Vechten 07 Oct '09

07 Oct '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Oct 7, 2009, at 10:40 AM, Alastair Houghton wrote: On 7 Oct 2009, at 18:30, Kevin Van Vechten wrote: On Oct 7, 2009, at 10:23 AM, Alastair Houghton wrote: Kevin _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… HFS+, however, has an option to be case-sensitive, and you can format such a filesystem with Disk Utility or third-party software such as (shameless plug) iPartition. [...] In the meantime, you can create a case-sensitive HFS+ filesystem somewhere (e.g. in a disk image, in another partition, on an external disk, or mounted over the network) where you'll get the behaviour you want. Minor nit: HFS+ is case-preserving but not case-sensitive. HFSX (a minor revision to the HFS+ volume format) optionally supports case- sensitive file names. HFSX is really just a shorthand notation though. The UI generally refers to "Mac OS Extended" (i.e. HFS+), and puts annotations such as case-sensitive and journaled in parentheses afterwards. IIRC the name "HFSX" comes from the Apple Partition Map type code ("Apple_HFSX") and *that* only exists to stop older software from getting confused when it finds it, and only then because people weren't checking the filesystem version number in the volume header. When using command line utilities such as diskutil and hdiutil you'll want to specify HFSX not HFS+. Yes. That doesn't make HFSX the name, however, any more than JHFS+ or HFS+J is the name of HFS+ with a journal. I maintain that the filesystem itself is either called "HFS+" or "Mac OS Extended" and that case-sensitivity is an *option*. This is borne out by the fact that there is only a single partition type in GPTs for both kinds of HFS+. Maintain all you want, but my comment was purely for practical purposes. From hdiutil(1): -fs filesystem where filesystem is one of HFS+, HFS+J (JHFS+), HFSX, JHFS+X, MS-DOS, or UDF. Also, from TN1150 <http://developer.apple.com/mac/library/technotes/tn/tn1150.html >: "A variant of HFS Plus, called HFSX, allows volumes whose names are compared in a case-sensitive fashion. The names are fully decomposed and in canonical order, but no Unicode characters are ignored during the comparison." This email sent to site_archiver(a)lists.apple.com

1 0

Re: How to work on case-sensitive projects?
by Alastair Houghton 07 Oct '09

07 Oct '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha1; c=relaxed; d=alastairs-place.net; h= subject:mime-version:content-type:from:in-reply-to:date:cc: content-transfer-encoding:message-id:references:to; q=dns/txt; s= aug07; bh=vBCVWuOK6Wy1eRsezw28yqsDF5c=; b=e92RjOPlGWqh6xMgqrKyxJ 5s1RMFcqpErX5rpeQ5xOCs8GIOLwoTVBh9tQd0/UEJYQoNvCHJmF24IcFEuiLB0b w9ZF8Z1jpWON+P0a5YOv2kEP9yrh+npS0z2Puag1e7fZDVZKXbloCGl/ZANVye6P sKsy1zOC6x1QH6/hufejA= On 7 Oct 2009, at 18:29, Allen Curtis wrote: *HFS* is indeed preserving but not sensitive. *HFS+* is always preserving, but *optionally* sensitive. 1. Run Disk Utility. 2. Choose File > New > Blank Disk Image. 4. Click "Create". It will need to be mounted manually. Kind regards, Alastair. -- http://alastairs-place.net _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Thanks for the explanation. BUT, my question was regarding which file systems where case-sensitve vs. case-preserving. I understand the difference. Another response that I had received indicated that HFS was preserving not sensitive. BTW: This will be a problem for any Linux kernel developer wishing to use their Mac for development. The problem is the stupid decision on the part of the Linux kernel people to have filenames that differ only by case in their source tree. True, but it is something that needs to be dealt with..... Ideally by the Linux kernel maintainers fixing their source tree (though doubtless they don't think it's a problem), but in the meantime there is an easy workaround. In the meantime, you can create a case-sensitive HFS+ filesystem somewhere (e.g. in a disk image, in another partition, on an external disk, or mounted over the network) where you'll get the behaviour you want. Thanks... Can you point me to an example of creating and mounting a HFS+ file, filesystem? Will it auto mount on reboot or will it need to be mounted manually? 3. Set things up how you like (you might consider using a sparse disk image or a sparse bundle image to save space). This email sent to site_archiver(a)lists.apple.com

1 0

Re: How to work on case-sensitive projects?
by Alastair Houghton 07 Oct '09

07 Oct '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha1; c=relaxed; d=alastairs-place.net; h= subject:mime-version:content-type:from:in-reply-to:date:cc: content-transfer-encoding:message-id:references:to; q=dns/txt; s= aug07; bh=pzAlGHOMU9IxM+os15gBTAFBFH8=; b=lv9PiHoaMui3dRzcYppn2X vnJn0tELzUHHrSBee5AJan3MM22GpKAoBy+aRLaIqkyQdapW6SGhGTdchpvrhvfx XtzM2dlcDwkkLytNvqwAw5pctQX/Kq+kHHTiR+eA0EdNlumTQfWj4RcLGs/WTrbi BQYdFM4yecGDtgojgKRuY= On 7 Oct 2009, at 18:30, Kevin Van Vechten wrote: On Oct 7, 2009, at 10:23 AM, Alastair Houghton wrote: Kind regards, Alastair. -- http://alastairs-place.net _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… HFS+, however, has an option to be case-sensitive, and you can format such a filesystem with Disk Utility or third-party software such as (shameless plug) iPartition. [...] In the meantime, you can create a case-sensitive HFS+ filesystem somewhere (e.g. in a disk image, in another partition, on an external disk, or mounted over the network) where you'll get the behaviour you want. Minor nit: HFS+ is case-preserving but not case-sensitive. HFSX (a minor revision to the HFS+ volume format) optionally supports case- sensitive file names. HFSX is really just a shorthand notation though. The UI generally refers to "Mac OS Extended" (i.e. HFS+), and puts annotations such as case-sensitive and journaled in parentheses afterwards. IIRC the name "HFSX" comes from the Apple Partition Map type code ("Apple_HFSX") and *that* only exists to stop older software from getting confused when it finds it, and only then because people weren't checking the filesystem version number in the volume header. When using command line utilities such as diskutil and hdiutil you'll want to specify HFSX not HFS+. Yes. That doesn't make HFSX the name, however, any more than JHFS+ or HFS+J is the name of HFS+ with a journal. I maintain that the filesystem itself is either called "HFS+" or "Mac OS Extended" and that case-sensitivity is an *option*. This is borne out by the fact that there is only a single partition type in GPTs for both kinds of HFS+. This email sent to site_archiver(a)lists.apple.com

1 0

Re: How to work on case-sensitive projects?
by Allen Curtis 07 Oct '09

07 Oct '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:cc:message-id:from:to :in-reply-to:content-type:mime-version:subject:date:references :x-mailer; bh=RKmW6cfJSVUeGVqFQy9OJLxupVQSs2OPeis2WBPgDe0=; b=AxFV8YeVmN1A/WpIWXgknWRZlnvs60iOJGeGGDumoB+YyRVO6m71NkBQbctfkufZUm MitukDu1cDtfGgLMvdk9hPe92S9mnRciLfoGUsu7L2c4K9mDzd1m1avpMTgpJX8Mtizb hnUp29sRv4VsDhJzFv3dqJAjKTjXKukHl+7Jk= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=cc:message-id:from:to:in-reply-to:content-type:mime-version:subject :date:references:x-mailer; b=s4sas4AfQes5UJfcYKT8YnZxKGG7TgNzKhhRk9PdUiHHbnzOCTvTYwm+RtRZT0DUjQ TMr8zuUmT8GyiYTYlpS2HJUaoq1olq+NvRXsPQ+us3qka1WT/u0chHbkCFhhGHF/UVat WE5Nyd7H2gwfL+6R3kH0a+bwO73GMErvwxExc= _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Using mmap to extend an existing mapping?
by Jens Alfke 07 Oct '09

07 Oct '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com —Jens _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… I'm calling mmap to create a new mapping of a file. Later on I append data to the file (just using regular write calls) and then I want to map in the new data. If possible I want to grow the existing mapping in place, to avoid invalidating all the existing pointers. Based on the mmap(2) man page, it sounded as though I could do this by passing in the base address of the old mapping and the MAP_FIXED flag; and it would replace the mapping with a larger one if possible, or return MAP_FAILED if there wasn't room. ::mmap(_start, newLength, PROT_READ, MAP_SHARED | MAP_FIXED, _fd, _position); Instead, what I see happening (by running vmmap(1) before and after the call) is that the mmap call blows away any other following VM regions to make room for my request. Since these regions are often things like stacks, object code or malloc heaps, this is immediately fatal. :-( Is there any way to get the behavior I want, where mmap will extend the mapping but will fail rather than deleting any other mappings? This email sent to site_archiver(a)lists.apple.com

1 0

Re: How to work on case-sensitive projects?
by Kevin Van Vechten 07 Oct '09

07 Oct '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: How to work on case-sensitive projects?
by Alastair Houghton 07 Oct '09

07 Oct '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha1; c=relaxed; d=alastairs-place.net; h= subject:mime-version:content-type:from:in-reply-to:date:cc: content-transfer-encoding:message-id:references:to; q=dns/txt; s= aug07; bh=ahjbMSJostiNDqLbs966+Dztgmw=; b=vRLe+HW3gh2y5mHQTkNesE vCDsoD5YCCJ8BBfW7o7iX1dlP3WthZujlHGrKxW2QTGlTBh70bVYrkNyrvYk6+Il uiYAARa8xOVUBhrLT97+w68AfxNDf17039TzIlbCbq9gjQdpQgIJFb/AWdLL1DEP obzJyucqG5uS03/kwlVDE= On 7 Oct 2009, at 18:09, Allen Curtis wrote: On 6 Oct 2009, at 20:08, Jamison Hope wrote: Kind regards, Alastair. -- http://alastairs-place.net _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Use a case sensitive file system. Have a disk partition formatted as UFS, or a UFS-formatted disk image and do your svn checkout there. I don't think Disk Utility can create a UFS disk image, but hdiutil can. http://codesnippets.joyent.com/posts/show/2084 I'd strongly recommend against using UFS, actually. Case-sensitive HFS+ is a much better option. Well, I am still a little confused about which is case-sensitive vs. case-preserving. In my case, it must be case-sensitive. Case-sensitive means that FOOBAR.C is a different file from foobar.c and from FooBar.C and so on. Case-sensitive filesystems are generally case-preserving (though there are implementations of FAT that are non- case-preserving but that are nevertheless case-sensitive... yes, this is stupid, before you ask). Case-preserving means that FOOBAR.C, foobar.c and FooBar.C are all the same file, *but* that you'll always see the filename *as you saved it*... so if you save it as "fOObAR.c", then that's what you'll see in a directory listing, even if you then open it up as "FOOBAR.C" (for instance). Case-preserving is what FAT32, VFAT, NTFS (except when accessed from the POSIX subsystem, at which point it behaves case-sensitively [yes, really... and yes, that can cause havoc for Windows native software]) and standard HFS+ do. HFS+, however, has an option to be case- sensitive, and you can format such a filesystem with Disk Utility or third-party software such as (shameless plug) iPartition. There are systems that are neither case-sensitive nor case-preserving (various implementations of FAT are like this, for example), so when you save "FOOBAR.C", "foobar.c", "FooBar.C" or whatever, you'll get either "FOOBAR.C" or "foobar.c" depending on the preference of the filesystem's developer. BTW: This will be a problem for any Linux kernel developer wishing to use their Mac for development. The problem is the stupid decision on the part of the Linux kernel people to have filenames that differ only by case in their source tree. In the meantime, you can create a case-sensitive HFS+ filesystem somewhere (e.g. in a disk image, in another partition, on an external disk, or mounted over the network) where you'll get the behaviour you want. This email sent to site_archiver(a)lists.apple.com

1 0

Re: How to work on case-sensitive projects?
by Allen Curtis 07 Oct '09

07 Oct '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:cc:message-id:from:to :in-reply-to:content-type:content-transfer-encoding:mime-version :subject:date:references:x-mailer; bh=hAz6Kh/nGotm215SGAZx34dKMIAaYE166lpK1O31XEk=; b=DfvK+C6blFbf2K98QNFCp5sfhDQtn7/pDhxa/lICkjrj6RQEv87rL6f6QH6Q29AM6Z vyyCaEmfE/Ojbm6zXIvO5EnVGT8hunKmKVr30NMLRvhyRw4euCHFjoaz7FNCfDnZW/BQ WuKYJuvp/f8ZXuVFXu1OUuuMmgiCKBv5tWmug= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=cc:message-id:from:to:in-reply-to:content-type :content-transfer-encoding:mime-version:subject:date:references :x-mailer; b=eEtUdtjdOlKBaaN3jS4EJ9gdec0pWiwShhbZlkh3Lj3J8EqN7V1ARnRfgBb88Q9Vjq d77AASpCXFxiabHhjQt2TCrQQkv8p64FuNKxYLtnwOCkU6c1WTF8QTvlQfi7c9uAhSg1 zyeP2uL1H3/Soh1IFE/e03TOjDmTBPsNoqLm8= On 6 Oct 2009, at 20:08, Jamison Hope wrote: _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Use a case sensitive file system. Have a disk partition formatted as UFS, or a UFS-formatted disk image and do your svn checkout there. I don't think Disk Utility can create a UFS disk image, but hdiutil can. http://codesnippets.joyent.com/posts/show/2084 I'd strongly recommend against using UFS, actually. Case-sensitive HFS+ is a much better option. Well, I am still a little confused about which is case-sensitive vs. case-preserving. In my case, it must be case-sensitive. BTW: This will be a problem for any Linux kernel developer wishing to use their Mac for development. This email sent to site_archiver(a)lists.apple.com

1 0

Re: How to work on case-sensitive projects?
by Alastair Houghton 07 Oct '09

07 Oct '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha1; c=relaxed; d=alastairs-place.net; h= subject:mime-version:content-type:from:in-reply-to:date:cc: content-transfer-encoding:message-id:references:to; q=dns/txt; s= aug07; bh=l5PU+cclTfzjWlWLZ5wmbPB681E=; b=C89G57CgeiKBImFYItB0ew xy2poGHx6/jo6MwLsJlOP3EOiiEYesipTlgqAiB5ExEn/e7FQhXGHRNVCIFmfodP KCnEAvahwZBlEoMN09pGEJk1HhdWZOCAPbm1DTgwOPkZPBWmdhmoBS0nBv/U+NpN JeALLp9mofWVUMq6MjTjI= On 6 Oct 2009, at 20:08, Jamison Hope wrote: Kind regards, Alastair. -- http://alastairs-place.net _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Use a case sensitive file system. Have a disk partition formatted as UFS, or a UFS-formatted disk image and do your svn checkout there. I don't think Disk Utility can create a UFS disk image, but hdiutil can. http://codesnippets.joyent.com/posts/show/2084 I'd strongly recommend against using UFS, actually. Case-sensitive HFS + is a much better option. This email sent to site_archiver(a)lists.apple.com

1 0

Snow Leopard, filter scheme prevents shutdown
by Andy Green 07 Oct '09

07 Oct '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Thread-index: AcpDVe2iX0dD53ooRCOezvRqwWXZ1wD0hRkg Thread-topic: Snow Leopard, filter scheme prevents shutdown (copied from darwin-drivers) I have a filter-scheme driver which is having some problems with snow leopard (10.6.1). I've stripped it down to the bare minimum (basically a transparent pass-through) and the problem still exists. It's not machine dependent - happens on several different systems, but only with snow leopard - tiger and leopard are OK. I've narrowed it down to synchronizeCache(IOService* client) - if I just return success, all is OK. If I forward to the provider, it never returns. The driver matches on 'whole' media, not on content hints (and uses recursion prevention via property). We have external USB and firewire devices, and the filter has active matching - probe() compares the device name. If it helps, I have a stripped-down sample that reproduces the problem. Using an external firewire disk, with 2 units (disks), the shutdown fails every time. We have seen similar results on USB, and with two single-LUN firewire disks, but it's harder to reproduce with those. If I log out, then shutdown from the login window, it's OK. If I format the disks as non-journalled, it's OK - so definitely something to do with cache flushing. If I manually eject just one media before shutting down, it's OK. Help! Thanks, Andy _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0