June 2006 - Darwin-dev - lists.apple.com

Re: Metadata support
by Boyd Waters 26 Jun '06

26 Jun '06

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Jun 25, 2006, at 4:28 PM, Dan Shoop wrote: Not currently it seems. :( This seems to work already: $ xattr --set fred blue foo $ xattr --set barney red foo $ xattr --list foo foo barney red fred blue $ cp foo bar $ xattr --list bar bar barney red fred blue $ xattr --list ./roundTrip ./roundTrip (no extended attributes) Dan, thanks for these answers! - boyd Boyd Waters National Radio Astronomy Observatory Socorro, New Mexico _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com [Boyd Waters asked] Is there really no way to copy a file - along with *all* metadata* - in one operation? And probably it's going to be a very long wait, so long as Apple keeps cruft in .DS_Store's as said cruft would need to be copied between source and target .DS_Store's which is a Moreover Spotlight non-comment metadata isn't likely to get copied ever, but probably shouldn't be either; nor is there much value as the kernel can just re-create it. Hmm.. ok, I think I understand about the Spotlight meta-data being re- created: that's determined by the various Spotlight metadata importers, which pull info from the "data-data" of the file and populate various name/value pairs for the Spotlight search tool. I've written such a metadata-importer spec for Spotlight... But I'm more interested in storing other meta-data values in files as POSIX extended attributes, and I want any file operations to preserve those xattrs. So perhaps - for my use cases, anyway - the only thing I need to worry about is file transfer to non-Macintosh servers via ssh or rsync (that is, non-Mac-mounted filesystems). I've patched rsync on my Linux box to handle that, but scp needs a similar patch? (I see that Mac scp has the '-E' flag). $ scp foo host.loopback.edu:test-axttr foo 100% 0 0.0KB/s 00:00 $ scp host.loopback.edu:test-axttr ./roundTrip test-axttr 100% 0 0.0KB/s 00:00 smime.p7s

1 0

Re: Metadata support
by Dan Shoop 25 Jun '06

25 Jun '06

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Content-Type: multipart/signed; micalg=sha1; boundary=Apple-Mail-7--985797476; protocol="application/pkcs7-signature" On Jun 25, 2006, at 11:50 AM, Dan Shoop wrote: Not currently it seems. :( -dhan ------------------------------------------------------------------------ Dan Shoop AIM: iWiring Systems & Networks Architect http://www.ustsvs.com/ shoop(a)iwiring.net http://www.iwiring.net/ 1-714-363-1174 pgp key fingerprint: FAC0 9434 B5A5 24A8 D0AF 12B1 7840 3BE7 3736 DE0B iWiring provides systems and networks support for Mac OS X, unix, and Open Source application technologies at affordable rates. _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… At 2:32 PM -0600 6/25/06, Boyd Waters wrote: However copyfile() doesn't seem to preserve *all* the complete, necessary and expected data associated with Mac HFS[+] files nor does the ._file mechanism. Specifically symlink ownership, creation date, and file ID info for Aliases will get clobbered. And there's also Finder information and Spotlight data stored in the .DS_Store's And currently (10.4.6) there appears to be no shipping tool that can copy a file completely. ASR, hdiutil, ditto, cp (and copyfile() reliant mechanisms) all miss something. Sometimes rather badly. It would be nice if Apple would at least stuff the creation date in the ._file under OS X. :( Wow. Which is why this review of backup software found that only *one* of all the tools available will preserve all metadata: http://blog.plasticsfuture.org/2006/04/23/mac-backup-software-harmful/ In all fairness, the subset of tools covered there is limited. For instance that blog entry doesn't even mention tar (which fares worse than cp, btw) or using disk images for backup, nor does it even cover the popular backup sw package contenders (such as BRU, Retrospect, et al.) Also its focus is more towards backup than copying, which was the direction of the OP's question. But it does seem to nicely cover some of the issues I was referring to. Is there really no way to copy a file - along with *all* metadata* - in one operation? And probably it's going to be a very long wait, so long as Apple keeps cruft in .DS_Store's as said cruft would need to be copied between source and target .DS_Store's which is a Moreover Spotlight non-comment metadata isn't likely to get copied ever, but probably shouldn't be either; nor is there much value as the kernel can just re-create it. -- This email sent to site_archiver(a)lists.apple.com

1 0

Re: Metadata support
by Boyd Waters 25 Jun '06

25 Jun '06

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Jun 25, 2006, at 11:50 AM, Dan Shoop wrote: - boyd Boyd Waters National Radio Astronomy Observatory Socorro, New Mexico _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com However copyfile() doesn't seem to preserve *all* the complete, necessary and expected data associated with Mac HFS[+] files nor does the ._file mechanism. Specifically symlink ownership, creation date, and file ID info for Aliases will get clobbered. And there's also Finder information and Spotlight data stored in the .DS_Store's And currently (10.4.6) there appears to be no shipping tool that can copy a file completely. ASR, hdiutil, ditto, cp (and copyfile() reliant mechanisms) all miss something. Sometimes rather badly. It would be nice if Apple would at least stuff the creation date in the ._file under OS X. :( Wow. Which is why this review of backup software found that only *one* of all the tools available will preserve all metadata: http://blog.plasticsfuture.org/2006/04/23/mac-backup-software-harmful/ Is there really no way to copy a file - along with *all* metadata* - in one operation? smime.p7s

1 0

Re: Metadata support
by Dan Shoop 25 Jun '06

25 Jun '06

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On 25/06/2006, at 8:05 AM, Tomas Zahradnicky wrote: Hello, -dhan ------------------------------------------------------------------------ Dan Shoop AIM: iWiring Systems & Networks Architect http://www.ustsvs.com/ shoop(a)iwiring.net http://www.iwiring.net/ 1-714-363-1174 pgp key fingerprint: FAC0 9434 B5A5 24A8 D0AF 12B1 7840 3BE7 3736 DE0B iWiring provides systems and networks support for Mac OS X, unix, and Open Source application technologies at affordable rates. _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… At 6:02 PM +1000 6/25/06, Q wrote: I've noticed that tar is able to store files' metadata and in order to preserve it, it adds ._FILENAME file that appears to store FileInfo and file's resource fork if there's one. Anyone knows if this process is somewhere documented including the information it stores beyond the raw resource fork? Check out copyfile() included in the LibC library on tiger. The source file copyfile.c (in the LibC source bundle from ADC) will tell you everything you need to know about what's in those '._*' files. My app uses libtar and when I extract everything, I need to recombine ._files back into their owners. I have written something that appears to work but would like to be sure I restored everything I had to. If you are making a tiger only app you can just use copyfile() included in LibC, this is what the tiger unix tools like tar, cp, rsync, etc use. However copyfile() doesn't seem to preserve *all* the complete, necessary and expected data associated with Mac HFS[+] files nor does the ._file mechanism. Specifically symlink ownership, creation date, and file ID info for Aliases will get clobbered. And there's also Finder information and Spotlight data stored in the .DS_Store's And currently (10.4.6) there appears to be no shipping tool that can copy a file completely. ASR, hdiutil, ditto, cp (and copyfile() reliant mechanisms) all miss something. Sometimes rather badly. It would be nice if Apple would at least stuff the creation date in the ._file under OS X. :( -- This email sent to site_archiver(a)lists.apple.com

1 0

Re: Metadata support
by Q 25 Jun '06

25 Jun '06

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Domainkey-signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:in-reply-to:references:mime-version:content-type:message-id:cc:content-transfer-encoding:from:subject:date:to:x-mailer; b=GBA5X6J7vKr0i4nCtNSelBdbglCxBrCiNKByEUBF/TQdLckpo6BaPeZhIu4hXEu16fX0lQEOcUE1bN5QkChm33PQFd5QsLrY105GuxoegdMezroxqb+EXAlt1dHrlKzT3K8bA8CJUb/Nidge6+p366CidAjNM+DGQmK8kR6R5IU= On 25/06/2006, at 8:05 AM, Tomas Zahradnicky wrote: Hello, -- Seeya...Q -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- _____ / Quinton Dolan - qdolan(a)gmail.com __ __/ / / __/ / / / __ / _/ / / Gold Coast, QLD, Australia __/ __/ __/ ____/ / - / Ph: +61 419 729 806 _______ / _\ _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… I've noticed that tar is able to store files' metadata and in order to preserve it, it adds ._FILENAME file that appears to store FileInfo and file's resource fork if there's one. Anyone knows if this process is somewhere documented including the information it stores beyond the raw resource fork? Check out copyfile() included in the LibC library on tiger. The source file copyfile.c (in the LibC source bundle from ADC) will tell you everything you need to know about what's in those '._*' files. My app uses libtar and when I extract everything, I need to recombine ._files back into their owners. I have written something that appears to work but would like to be sure I restored everything I had to. If you are making a tiger only app you can just use copyfile() included in LibC, this is what the tiger unix tools like tar, cp, rsync, etc use. This email sent to site_archiver(a)lists.apple.com

1 0

Re: Metadata support
by Boyd Waters 24 Jun '06

24 Jun '06

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Jun 24, 2006, at 4:05 PM, Tomas Zahradnicky wrote: Hello, Doesn't the utility in /Developer/Tools/FixupResourceForks do this already? man FixupResourceForks I think you could use this utility in a shell wrapper to do the trick. Oh -- it's also in /System/Library/CoreServices/FixupResourceForks so you don't need to rely upon developer tools to be installed. - boyd Boyd Waters Socorro, New Mexico _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com I've noticed that tar is able to store files' metadata and in order to preserve it, it adds ._FILENAME file that appears to store FileInfo and file's resource fork if there's one. Anyone knows if this process is somewhere documented including the information it stores beyond the raw resource fork? My app uses libtar and when I extract everything, I need to recombine ._files back into their owners. I have written something that appears to work but would like to be sure I restored everything I had to. smime.p7s

1 0

[SOLVED] Re: configure: error: Kerberos 5 DES libraries not found
by Uli Zappe 24 Jun '06

24 Jun '06

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Hi, I was finally able to solve this, but the solution seems weird. Unfortunately, configure stalls with the following error: checking for Kerberos V in /usr... found checking for des_string_to_key in -lcrypto... no checking for des_string_to_key in -lk5crypto... no checking for krb5_c_string_to_key in -lk5crypto... no configure: error: Kerberos 5 DES libraries not found Bye Uli ________________________________________________________ Uli Zappe, Solmsstraße 5, D-65189 Wiesbaden, Germany http://www.ritual.org Fon: +49-700-ULIZAPPE Fax: +49-700-ZAPPEFAX ________________________________________________________ _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… I'm trying to recompile the current Darwin source of fetchmail (fetchmail-14, which is fetchmail 6.2.5). This was by using make with Apple's wrapper makefile in the fetchmail-14 distribution. Now it just occurred to me to try and use configure directly from the shell, with exactly the flags specified in Apple's wrapper makefile - and though it certainly shouldn't make any difference, this works. God knows why ... This email sent to site_archiver(a)lists.apple.com

1 0

Re: Metadata support
by Tommy Nordgren 24 Jun '06

24 Jun '06

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com 25 jun 2006 kl. 00.05 skrev Tomas Zahradnicky: Hello, Thanks, Tomas -- # Ing. Tomas Zahradnicky, Jr. # The Czech Technical University # Dept of Computer Science, FEE-CTU Prague _______________________________________________ _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… I've noticed that tar is able to store files' metadata and in order to preserve it, it adds ._FILENAME file that appears to store FileInfo and file's resource fork if there's one. Anyone knows if this process is somewhere documented including the information it stores beyond the raw resource fork? My app uses libtar and when I extract everything, I need to recombine ._files back into their owners. I have written something that appears to work but would like to be sure I restored everything I had to. You might try the book Mac OS X Tiger for Unix Geeks (ISBN 0-596-00912-7), from Oreilly. It appears to contain some material on this subject. ------------------------------------- This sig is dedicated to the advancement of Nuclear Power Tommy Nordgren tommy.nordgren(a)chello.se This email sent to site_archiver(a)lists.apple.com

1 0

Metadata support
by Tomas Zahradnicky 24 Jun '06

24 Jun '06

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Hello, Thanks, Tomas -- # Ing. Tomas Zahradnicky, Jr. # The Czech Technical University # Dept of Computer Science, FEE-CTU Prague _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… I've noticed that tar is able to store files' metadata and in order to preserve it, it adds ._FILENAME file that appears to store FileInfo and file's resource fork if there's one. Anyone knows if this process is somewhere documented including the information it stores beyond the raw resource fork? My app uses libtar and when I extract everything, I need to recombine ._files back into their owners. I have written something that appears to work but would like to be sure I restored everything I had to. This email sent to site_archiver(a)lists.apple.com

1 0

configure: error: Kerberos 5 DES libraries not found
by Uli Zappe 24 Jun '06

24 Jun '06

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Hi everybody, Unfortunately, configure stalls with the following error: checking for Kerberos V in /usr... found checking for des_string_to_key in -lcrypto... no checking for des_string_to_key in -lk5crypto... no checking for krb5_c_string_to_key in -lk5crypto... no configure: error: Kerberos 5 DES libraries not found The required libraries are (obviously) present: Any idea how I can get fetchmail compiled successfully? Thanks in advance for any reply! Bye Uli ________________________________________________________ Uli Zappe, Solmsstraße 5, D-65189 Wiesbaden, Germany http://www.ritual.org Fon: +49-700-ULIZAPPE Fax: +49-700-ZAPPEFAX ________________________________________________________ _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… since I want to fix a bug in fetchmail, I'm trying to recompile the current Darwin source of fetchmail (fetchmail-14, which is fetchmail 6.2.5). %% lsa /usr/lib/ | grep crypto -rwxr-xr-x 1 root wheel - 1209056 Jun 24 04:57 libcrypto. 0.9.7.dylib* -rwxr-xr-x 1 root wheel - 920352 Jun 24 04:57 libcrypto. 0.9.dylib* lrwxr-xr-x 1 root wheel - 21 Mar 2 07:23 libcrypto.dylib@ -> libcrypto.0.9.7.dylib lrwxr-xr-x 1 root wheel - 54 Mar 2 07:23 libk5crypto.dylib@ -> /System/Library/Frameworks/Kerberos.framework/ Kerberos This email sent to site_archiver(a)lists.apple.com

1 0