April 2005 - Darwin-dev - lists.apple.com

Re: Overwhelming Disk Cache?
by Matt Watson 06 Apr '05

06 Apr '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com matt. _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… You could try the fts(3) routines. They use various techniques to minimize system overhead when recursing over the filesystem. This email sent to site_archiver(a)lists.apple.com

1 0

Re: Overwhelming Disk Cache?
by John Francini 06 Apr '05

06 Apr '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com John Francini On Apr 6, 2005, at 14:26, Charles Jolley wrote: Hi: Thanks! -Charles _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/francini%40mac.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Scanning through files with fstat(2) will indeed fill up the cache, but this should only cause slowdowns, not failures. Failures imply that something else is going wrong: the system can't expand virtual memory enough and it's killing processes instead, or (more likely) the high activity level is exercising a problem with your memory. You haven't done anything like re-locate the swapfile to a separate partition or changed the arguments to dynamic_pager? Also, does this occur on more than one Mac? If so (and if the other Mac(s) are stock), it's probably an OS bug. Nothing that an unprivileged user can do (aside from filling up the filesystem) should cause other processes to crash. I have a little command line utility that scans through some files, calling fstat on each of them. The problem is when I test this with a large number of files (about 180,000), I start having problems thoughout my system while the scan in running. Copying files in the Finder will sometimes fail; apps will die while accessing files and so on. Even the scanner's stat calls will failnow and then. I suspect the problem is that my scanner is exhausting the file caches or something like that causing file system calls to fail. But I'm not sure. Has anyone else run into this kind of problem? Do you know why a tight loop calling fstat on files would be causing this problem? What is the best way to fix this? I could sleep() between calls I suppose, but I would like to make this as fast as possible. This email sent to francini(a)mac.com This email sent to site_archiver(a)lists.apple.com

1 0

Re: Overwhelming Disk Cache?
by Shawn Erickson 06 Apr '05

06 Apr '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Apr 6, 2005, at 11:26 AM, Charles Jolley wrote: Hi: -Shawn _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… I have a little command line utility that scans through some files, calling fstat on each of them. The problem is when I test this with a large number of files (about 180,000), I start having problems thoughout my system while the scan in running. Copying files in the Finder will sometimes fail; apps will die while accessing files and so on. Even the scanner's stat calls will failnow and then. I suspect the problem is that my scanner is exhausting the file caches or something like that causing file system calls to fail. But I'm not sure. Has anyone else run into this kind of problem? Do you know why a tight loop calling fstat on files would be causing this problem? What is the best way to fix this? Also what file systems types (local or remote?) and version of Mac OS X are involved? This email sent to site_archiver(a)lists.apple.com

1 0

Re: Overwhelming Disk Cache?
by Shawn Erickson 06 Apr '05

06 Apr '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Apr 6, 2005, at 11:26 AM, Charles Jolley wrote: Hi: What type of failures are you seeing specifically? -Shawn _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… I have a little command line utility that scans through some files, calling fstat on each of them. The problem is when I test this with a large number of files (about 180,000), I start having problems thoughout my system while the scan in running. Copying files in the Finder will sometimes fail; apps will die while accessing files and so on. Even the scanner's stat calls will failnow and then. Do they seem to happen for files that you are scanning at the same time the some thing else is attempting to use/access the file? This email sent to site_archiver(a)lists.apple.com

1 0

Overwhelming Disk Cache?
by Charles Jolley 06 Apr '05

06 Apr '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Hi: Thanks! -Charles _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… I have a little command line utility that scans through some files, calling fstat on each of them. The problem is when I test this with a large number of files (about 180,000), I start having problems thoughout my system while the scan in running. Copying files in the Finder will sometimes fail; apps will die while accessing files and so on. Even the scanner's stat calls will failnow and then. I suspect the problem is that my scanner is exhausting the file caches or something like that causing file system calls to fail. But I'm not sure. Has anyone else run into this kind of problem? Do you know why a tight loop calling fstat on files would be causing this problem? What is the best way to fix this? I could sleep() between calls I suppose, but I would like to make this as fast as possible. This email sent to site_archiver(a)lists.apple.com

1 0

PICT Previews with alpha channel
by Stremming, Marcel 04 Apr '05

04 Apr '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Thread-index: AcU5V9YhEU8YLPMORzyz+cZ3ImYsPg== Thread-topic: PICT Previews with alpha channel Hi all, I am not sure, if this is the corret list to post this question to. My apologies in advance if this was a wrong choice. My problem are EPS files (Vector EPF from Adobe Illustrator) from which I only have the datafork. For placement in QXP I need a PICT preview in the resourcefork. Therefore I have to generate a suitable PICT preview from the datafork and put it into the resourcefork. All this has to be done on a Helios file server under unix (using ImageMagick). This far, there is no problem. I managed to do that. The Problem however is generating a suitable PICT preview. My Previews work inside QXP, despite of the fact, that the alpha channel does not work. I am sure, that my PICTs actually have an alphachannel, but still QXP does not accept them as transparent. There must be soming special about those PICT previews, which work inside QXP. Does anyone here have experience with this matter? Best Regards, Marcel. _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

unsubscribe stupid address=fclee@highstream.net
by Frederick C. Lee 01 Apr '05

01 Apr '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0