Re: Overwhelming Disk Cache?
Re: Overwhelming Disk Cache?
- Subject: Re: Overwhelming Disk Cache?
- From: John Francini <email@hidden>
- Date: Wed, 6 Apr 2005 15:03:29 -0400
Scanning through files with fstat(2) will indeed fill up the cache, but
this should only cause slowdowns, not failures. Failures imply that
something else is going wrong: the system can't expand virtual memory
enough and it's killing processes instead, or (more likely) the high
activity level is exercising a problem with your memory. You haven't
done anything like re-locate the swapfile to a separate partition or
changed the arguments to dynamic_pager?
Also, does this occur on more than one Mac? If so (and if the other
Mac(s) are stock), it's probably an OS bug. Nothing that an
unprivileged user can do (aside from filling up the filesystem) should
cause other processes to crash.
John Francini
On Apr 6, 2005, at 14:26, Charles Jolley wrote:
Hi:
I have a little command line utility that scans through some files,
calling fstat on each of them. The problem is when I test this with a
large number of files (about 180,000), I start having problems
thoughout my system while the scan in running. Copying files in the
Finder will sometimes fail; apps will die while accessing files and so
on. Even the scanner's stat calls will failnow and then.
I suspect the problem is that my scanner is exhausting the file caches
or something like that causing file system calls to fail. But I'm not
sure.
Has anyone else run into this kind of problem? Do you know why a
tight loop calling fstat on files would be causing this problem? What
is the best way to fix this?
I could sleep() between calls I suppose, but I would like to make this
as fast as possible.
Thanks!
-Charles
_______________________________________________
Do not post admin requests to the list. They will be ignored.
Darwin-dev mailing list (email@hidden)
Help/Unsubscribe/Update your Subscription:
This email sent to email@hidden
_______________________________________________
Do not post admin requests to the list. They will be ignored.
Darwin-dev mailing list (email@hidden)
Help/Unsubscribe/Update your Subscription:
This email sent to email@hidden