May 2005 - Darwin-dev - lists.apple.com

About Group, OpenDirectory, Active Directory and Unix philosophy
by Stéphane Sudre 25 May '05

25 May '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Now, the user is going to create a file in (his|her) mobile home folder. Is this wrong from an Unix philosophy point of view? _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Let's say I have a user which is authenticating (him|her)self against an Active Directory Server from (his|her) Mac OS X machine. This leads the uid tool showing some group ids which are not the standard ones (20,80,0,501, 502, etc.). For instance: 1547231201. Shall the gid for the file be the one of the parent folder (staff for instance) or the one shown by uid? Currently, for a tool, I'm setting the gid of the resulting file to the gid of the logged user (obtained with getgid()). Additionally, doing this prevents an Apple application from using the file whereas the uid for the file is perfectly correct and the permissions are rwx for the user. This email sent to site_archiver(a)lists.apple.com

1 0

Re: Bizarre out of memory bug
by Andrew Gallatin 25 May '05

25 May '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Can you run ktrace on it? I'd do this: 1) Login via the Bonjour name. Don't type any commands. 2) Login via the IP address. 3) Find the PID of the login from Bonjour. You can use the 'tty' command to exclude the current session combined with 'ps ax | grep tcsh' in the ssh session coming from the IP. 4) Ktrace the tsch shell from the Bonjour login: ktrace -di $PID_OF_TSCH_FROM_BONJOUR 5) type "ls" in the Bojour tcsh shell. 6) Use kdump to find what operation failed. Run kdump | less and search for the "out of memory" string. Drew _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Bizarre out of memory bug
by Chris Ridd 25 May '05

25 May '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com User-agent: Microsoft-Entourage/11.1.0.040913 On 25/5/05 9:47, Justin Walker <justin(a)mac.com> wrote: > > On May 25, 2005, at 11:59, Godfrey van der Linden wrote: > >> I'd say that the harddrive on yobgorgle is full. Some app is either >> leaking big time or your have to small a boot partition. >> >> Right now your only solution is probably to reboot the system. > > Well, at least he shouldn't have to reinstall :-} > > I'm not sure that a full drive is the issue: the OP did say that it > works without fail if he uses the raw IP address instead of the .local > DNS name. It sounds much more like something weird in the shell being used. I can't entirely see what, but changing the tcsh prompt to something static, or changing the shell itself as you suggested, could prove interesting. You can also connect with ssh without running a shell - I think with the -f flag - so you could try doing that and remove the shell from the list of potential problems. Cheers, Chris _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Bizarre out of memory bug
by Justin Walker 25 May '05

25 May '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On May 25, 2005, at 11:59, Godfrey van der Linden wrote: Well, at least he shouldn't have to reinstall :-} Cheers, Justin -- Justin C. Walker, Curmudgeon-At-Large Institute for General Semantics -------- Men are from Earth. Women are from Earth. Deal with it. -------- _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… I'd say that the harddrive on yobgorgle is full. Some app is either leaking big time or your have to small a boot partition. Right now your only solution is probably to reboot the system. I'm not sure that a full drive is the issue: the OP did say that it works without fail if he uses the raw IP address instead of the .local DNS name. This email sent to site_archiver(a)lists.apple.com

1 0

Re: LDAP, DirectoryService and loginwindow in Tiger
by Finlay Dobbie 25 May '05

25 May '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Domainkey-signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:reply-to:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=ZbToMZ0QSGDoHpCibWq76xKZ3rLun60chOVoSd7jJY5WwW2l5LDHbcvRNKolkmsOJSX2/v28UgRBKReWDG/cRuA239ndzfo9Kzw9WM6DtD14hj4/3UQqrbRp8bxWtoHvH/jInc+w3wYW+7vLFCI+m1dYZu11j1yPcQpj27yDFGs= Well, I filed two bugs if anybody cares. <rdar://problem/4130011> <rdar://problem/4130013> -- Finlay On 5/20/05, Finlay Dobbie <finlay.dobbie(a)gmail.com> wrote: > In Tiger, it looks like loginwindow's authentication is using > dsAuthMethodStandard:dsAuthNodeNativeCannotUseClearText rather than > dsAuthMethodStandard:dsAuthNodeNativeCanUseClearText > > However, the LDAPv3 plugin appears to only understand {crypt} and > {SMD5} format passwords. Generally it is recommended that {SHA1} or > {SSHA1} is used. > > The manifestation of this is that you can't log in to the GUI whilst > authenticating against an LDAP server whose user accounts have > passwords stored in SHA-1 hashes, but you can log in using ssh (and > possibly other stuff). > > Have I missed something? If not, I'll file a bug :-) > > -- Finlay > _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: fsevents oddities (was Re: EVFILT_VNODES?)
by Hamish Allan 25 May '05

25 May '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On 25 May 2005, at 18:03, Mike Smith wrote: I'm starting to get an impression! 1) $ mdfind hamishtest3 2) $ cat > foo.txt 3) hamishtest3 4) ^D 5) $ mdfind hamishtest3 6) /Users/hamish/foo.txt 7) $ mkdir bar 8) $ ln foo.txt bar/bar.txt 9) $ mdfind hamishtest3 10) /Users/hamish/foo.txt 11) $ cat >> bar/bar.txt 12) extra 13) ^D 14) $ mdfind hamishtest3 15) /Users/hamish/bar/foo.txt 16) $ rm foo.txt 17) $ mdfind hamishtest3 18) $ mdimport bar/bar.txt 19) $ mdfind hamishtest3 20) /Users/hamish/bar/foo.txt Thanks, Hamish _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Ah, you have no idea the can of worms into which you blithely dip. 8) There is a cache of names by which a vnode has been looked up; just terminal name components. There is a child->parent relationship maintained between a vnode and *one* parent in which it has been looked up. This cache is built as a side-effect of the lookup process, and persists in conjunction with the vnode cache. It's not assembled en masse at any particular point in time. Okay, I think I understand, but that still doesn't fully explain the following behaviour: In line 15 above, the last time the vnode for foo.txt was looked up was via /Users/hamish/bar/, so that's where foo.txt is reported. But there is no file /Users/hamish/bar/foo.txt, and nor has there ever been, so something is wrong with the caching. Whatever part of the system is caching foo.txt shouldn't be doing so once the write to bar/bar.txt has happened. And why, even after I've removed foo.txt and imported bar/bar.txt, hasn't it been updated yet in line 20? The "path to vnode" is assembled by traversing these relationships; there are transformations in the filesystem under which they cannot be correctly maintained, and if a file is looked up by two different paths, only one can be returned. I think I understand this now. So to find out a file's name from its vnode I ask the filesystem for a directory listing on the vnode in its parent cache (and to find out its pathname I do that recursively). I think that if the inverted index allowed multiple paths to be stored for a vnode, the correct behaviour could be achieved. Of course, some of my assumptions may not be correct. Any thoughts? How would you know which path to return? It would be good if you could return all of them: anything which would want a vnode-to-path-lookup would surely benefit from having them all? Instead of caching a single parent node, you would maintain a linked list (or whatever) of all parent nodes. I thought it might be possible to get similar functionality without writing a VFS by having a daemon monitor the creation of new directories (either in a particular place, or with Spotlight- searchable attributes) and fill them with hard links to Spotlight search results. To preserve the pathname of the files found, I would create the full directory structure within the given folder; I therefore wanted a way to monitor whether that structure had changed, in order to halt any live updating of results and turn it into a 'normal' folder Attempting to run a user process in lockstep with the filesystem is doomed from the start; don't do this. Isn't that what Spotlight is: a user process attempting to run in lockstep with the filesystem by means of the fsevents API?! Build your structure lazily in response to user requests rather than dragging the whole system down to a crawl. I figured that essentially I would be using part of the filesystem as a cache for search results, with the option of having that cache updated live. So there would be as many threads alive as live smart folders, but most of them would be idle most of the time. I hadn't really considered that this would adversely affect performance because I've never used a lot of smart folders, but it may not scale well to other users. You're definitely better off building your filesystem as a proper VFS module. I haven't found a great deal of information about how to go about this. I have gleaned bits and pieces, like that I should bundle this into a kext, without an explanation of how. Also I have little to no idea about how to debug kernel code. Any pointers, anyone? This email sent to site_archiver(a)lists.apple.com

1 0

Re: Bizarre out of memory bug
by Godfrey van der Linden 25 May '05

25 May '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Right now your only solution is probably to reboot the system. Godfrey On 05/25/2005, at 9:50 , Justin Walker wrote: Wow. On May 25, 2005, at 3:40, Tim Seufert wrote: [mightygorilla:~] tas% ssh yobgorgle Password: Welcome to Darwin! [yobgorgle:~] tas% ls tcsh: Out of memory. Connection to yobgorgle closed. [mightygorilla:~] tas% Truly strange. Have you tried changing the hostname? :-} A couple of thoughts: - did you also check the console log? - have you tried logging into an account with 'bash' or 'sh' as the default shell? [snip] Wow. I just don't know what to say. Me too. [snip] Anybody have any suggestions before I file a bug? Cheers, Justin -- Justin C. Walker, Curmudgeon at Large Institute for General Semantics ----------- My wife 'n kids 'n dog are gone, I can't get Jesus on the phone, But Ol' Milwaukee's Best is my best friend. ----------- _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/gvdl%40apple.com This email sent to gvdl(a)apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… I'd say that the harddrive on yobgorgle is full. Some app is either leaking big time or your have to small a boot partition. So I'm on my Powerbook (10.4.1), and SSH across the good old domestic WLAN to my G5 (Also 10.4.1). I get behavior like this: This tugs at a few loose memory strands. I have a vague recollection of similar behavior, perhaps with tcsh, having to do with something in the "rc" files in users' home directories. Bizarre thing #1: the G5 named "Yobgorgle" had roughly 2GB free RAM at the time of this event. Physical memory certainly isn't a problem. The only justification for the error in question is if some piece of code tried to allocate more address space than the kernel was willing to give a single process. Bizarre thing #2: So, "yobgorgle" is really "yobgorgle.local" since I have "local" in my search domains list. In other words, it's a Ren^h^h^h Bonjour name. On a whim, I decided to SSH to the actual IP address: Only to try to remove tcsh, or its startup files, from the picture. This is a beaut. This email sent to site_archiver(a)lists.apple.com

1 0

Re: (nevermind) which source is ioctl() implemented in?
by Godfrey van der Linden 25 May '05

25 May '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Now it even works for the C++ parts of the kernel too. Godfrey On 05/25/2005, at 9:58 , Justin Walker wrote: On May 25, 2005, at 5:29, Philip George wrote: nevermind found what i needed elsewhere _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Just for the record, if you are interested in kernel bits, you can, in the top level of the 'xnu' tree, type "make cscope", and you will get a cscope database that will help you navigate through the C-language part of the kernel (mostly, the 'bsd' component). See 'man cscope' for details. This email sent to site_archiver(a)lists.apple.com

1 0

Re: fsevents oddities (was Re: EVFILT_VNODES?)
by Mike Smith 25 May '05

25 May '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On May 25, 2005, at 7:29 AM, Hamish Allan wrote: Ah, you have no idea the can of worms into which you blithely dip. 8) This is not quite correct. How would you know which path to return? = Mike _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… But I don't really understand why this is the case -- surely a DELETE refers not to a vnode, but to an index entry, in which case the correct string ought to be able to be reported? Presumably there is an inverted index (from vnode to path) for every vnode on the filesystem. This must be populated at startup time, as Spotlight returns hamishtest2 for my mdfind query after a reboot. But the behaviour would suggest that although it can be added to for a fresh vnode, the entry for an existing vnode cannot be updated. And the entry is only cleared when the link count reaches zero. There is a cache of names by which a vnode has been looked up; just terminal name components. There is a child->parent relationship maintained between a vnode and *one* parent in which it has been looked up. This cache is built as a side-effect of the lookup process, and persists in conjunction with the vnode cache. It's not assembled en masse at any particular point in time. The "path to vnode" is assembled by traversing these relationships; there are transformations in the filesystem under which they cannot be correctly maintained, and if a file is looked up by two different paths, only one can be returned. I think that if the inverted index allowed multiple paths to be stored for a vnode, the correct behaviour could be achieved. Of course, some of my assumptions may not be correct. Any thoughts? This email is quite long already, but I'll give you a brief outline of my application. You may remember that I posted to this list recently about writing a Spotlight filesystem (http:// lists.apple.com/archives/darwin-dev/2005/May/msg00229.html) I thought it might be possible to get similar functionality without writing a VFS by having a daemon monitor the creation of new directories (either in a particular place, or with Spotlight- searchable attributes) and fill them with hard links to Spotlight search results. To preserve the pathname of the files found, I would create the full directory structure within the given folder; I therefore wanted a way to monitor whether that structure had changed, in order to halt any live updating of results and turn it into a 'normal' folder Attempting to run a user process in lockstep with the filesystem is doomed from the start; don't do this. Build your structure lazily in response to user requests rather than dragging the whole system down to a crawl. You're definitely better off building your filesystem as a proper VFS module. This email sent to site_archiver(a)lists.apple.com

1 0

Re: (nevermind) which source is ioctl() implemented in?
by Justin Walker 25 May '05

25 May '05

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On May 25, 2005, at 5:29, Philip George wrote: nevermind Regards, Justin -- Justin C. Walker, Curmudgeon-At-Large Institute for General Semantics -------- When LuteFisk is outlawed, Only outlaws will have LuteFisk -------- _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… found what i needed elsewhere Just for the record, if you are interested in kernel bits, you can, in the top level of the 'xnu' tree, type "make cscope", and you will get a cscope database that will help you navigate through the C-language part of the kernel (mostly, the 'bsd' component). See 'man cscope' for details. This email sent to site_archiver(a)lists.apple.com

1 0