June 2009 - Darwin-kernel - lists.apple.com

Re: Sources of _execve and __posix_spawn
by Dan Heller 02 Jun '09

02 Jun '09

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com They're in bsd/kern/kern_exec.c. Cheers, Dan On Jun 2, 2009, at 2:50 PM, Hans Aberg wrote: Hans Aberg _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/daniel.h%40apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… Where are the sources of _execve and __posix_spawn located? (Not in exec.c, posix_spawn.c.) This email sent to daniel.h(a)apple.com This email sent to site_archiver(a)lists.apple.com

1 0

Sources of _execve and __posix_spawn
by Hans Aberg 02 Jun '09

02 Jun '09

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Hans Aberg _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… Where are the sources of _execve and __posix_spawn located? (Not in exec.c, posix_spawn.c.) This email sent to site_archiver(a)lists.apple.com

1 0

Re: write(2) fails for large sizes in 64 bit applications
by Terry Lambert 02 Jun '09

02 Jun '09

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com What I am suggesting is to push write() closer to the standard, thus making porting applications to Mac OS X easier. Correct. I'd say it more forcefully. -- Terry _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… On Jun 2, 2009, at 5:37 AM, Quinn <eskimo1(a)apple.com> wrote: At 14:25 +0200 2/6/09, Robert Homann wrote: A laudable goal. Have you filed a bug about this? If not, please do. Our kernel engineers will need a bug on file before they take any action on this. <http://developer.apple.com/bugreporter/> Our change control process will not allow us to make arbitrary changes or commit time to doing work without some type of bug report or project attachment. It's very customer focussed. People can complain about things on mailing lists all they want, but unless someone writes up a bug, that's all they've done. An Apple engineer could see the complaint on a mailing list and write up a bug themselves, but that's going to have a lower priority than if it came from an outside developer report, particularly if it was standing in the way of the developer shipping a product. They might also opportunistically put in a fix while fixing something else related for which they already had a bug or project mandate. Neither one of the Apple unilateral actions is going to guarantee the developer will be satisfied with the fix, since they won't be the ones marking it verified, and the helpful engineers understanding of the original complaint may be imperfect. Assuming a new bug report, if an Apple engineer wrote this up, it'd be a P4 "Nice to have"; if a customer wrote it up, it'd be a P3 "Important", unless they could demonstrate that they had already shipped binary-only product, and the only thing that started triggering it was a change in data set size reasonably expected to be encountered by a lot of customers, at which point it would likely become P2 "Expected". This particular problem itself, though, is a bad example of something to argue passionately about, since the cause is understood, it's easily avoided, the operations in question are practically absurdly large, and the consequences of making the operations "work" will be large I/O stalls as the I/O request gets saturated at the disk, whose firmware doesn't allow the kernel driver to reorder in-flight requests based on later higher priority requests (i.e. the hardware itself is uncooperative with background I/O). Basically, the application is not playing nice with other applications or commodity disks. While it's also possible to "solve" the problem by shorting writes, as has been suggested, this is less satisfying aesthetically, from an extent allocation policy perspective (assuming disk writes), and pragmatically, based on experience of programmers only checking write return values for errors, rather than size. To avoid the I/O stall this clamp would also need to be rather small; it's hoped that the programmer would do this voluntarily, unless their application needed the I/O to all go at once, in which case we do what they tell us to do, to the best of our ability. If that's not a requirement, then this is back to a P3, with a strong hint that it should be a P4 based on it not being a problem in the first place if the application was a good citizen that had already been written to "play well with others" by voluntarily limiting its own I/O sizes. This email sent to site_archiver(a)lists.apple.com

1 0

Re: copy some kernel extensions to /tmp directory and then load that kext when program Launches
by mm w 02 Jun '09

02 Jun '09

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=WsCmNuwz7EWoX8y9pI/BHmNagVlv9ftg3WEPSYAFY7s=; b=q/ooOYoTHiVaEENazWMrNVjMXft6pRjcPmtLswbLjGHN2uXpceB/DHVC465PShJ2ot UqGJXeiE+ybrWyhwF7ealoERsMpbLpSQ8BlfG17xZg/JSRuqEAMzNYBUrICFkqBDBIYp Pze1/KHOKpdi8JJ/tna5tnsJqYnN4dq7RPXNw= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=Hsg0JiSw2m8iCMVVsx5x81La+wyW4DWqVNoKPMC4Z2/XtLC6BPQ3/rBUaGO+jKr8db 68ihinWaaXDvyWNDaZrE/4JF4tFFpOkt0z/4v/6GftZzX3x/QCiIdeQ0YfqNAO5x6CzH F77Pt9ohjuJhDLUcS7Pr/F+C9DjbcKSWp6AfI= Hello, just a really quick comment, imagine (when you are requesting and attaching your filter), you have 2 or 3 other "applications" using blocking sockets, what's happening? Best, On Tue, Jun 2, 2009 at 9:31 AM, Rahulkumar Tibdewal <rahulkumar_tibdewal(a)persistent.co.in> wrote: > Hi, > > Yes!!! Rightly said so. > > Well here are basic steps taken to implement feature. > > > 1. Setup the tag value associated with this NKE in preparation for swallowing pack and re-injecting them using mbuf_tag_id_find() > 2. Register the Network Kernel Extension, so it will attach the filter to every socket that system created using sflt_register() > 3. Register the IPV4 with domain AF_INET, type of SOCK_STREAm and TCP protocol. Using sflt_register() > 4. Register the IPV6 with domain AF_INET, type of SOCK_STREAm and TCP protocol. Using sflt_register() > 5. Now we register our control structure so that we can be found/communicated by user level process. Using ctl_register() > > -- this all is done in kext. > > 6. Now use setsockopt() so that block and unblock can be done. This is done Externally. > > > I hope this information is enough. When I block Internet, it takes 5-6 seconds. Whereas when we unblock, it works on a click. > Can u suggest something. > >> there are ways to force the door. > May I know what ways are u talking about. > > Thanks > Rahul > > -----Original Message----- > From: darwin-kernel-bounces+rahulkumar_tibdewal=persistent.co.in(a)lists.apple.com [mailto:darwin-kernel-bounces+rahulkumar_tibdewal=persistent.co.in@lists.apple.com] On Behalf Of mm w > Sent: Tuesday, June 02, 2009 9:15 PM > To: darwin-kernel(a)lists.apple.com > Subject: Re: copy some kernel extensions to /tmp directory and then load that kext when program Launches > > Hello, it's hard to say without seeing something there are several > options, timeouts, it's not because you are asking something that the > system won't delay your request (there are ways to force the door), if > you could describe your mechanism? anyway you could "block/redirect" > the traffic just by applying an ipfw rule, did you make a kext for > making a kext (the same privilege issue? ) or there are some other > reasons?, if you answer to those questions maybe people could answer, > we are not behind your computer or inside your project, so people need > to have a valuable description to make assumptions > > Best, > > On Tue, Jun 2, 2009 at 2:58 AM, Rahulkumar Tibdewal > <rahulkumar_tibdewal(a)persistent.co.in> wrote: >> Hi, >> >> Well If you remember I was working on developing a kext which can block the access to the internet of the Standard user(client) once server drops the message block internet. >> It's done. But the problem is delay. It takes normally 10 seconds to execute the command of stop internet on client machine. Is it due to kext or some thing else? >> How can we take care of this? >> >> Thanks >> Rahul >> >> >> >> DISCLAIMER >> ========== >> This e-mail may contain privileged and confidential information which is the property of Persistent Systems Ltd. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Persistent Systems Ltd. does not accept any liability for virus infected mails. >> > _______________________________________________ > Do not post admin requests to the list. They will be ignored. > Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) > Help/Unsubscribe/Update your Subscription: > http://lists.apple.com/mailman/options/darwin-kernel/rahulkumar_tibdewal%40… > > This email sent to rahulkumar_tibdewal(a)persistent.co.in > > DISCLAIMER > ========== > This e-mail may contain privileged and confidential information which is the property of Persistent Systems Ltd. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Persistent Systems Ltd. does not accept any liability for virus infected mails. > _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

RE: copy some kernel extensions to /tmp directory and then load that kext when program Launches
by Rahulkumar Tibdewal 02 Jun '09

02 Jun '09

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Thread-index: AcnjmUGUGWRzp2b2SwySMRLd+JqwNwAAuZGw Thread-topic: copy some kernel extensions to /tmp directory and then load that kext when program Launches Hi, Yes!!! Rightly said so. Well here are basic steps taken to implement feature. 1. Setup the tag value associated with this NKE in preparation for swallowing pack and re-injecting them using mbuf_tag_id_find() 2. Register the Network Kernel Extension, so it will attach the filter to every socket that system created using sflt_register() 3. Register the IPV4 with domain AF_INET, type of SOCK_STREAm and TCP protocol. Using sflt_register() 4. Register the IPV6 with domain AF_INET, type of SOCK_STREAm and TCP protocol. Using sflt_register() 5. Now we register our control structure so that we can be found/communicated by user level process. Using ctl_register() -- this all is done in kext. 6. Now use setsockopt() so that block and unblock can be done. This is done Externally. I hope this information is enough. When I block Internet, it takes 5-6 seconds. Whereas when we unblock, it works on a click. Can u suggest something. > there are ways to force the door. May I know what ways are u talking about. Thanks Rahul -----Original Message----- From: darwin-kernel-bounces+rahulkumar_tibdewal=persistent.co.in(a)lists.apple.com [mailto:darwin-kernel-bounces+rahulkumar_tibdewal=persistent.co.in@lists.apple.com] On Behalf Of mm w Sent: Tuesday, June 02, 2009 9:15 PM To: darwin-kernel(a)lists.apple.com Subject: Re: copy some kernel extensions to /tmp directory and then load that kext when program Launches Hello, it's hard to say without seeing something there are several options, timeouts, it's not because you are asking something that the system won't delay your request (there are ways to force the door), if you could describe your mechanism? anyway you could "block/redirect" the traffic just by applying an ipfw rule, did you make a kext for making a kext (the same privilege issue? ) or there are some other reasons?, if you answer to those questions maybe people could answer, we are not behind your computer or inside your project, so people need to have a valuable description to make assumptions Best, On Tue, Jun 2, 2009 at 2:58 AM, Rahulkumar Tibdewal <rahulkumar_tibdewal(a)persistent.co.in> wrote: > Hi, > > Well If you remember I was working on developing a kext which can block the access to the internet of the Standard user(client) once server drops the message block internet. > It's done. But the problem is delay. It takes normally 10 seconds to execute the command of stop internet on client machine. Is it due to kext or some thing else? > How can we take care of this? > > Thanks > Rahul > > > > DISCLAIMER > ========== > This e-mail may contain privileged and confidential information which is the property of Persistent Systems Ltd. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Persistent Systems Ltd. does not accept any liability for virus infected mails. > _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/rahulkumar_tibdewal%40… This email sent to rahulkumar_tibdewal(a)persistent.co.in DISCLAIMER ========== This e-mail may contain privileged and confidential information which is the property of Persistent Systems Ltd. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Persistent Systems Ltd. does not accept any liability for virus infected mails. _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: copy some kernel extensions to /tmp directory and then load that kext when program Launches
by mm w 02 Jun '09

02 Jun '09

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=BKrHgXuNRcAEmq0CA82ADvze+BANBU703R5lhigHzxg=; b=a4lWVYNFVydqNBDG8iv6ON69VQV+sZkASxvw2KhWXdRF2E5BwcEgQYtEWPhpL9XCaG wZ/uXixb0DYl8XxhsINN4toczlnW5/4v4kHDJDgzSuhp1fGlZsBQ65SNVZm5pAYYp1Vr XG6DBmkjRu+gkCyGs8ovn5fUESBkoFY/7E1sY= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=lLR99Vp9BZeLhN69ekg/R2AyoXsx/UfcmXHNchuT9l5LbjmL3YVaRbJm181Gr59EO0 aSslZ+Qdn1Jll+oMkRconuweszsMJCB1auJlZzkgRzDAIIN5VQFmFedukpEgXOF2n3TN o5XFp3qMy0hVpj9t4nZzNmeToouYKo2LnyVvs= Hello, it's hard to say without seeing something there are several options, timeouts, it's not because you are asking something that the system won't delay your request (there are ways to force the door), if you could describe your mechanism? anyway you could "block/redirect" the traffic just by applying an ipfw rule, did you make a kext for making a kext (the same privilege issue? ) or there are some other reasons?, if you answer to those questions maybe people could answer, we are not behind your computer or inside your project, so people need to have a valuable description to make assumptions Best, On Tue, Jun 2, 2009 at 2:58 AM, Rahulkumar Tibdewal <rahulkumar_tibdewal(a)persistent.co.in> wrote: > Hi, > > Well If you remember I was working on developing a kext which can block the access to the internet of the Standard user(client) once server drops the message block internet. > It's done. But the problem is delay. It takes normally 10 seconds to execute the command of stop internet on client machine. Is it due to kext or some thing else? > How can we take care of this? > > Thanks > Rahul > > > > DISCLAIMER > ========== > This e-mail may contain privileged and confidential information which is the property of Persistent Systems Ltd. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Persistent Systems Ltd. does not accept any liability for virus infected mails. > _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: write(2) fails for large sizes in 64 bit applications
by Quinn 02 Jun '09

02 Jun '09

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com What I am suggesting is to push write() closer to the standard, thus making porting applications to Mac OS X easier. <http://developer.apple.com/bugreporter/> S+E -- Quinn "The Eskimo!" <http://www.apple.com/developer/> Apple Developer Relations, Developer Technical Support, Core OS/Hardware _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… At 14:25 +0200 2/6/09, Robert Homann wrote: A laudable goal. Have you filed a bug about this? If not, please do. Our kernel engineers will need a bug on file before they take any action on this. This email sent to site_archiver(a)lists.apple.com

1 0

Re: write(2) fails for large sizes in 64 bit applications
by Robert Homann 02 Jun '09

02 Jun '09

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com On Fri, 29 May 2009, Jeremy Pereira wrote: Hello! > I think the behaviour is probably correct in that the OS X kernel is a > *32 bit* mach-o object, at least it is on my 10.5.7 Core 2 Duo Macbook > Pro. Yes, considering that the kernel is a 32 bit one, I think it is OK for some 32 bit limits to apply internally if the resulting behavior is still reasonable for 64 bit processes. The INT_MAX limitation of write() is correct for 32 bit processes, I would say, and I would expect to see some error when trying to pass larger values. A 64 bit process, however, should not see an error for large values, regardless of the underlying kernel implementation. Instead, write() should write the whole buffer, or just as much as the internal limit allows to - in this case INT_MAX - and return the number of bytes written to the caller. This is what I would have expected and what the standard suggests. > write(2) is a system call. The implementation is inside the kernel, > not in any user space library linked with your application. > Internally, it is going to be subject to 32 bit limits and personally > I think that is entirely reasonable. > > Whilst I admit the kernel could be changed to cope with larger > buffers, I think it is a bit harsh to criticise it because the largest > block it can write to a file in one go is a mere 2Gb, especially > considering some other 32 bit kernels can't run 64 bit code at all. What I am suggesting is to push write() closer to the standard, thus making porting applications to Mac OS X easier. It is not hard to accomplish in this case, so it should be done, no? (I haven't checked, but read() may expose similar behavior, so it should also be adapted for symmetry.) In case someone is interested: This whole issue was raised by an application that computes a large table in a malloc()'ed block (larger than 2GB), and dumps it to file using write(). I didn't expect any problems on OS X since I had no trouble on other systems. Now I have changed the program so to limit the number of bytes written at a time. It doesn't hurt much, but it took me some time to track down the problem. Best regards, Robert Homann -- Windows is not the answer. Windows is the question. The answer is "No". _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

RE: copy some kernel extensions to /tmp directory and then load that kext when program Launches
by Rahulkumar Tibdewal 02 Jun '09

02 Jun '09

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Thread-index: AcnftbGKLgxZTzqHQfWgDFpstUz1JADsna0g Thread-topic: copy some kernel extensions to /tmp directory and then load that kext when program Launches Hi, Well If you remember I was working on developing a kext which can block the access to the internet of the Standard user(client) once server drops the message block internet. It's done. But the problem is delay. It takes normally 10 seconds to execute the command of stop internet on client machine. Is it due to kext or some thing else? How can we take care of this? Thanks Rahul DISCLAIMER ========== This e-mail may contain privileged and confidential information which is the property of Persistent Systems Ltd. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Persistent Systems Ltd. does not accept any liability for virus infected mails. _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0