April 2007 - Darwin-dev - lists.apple.com

Re: ::select() and threads question, hopefully posed better :-)
by David Leimbach 13 Apr '07

13 Apr '07

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=gwd9ZJO8CtBLIzAOh1Obl8cBtPAvH5tpLFYPfTTNMWsEO9MbzbyZmL0ZzVsD+f1yYUSOp9TngaDpWrjGLz3vSEFfD8YRLuwgbTiGiCOLo8GfZD23gfcbe9ISldo7k5d2ik/xgWAwZFTkIeWuWUkpmz+2q6L8TRb8+lBfQyNllRA= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=QzGpVEZTnZ0g4fH69cKccjYi6VdFOeRLlzGJGksKmlKjFNpF7EaRay+LxRj+21Mh2kVWgGKWit868ZZ6KTcNal55cJXzR6qsi3ipoVDujh0Nuc+1yEz24SKcxlHx2AbGFk7OekLq9769L5sDvs+Ht8wUmeOoZ7JQDNFAFS1CGZs= On Apr 11, 2007, at 2:41 PM, jmzorko(a)mac.com wrote: > However, when I run the code, I see the OSX version taking up 4-5x > (or more, sometimes 10x) as much CPU as it does under Windows .... > > So, I said to myself, "self, you should check out that nifty Shark > app that ships with OSX, and see if you can find out what is taking > all the CPU" So, I did. I launched Shark, pointed it at my > process, selected Time Profile, and pressed Start. A minute or so > later, it came back and showed me lots of cool stuff, but the most > interesting thing was that, according to Shark, something like 60% > of the time my program was running, it was in > ml_set_interrupts_enabled. > > I said, "self, I don't know what that is, but let's see if it calls > something that I do know about." So I followed the arrows, and this > is what Shark told me: > >> ml_set_interrupts_enabled >> thread_block_reason >> thread_block >> uiomove >> selprocess >> select > > ... so the nature of my question is this: if 60% of the time my > program is running is spent in the above, how can I optimize it? As someone else posted, a thread executing along that path is blocked waiting for something else to happen. It is not consuming CPU cycles. What's happening on the other threads? Or in the other 40% of the time on that thread? Unless his select has a really short timeout right? Then it could wake up a lot in a loop. -Marc _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/leimy2k%40gmail.com This email sent to leimy2k(a)gmail.com -- - Passage Matthew 5:37: But let your communication be, Yea, yea; Nay, nay: for whatsoever is more than these cometh of evil. _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… On 4/11/07, Marc Epard <mepard(a)mac.com> wrote: This email sent to site_archiver(a)lists.apple.com

1 0

Re: [APPL:DarwinDev] launchd agent for securing mail through ssh tunnel
by Jay A. Kreibich 13 Apr '07

13 Apr '07

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com User-agent: Mutt/1.5.12-2006-07-14 On Fri, Apr 13, 2007 at 12:13:44PM +0200, Nicola Vitacolonna scratched on the wall: > Hi, > I use to read email through an ssh tunnel and I want to turn the task > into an on-demand launchd user agent. So far, I have come out with > the following, "nearly working", solution: > I have a couple of problems, though: > > 1) The first email sent during a session correctly triggers the ssh > tunnel on, but the mail client (I have tried with Apple Mail and > Thunderbird) hangs on "Connecting to localhost...". If I stop sending > the email and try again (now the tunnel is already active) the mail > is sent. Subsequent messages are also sent without any problem. This isn't as simple as it sounds. The problem is that "servers" (defined, for the purpose of this conversation, as anything that allows incoming network connections; in this case the local end of the ssh tunnel) that want to run "on demand" must be written in a special way. This is true of launchd, it is also true of launchd's predecessors, such as inetd and xinetd. In short, the problem is that launchd has control over the incoming network connection. When it detects an incoming connection (e.g. your mail program) it launches the defined on-demand program (your ssh tunnel). But after that it done, it needs some way to plumb together the network connection and the newly launched program. This requires an alternate input/output method in the on-demand server application. While sshd (the normal server daemon) supports this mode (-i), the ssh client does not. So your first connection triggers the startup of the tunnel, but it doesn't actually work, since the plumbing can't be connected correctly. The tunnel has started up, however, so subsequent connections work as expected. Google for "ssh tunnel inetd" to get some ideas on how people have worked around this. > 2) When I pull out the network cable (e.g., because I change > location), ssh quits after a while (see options ServerAliveInterval > and ServerAliveCountMax); it is respawned by launchd, however, no > matter how long it has been running. Since there is no network > available, ssh exits again, and so repearedly until the job is > eventually removed. So, I have to unload/load the plist when I > connect the cable again. This sounds odd. Without getting into the details, it sounds like launchd is not properly maintaining control over the ssh process (which is likely since most ssh tunnels are more of a daemon than a one-shot deal (required by on-demand); -f can somewhat reproduce this, but not well). There is also going to be issues if you don't turn your mail program off when your network connection is gone. I have a less clear picture of what is going on in this second case. Perhaps someone else has a better idea. -j -- Jay A. Kreibich < J A Y @ K R E I B I.C H > "'People who live in bamboo houses should not throw pandas.' Jesus said that." - "The Ninja", www.AskANinja.com, "Special Delivery 10: Pop!Tech 2006" _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Redirecting Output for a fork()'d Process
by Michael Smith 13 Apr '07

13 Apr '07

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Maybe you should use perror instead of/in addition to this printf, so you would get an English description of the problem (and your users would understand the error message easily, too. Filipe Cabecinhas printf("fopen failed on error: %d - redirectPath is: %s - line number: %d\n", errno, redirectPath, __LINE__); = Mike _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… On Apr 13, 2007, at 3:29 AM, darwin-dev-request(a)lists.apple.com wrote: On 13 Apr, 2007, at 03:06, David Alger wrote: Actually, this is precisely what the functions in <err.h> are for. See the manpages for err() and warn(). This email sent to site_archiver(a)lists.apple.com

1 0

launchd agent for securing mail through ssh tunnel
by Nicola Vitacolonna 13 Apr '07

13 Apr '07

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com I have a couple of problems, though: #!/usr/bash ssh -i etc etc... sleep 65 exit 0 Nicola _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Hi, I use to read email through an ssh tunnel and I want to turn the task into an on-demand launchd user agent. So far, I have come out with the following, "nearly working", solution: <?xml version="1.0" encoding="UTF-8"?> <!DOCTYPE plist PUBLIC "-//Apple Computer//DTD PLIST 1.0//EN" "http:// www.apple.com/DTDs/PropertyList-1.0.dtd"> <plist version="1.0"> <dict> <key>Label</key> <string>my.smtp.server</string> <key>OnDemand</key> <true/> <key>Program</key> <string>/usr/bin/ssh</string> <key>ProgramArguments</key> <array> <string>ssh</string> <string>-i</string> <string>/Users/myself/.ssh/my-ssh-key</string> <string>-l</string> <string>myself</string> <string>-N</string> <string>-q</string> <string>-T</string> <string>-o</string> <string>Protocol=2</string> <string>-o</string> <string>ConnectionAttempts=3</string> <string>-o</string> <string>ServerAliveCountMax=3</string> <string>-o</string> <string>ServerAliveInterval=5</string> <string>-o</string> <string>ExitOnForwardFailure=yes</string> <string>-L</string> <string>1200:localhost:25</string> <string>my.smtp.server</string> </array> <key>RunAtLoad</key> <false/> <key>ServiceDescription</key> <string>SSH tunnel from localhost:1200 to my.smtp.server:25</string> <key>Sockets</key> <dict> <key>Listeners</key> <dict> <key>SockServiceName</key> <string>1200</string> <key>SockType</key> <string>stream</string> </dict> </dict> </dict> </plist> 1) The first email sent during a session correctly triggers the ssh tunnel on, but the mail client (I have tried with Apple Mail and Thunderbird) hangs on "Connecting to localhost...". If I stop sending the email and try again (now the tunnel is already active) the mail is sent. Subsequent messages are also sent without any problem. 2) When I pull out the network cable (e.g., because I change location), ssh quits after a while (see options ServerAliveInterval and ServerAliveCountMax); it is respawned by launchd, however, no matter how long it has been running. Since there is no network available, ssh exits again, and so repearedly until the job is eventually removed. So, I have to unload/load the plist when I connect the cable again. I had thought that the last behaviour might depend on ssh exiting with code 255, so I have tried to wrap the ssh command into a script like this: and I have changed the plist to run this script, but the same problems exist. Any ideas? This email sent to site_archiver(a)lists.apple.com

1 0

Re: launchd question
by Jonas Maebe 13 Apr '07

13 Apr '07

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On 13 Apr 2007, at 00:26, jmzorko(a)mac.com wrote: Jonas _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Now, for my next trick, i'm going to make this app into the OSX equivalent of a Win32 service by making it run under launchd. This was really easy to do, but I noticed from the logs that this app writes, that launchd doesn't seem to be nicely shutting it down e.g. I think it just a kill -9. The app catches SIGINT and shuts down nicely when it gets it ... can I make launchd send it? The common way for daemons to be told to quit "in a friendly way" is by sending them a SIGTERM, not a SIGINT (SIGINT usually means "someone pressed ctrl-c"). This email sent to site_archiver(a)lists.apple.com

1 0

Re: Redirecting Output for a fork()'d Process
by Filipe Cabecinhas 13 Apr '07

13 Apr '07

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:in-reply-to:references:mime-version:content-type:message-id:cc:content-transfer-encoding:from:subject:date:to:x-mailer; b=g+H6sYLrd2TCZNP/o2vqE0Sxl+XtIWDhtyo6tNYt1iGXVcDgnMlGVNMGS1Sw+Rz07g2awrnHeQLXHKkIDjFjQEqlYT77/YwduH29/7zA0YxjWafIq4YW4SWYGTrjIyWhJPakk4/pgqYyxlHWaCAH9GI4yg7s+xzPWCqXCZW1jPU= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:in-reply-to:references:mime-version:content-type:message-id:cc:content-transfer-encoding:from:subject:date:to:x-mailer; b=B313hfs9l+QwGknm6cGO/OUgzjKg8R/hfgQgbp5S/T3eogMhwG2iJdykhaaKqRMkYOeLYbdCC1LCAialCIGJGkY/H03/M29SlW0zGpfYLKKM8vbHbCs3LlOIEEdi9APkPWwSB8nUxdBgrG5LgijVVrV4PGMDecyqMYxsavinT/M= Hi Filipe Cabecinhas _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Maybe you should use perror instead of/in addition to this printf, so you would get an English description of the problem (and your users would understand the error message easily, too. On 13 Apr, 2007, at 03:06, David Alger wrote: printf("fopen failed on error: %d - redirectPath is: %s - line number: %d\n", errno, redirectPath, __LINE__); This email sent to site_archiver(a)lists.apple.com

1 0

cpp bug?
by Ruben Zilibowitz 13 Apr '07

13 Apr '07

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Hi, The contents of test.h was simply: #include <stdio.h> #define kHELLO 1 Regards, Ruben _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Recently I have run across some unexpected behaviour from the tool cpp installed on my Mac OS X system. On running the command: cpp -x c test.h I got this: powerpc-apple-darwin8-gcc-4.0.1: c: No such file or directory powerpc-apple-darwin8-gcc-4.0.1: c: No such file or directory powerpc-apple-darwin8-gcc-4.0.1: warning: '-x -x' after last input file has no effect powerpc-apple-darwin8-gcc-4.0.1: no input files Doing just: cpp test.h seems to work correctly, but I wanted the -x c option to work for certain reasons. The man page for cpp says this should be a valid option. Is this a bug in cpp on Mac OS X? I don't actually understand the meaning of the error messages I received. This email sent to site_archiver(a)lists.apple.com

1 0

Re: Redirecting Output for a fork()'d Process
by David Alger 13 Apr '07

13 Apr '07

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

kext volume filter logging
by Duane Murphy 12 Apr '07

12 Apr '07

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Hi Fellow Devs, I'm working on a kext volume filter. I'm finding that not all of my printf() messages are making it to system.log. Is there some way of making logging more consistent? When I attached with two machine debugging, I found that log messages were much more consistent, but that's such a hassle. What other logging mechanism or debugging solutions do others use to get a handle on their kext? Thanks for your tips! ...Duane _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: launchd question
by Dave Zarzycki 12 Apr '07

12 Apr '07

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Try catching SIGTERM. On Apr 12, 2007, at 3:26 PM, jmzorko(a)mac.com wrote: Hello, all ... Firstly, thanks for the help re: Shark ... I finally get it :-) Regards, John Falling You - exploring the beauty of voice and sound http://www.fallingyou.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/zarzycki%40apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Now, for my next trick, i'm going to make this app into the OSX equivalent of a Win32 service by making it run under launchd. This was really easy to do, but I noticed from the logs that this app writes, that launchd doesn't seem to be nicely shutting it down e.g. I think it just a kill -9. The app catches SIGINT and shuts down nicely when it gets it ... can I make launchd send it? This email sent to zarzycki(a)apple.com This email sent to site_archiver(a)lists.apple.com

1 0