December 2007 - Darwin-dev - lists.apple.com

Re: pipes, scripts, and launchd
by Perry Smith 29 Dec '07

29 Dec '07

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Dec 28, 2007, at 3:21 PM, Michael Smith wrote: I may be making too big a deal of all this but I can't figure out how to do something like: postgres <args> | rotatelogs <args> from launchd. If I put that command in a simple bash shell script, I *believe* it will not work. The signal will go to bash and bash will not pass it along to the children. If the latter, then that's not a good way to do it. Have the output from the daemon go to the input of another process. Thanks, pedz _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… On Dec 28, 2007, at 12:03 PM, darwin-dev-request(a)lists.apple.com wrote: There's something missing from what you're asking here; specifically, what signal are you talking about? launchd uses SIGTERM to signal the process should gracefully shutdown. Then launchd does a SIGKILL when it gets impatient. I could trap the signal and pass it along myself... but, $! gives the pid for the last process in the pipe (rotatelogs). That is not what I need to signal. I need the signal passed to postgres. And, in fact, it would be nice if the signal did NOT pass to rotatelogs. I'd like for it to stop when its input closes and not before then. Are you actually trying to pass output from postgres to rotatelogs, or just have the two die cleanly together? Yes, I am trying to pass output from postgres to rotatelogs. rotatelogs is a cute way to have your log files age. Anyone have any suggestions of how to do this? What is "this"? This email sent to site_archiver(a)lists.apple.com

1 0

Re: pipes, scripts, and launchd
by Steve Checkoway 29 Dec '07

29 Dec '07

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Dec 28, 2007, at 3:41 PM, Benjamin Huntsman wrote: <key>ProgramArguments</key> <array> <string>postgres</string> <string>args</string> <string>|</string> <string>rotatelogs</string> <string>args</string> </array> i.e., passing |, rotatelogs, arg1, and arg2 to postgres. -- Steve Checkoway "Anyone who says that the solution is to educate the users hasn't ever met an actual user." -- Bruce Schneier _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com I find it hard to believe that that would work at all. If so, then there would be no need for an array of arguments, one could merely pass the entire command line. I suspect, but haven't actually tested, that this would be about the same as doing execl( "postgres", "postgres", "arg1", "arg2...", "|", "rotatelogs", "arg1", "arg2...", NULL ); smime.p7s

1 0

RE: pipes, scripts, and launchd
by Benjamin Huntsman 28 Dec '07

28 Dec '07

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Thread-index: AchJqGm8YRrnDqJSTquJBpe37OC/zwAArEef Thread-topic: pipes, scripts, and launchd I had a similar situation where we had to create a symbolic link at startup, in Leopard, where there's only launchd. Here's my plist: <?xml version="1.0" encoding="UTF-8"?> <!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd"> <plist version="1.0"> <dict> <key>Debug</key> <false/> <key>Label</key> <string>com.mycompany.f5-prep</string> <key>OnDemand</key> <false/> <key>ProgramArguments</key> <array> <string>/bin/ln</string> <string>-s</string> <string>/var/run/DirectoryService.pid</string> <string>/var/run/lookupd.pid</string> </array> <key>RunAtLoad</key> <true/> </dict> </plist> just keep each flag to postgres on a seperate <string></string> line. Something like: <?xml version="1.0" encoding="UTF-8"?> <!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd"> <plist version="1.0"> <dict> <key>Debug</key> <false/> <key>Label</key> <string>com.yourcompany.rotatelogs</string> <key>OnDemand</key> <false/> <key>ProgramArguments</key> <array> <string>postgres</string> <string>args</string> <string>|</string> <string>rotatelogs</string> <string>args</string> </array> <key>RunAtLoad</key> <true/> </dict> </plist> ought to work. I believe it just launchd will pass the <strings> verbatim, so launchd would end up generating the same command you typed below. worth a try, at least... -----Original Message----- From: darwin-dev-bounces+bhuntsman=mail2.cu-portland.edu(a)lists.apple.com on behalf of Dave Zarzycki Sent: Fri 12/28/2007 3:25 PM To: Perry Smith Cc: darwin-dev(a)lists.apple.com Subject: Re: pipes, scripts, and launchd I haven't tested this, but I suspect it should work... Setup: mkfifo /var/postgres_pipe Job 1: Have postgres write to /var/postgres_pipe via the launchd plist StandardOutPath and StandardErrorPath keys. Job 2: #!/bin/sh exec rotatelogs < /var/postgres_pipe # Note to self: It would have been nice if launchd supported a StandardInputPath configuration option davez On Dec 28, 2007, at 8:44 AM, Perry Smith wrote: > I may be making too big a deal of all this but I can't figure out > how to do something like: > > postgres <args> | rotatelogs <args> > > from launchd. If I put that command in a simple bash shell script, > I *believe* it will not work. The signal will go to bash and bash > will not pass it along to the children. > > I could trap the signal and pass it along myself... but, $! gives > the pid for the last process in the pipe (rotatelogs). That is not > what I need to signal. I need the signal passed to postgres. And, > in fact, it would be nice if the signal did NOT pass to rotatelogs. > I'd like for it to stop when its input closes and not before then. > > I'm going to look in to using ksh and maybe using co-processes with > ksh. bash does not seem to have that concept. But, it just seems > like it should not be this hard to do. > > Anyone have any suggestions of how to do this? > > Thank you, > pedz > > _______________________________________________ > Do not post admin requests to the list. They will be ignored. > Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) > Help/Unsubscribe/Update your Subscription: > http://lists.apple.com/mailman/options/darwin-dev/zarzycki%40apple.com > > This email sent to zarzycki(a)apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/bhuntsman%40mail2.cu-port… This email sent to bhuntsman(a)mail2.cu-portland.edu _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: pipes, scripts, and launchd
by Dave Zarzycki 28 Dec '07

28 Dec '07

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com I haven't tested this, but I suspect it should work... Setup: mkfifo /var/postgres_pipe Job 1: Job 2: davez On Dec 28, 2007, at 8:44 AM, Perry Smith wrote: postgres <args> | rotatelogs <args> Anyone have any suggestions of how to do this? Thank you, pedz _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/zarzycki%40apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Have postgres write to /var/postgres_pipe via the launchd plist StandardOutPath and StandardErrorPath keys. #!/bin/sh exec rotatelogs < /var/postgres_pipe # Note to self: It would have been nice if launchd supported a StandardInputPath configuration option I may be making too big a deal of all this but I can't figure out how to do something like: from launchd. If I put that command in a simple bash shell script, I *believe* it will not work. The signal will go to bash and bash will not pass it along to the children. I could trap the signal and pass it along myself... but, $! gives the pid for the last process in the pipe (rotatelogs). That is not what I need to signal. I need the signal passed to postgres. And, in fact, it would be nice if the signal did NOT pass to rotatelogs. I'd like for it to stop when its input closes and not before then. I'm going to look in to using ksh and maybe using co-processes with ksh. bash does not seem to have that concept. But, it just seems like it should not be this hard to do. This email sent to zarzycki(a)apple.com This email sent to site_archiver(a)lists.apple.com

1 0

Re: pipes, scripts, and launchd
by Michael Smith 28 Dec '07

28 Dec '07

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Dec 28, 2007, at 12:03 PM, darwin-dev-request(a)lists.apple.com wrote: I may be making too big a deal of all this but I can't figure out how to do something like: postgres <args> | rotatelogs <args> from launchd. If I put that command in a simple bash shell script, I *believe* it will not work. The signal will go to bash and bash will not pass it along to the children. I could trap the signal and pass it along myself... but, $! gives the pid for the last process in the pipe (rotatelogs). That is not what I need to signal. I need the signal passed to postgres. And, in fact, it would be nice if the signal did NOT pass to rotatelogs. I'd like for it to stop when its input closes and not before then. If the latter, then that's not a good way to do it. What is "this"? = Mike _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… There's something missing from what you're asking here; specifically, what signal are you talking about? Are you actually trying to pass output from postgres to rotatelogs, or just have the two die cleanly together? Anyone have any suggestions of how to do this? This email sent to site_archiver(a)lists.apple.com

1 0

Re: "Hidden" Users
by Jean-Francois Roy 28 Dec '07

28 Dec '07

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Dec 28, 2007, at 13:18, Perry Smith wrote: Thank you, pedz #!/bin/bash dscl . create /Users/postgres dscl . create /Users/postgres UniqueID $uid dscl . create /Users/postgres PrimaryGroupID $uid dscl . create /Users/postgres NFSHomeDirectory /Users/postgres dscl . create /Users/postgres Password '*' dscl . create /Users/postgres UserShell /bin/bash dscl . create /Users/postgres RealName 'Postgres Admin User' dscl . create /Groups/postgres dscl . create /Groups/postgres PrimaryGroupID $uid dscl . create /Users/postgres RealName 'Postgres Admin Group' if [[ ! -d /Users/postgres ]] ; then mkdir /Users/postgres fi chown -R postgres:postgres /Users/postgres _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/bahamut%40macstorm.org _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… I believe you should just keep the uid below 500. Pick a more or less safe starting uid, for example starting at 300. This has worked fine for me in situation similar to yours. There are users such as _mysql, _www. They seem to be aliased to mysql and www. They do not show up in the list of users you can "fast switch" between. They also do not show up in the list of accounts shows by System Preferences => Accounts. I'm trying to create a postgres user. I've managed to do it with the script attached. But, I am not clear what the magic is that determines if it will be shown in these two places. I've managed, at one point, to create a user that did not show up in Accounts but did show up in the list of users you can fast switch between. Does anyone know for sure what is used to determine the list of users displayed in Accounts and the list of users displayed in the fast user switching menu? # We loop to find a numeric value which is not a users uniqueid or a groups # primary group id starting at 501 typeset -i uid=501 while [[ "$( dscl . search Users UniqueID $uid && dscl . search Groups PrimaryGroupID $uid )" ]] ; do let ++uid done This email sent to bahamut(a)macstorm.org This email sent to site_archiver(a)lists.apple.com

1 0

"Hidden" Users
by Perry Smith 28 Dec '07

28 Dec '07

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Thank you, pedz #!/bin/bash dscl . create /Users/postgres dscl . create /Users/postgres UniqueID $uid dscl . create /Users/postgres PrimaryGroupID $uid dscl . create /Users/postgres NFSHomeDirectory /Users/postgres dscl . create /Users/postgres Password '*' dscl . create /Users/postgres UserShell /bin/bash dscl . create /Users/postgres RealName 'Postgres Admin User' dscl . create /Groups/postgres dscl . create /Groups/postgres PrimaryGroupID $uid dscl . create /Users/postgres RealName 'Postgres Admin Group' if [[ ! -d /Users/postgres ]] ; then mkdir /Users/postgres fi chown -R postgres:postgres /Users/postgres _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… There are users such as _mysql, _www. They seem to be aliased to mysql and www. They do not show up in the list of users you can "fast switch" between. They also do not show up in the list of accounts shows by System Preferences => Accounts. I'm trying to create a postgres user. I've managed to do it with the script attached. But, I am not clear what the magic is that determines if it will be shown in these two places. I've managed, at one point, to create a user that did not show up in Accounts but did show up in the list of users you can fast switch between. Does anyone know for sure what is used to determine the list of users displayed in Accounts and the list of users displayed in the fast user switching menu? # We loop to find a numeric value which is not a users uniqueid or a groups # primary group id starting at 501 typeset -i uid=501 while [[ "$( dscl . search Users UniqueID $uid && dscl . search Groups PrimaryGroupID $uid )" ]] ; do let ++uid done This email sent to site_archiver(a)lists.apple.com

1 0

pipes, scripts, and launchd
by Perry Smith 28 Dec '07

28 Dec '07

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com postgres <args> | rotatelogs <args> Anyone have any suggestions of how to do this? Thank you, pedz _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… I may be making too big a deal of all this but I can't figure out how to do something like: from launchd. If I put that command in a simple bash shell script, I *believe* it will not work. The signal will go to bash and bash will not pass it along to the children. I could trap the signal and pass it along myself... but, $! gives the pid for the last process in the pipe (rotatelogs). That is not what I need to signal. I need the signal passed to postgres. And, in fact, it would be nice if the signal did NOT pass to rotatelogs. I'd like for it to stop when its input closes and not before then. I'm going to look in to using ksh and maybe using co-processes with ksh. bash does not seem to have that concept. But, it just seems like it should not be this hard to do. This email sent to site_archiver(a)lists.apple.com

1 0

Re: DTrace and C++ function
by Dmitry Markman 27 Dec '07

27 Dec '07

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Hi, Eric maybe you already know how to do that I was able to trace throw and catch this is an export script from the Instruments #pragma D option switchrate=10msec #pragma D option bufsize=15m #pragma D option stackindent=0 #pragma D option quiet syscall::getpriority:entry/execname=="Instruments"/ {} pid$target:libstdc++.6.dylib:__cxa_throw:entry { pid$target:libstdc++.6.dylib:__cxa_begin_catch:entry { hope it will help On Dec 25, 2007, at 12:57 AM, Dmitry Markman wrote: it works but it's not really consistent with Instruments application I mean that if you have more then 1 instrument #pragma D option will affect all instruments, not just instrument where you add pragma into DATA section so it would be better if we have that option in the Instruments.app preferences thanks On Dec 24, 2007, at 9:10 PM, Eric Gouriou wrote: Here is an undocumented way. In the DATA section of a custom DTrace instrument, add: #pragma D option mangled Eric Indeed DTrace understands glob patterns, not regular expressions. man dtrace has examples of ObjC probes using such patterns. The idiomatic way to match :: is to use ??. I''ll also add that -xmangled was added to switch DTrace to use the mangled representation instead of the default demangled one. It can be very useful for C++ work. This article might also be of interest: <http://developers.sun.com/solaris/articles/dtrace_cc.html> Although it looks like the default there is to use mangled names. Dmitry Markman _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/dmarkman%40mac.com Dmitry Markman _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… BEGIN{printf("<dtrace_output_begin/>\n %-14d\n480ED714-974A-4432- AC52-424A43473C53|2C0D976D-1BDB-4420-AE66-44408748B3EA\n", walltimestamp/1000);} printf("<e> -1 0 %d %-14d\n%s \n</e>\n",tid, walltimestamp/1000, probefunc);printf("<s>\n");ustack(128);printf("</s>\n"); } printf("<e> -2 0 %d %-14d\n%s \n</e>\n",tid, walltimestamp/1000, probefunc);printf("<s>\n");ustack(128);printf("</s>\n"); } On Dec 22, 2007, at 12:43 PM, Dmitry Markman wrote: do you know how i can set -xmangled from Instruments application? This is the equivalent of -xmangled, from within the script. I am not sure of the consequences of setting this option on other instruments that might be instantiated in the same run. On Dec 22, 2007, at 1:59 PM, Eric Gouriou wrote: On Dec 21, 2007, at 7:02 PM, Dmitry Markman wrote: I should use *test_cpp* Terry mentioned regular expression, so I thought I have to use .*test_cpp.* but that didn'r work This email sent to dmarkman(a)mac.com This email sent to site_archiver(a)lists.apple.com

1 0

Re: DTrace and C++ function
by Dmitry Markman 25 Dec '07

25 Dec '07

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com it works but it's not really consistent with Instruments application I mean that if you have more then 1 instrument #pragma D option will affect all instruments, not just instrument where you add pragma into DATA section so it would be better if we have that option in the Instruments.app preferences thanks On Dec 24, 2007, at 9:10 PM, Eric Gouriou wrote: Here is an undocumented way. In the DATA section of a custom DTrace instrument, add: #pragma D option mangled Eric Indeed DTrace understands glob patterns, not regular expressions. man dtrace has examples of ObjC probes using such patterns. The idiomatic way to match :: is to use ??. I''ll also add that -xmangled was added to switch DTrace to use the mangled representation instead of the default demangled one. It can be very useful for C++ work. This article might also be of interest: <http://developers.sun.com/solaris/articles/dtrace_cc.html> Although it looks like the default there is to use mangled names. Dmitry Markman _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… On Dec 22, 2007, at 12:43 PM, Dmitry Markman wrote: do you know how i can set -xmangled from Instruments application? This is the equivalent of -xmangled, from within the script. I am not sure of the consequences of setting this option on other instruments that might be instantiated in the same run. On Dec 22, 2007, at 1:59 PM, Eric Gouriou wrote: On Dec 21, 2007, at 7:02 PM, Dmitry Markman wrote: I should use *test_cpp* Terry mentioned regular expression, so I thought I have to use .*test_cpp.* but that didn'r work This email sent to site_archiver(a)lists.apple.com

1 0