April 2010 - Darwin-dev - lists.apple.com

Re: processes, tasks, threads
by Jens Alfke 12 Apr '10

12 Apr '10

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: processes, tasks, threads
by Ariel Feinerman 11 Apr '10

11 Apr '10

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:received:message-id:subject:from:to:cc:content-type; bh=RjwM2aB1pZLzpHJBVk6uusTAzDic4F67jZ1j213lX/4=; b=nu5i62wBbteUK0oEkFhIlUYTi0U4rDVJUT3zL4LYWPjJ4Is+aSTq8KcsoB2m5WE49S LJlBp0RFuyVf5NNMwNwLKnEWpdbtyNG5F0j6VJCS8Zbim4J8JSrX/ViGVTs802ir/203 TJRnLyzyi9vv0bjIn2aFmfbQH31lBICI9HleE= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=Dij3xR9IsIuw1XBlnnaGFYDcPNSAf8v1ebgiLIpClDoQyqkQ0T2bKYgB+UMuLYzTeE JRksMS0haMYuSy72QkHd4HZy/sVS+/W9S+IHEOfhnpdFq3PppBXniJKtP2h+2Ha6DDA4 W3mYRewCjExHg400nH0lQoyfCfyAyM1hKY5eI= _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: processes, tasks, threads
by Jens Alfke 10 Apr '10

10 Apr '10

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com A thread is just a flow of control -- a CPU state (registers) and a stack. A process is what you think of as a program, what's listed in 'top' or Activity Monitor. It's a set of threads running in a memory address space plus a set of privileges (user and group ID, resource quotas, etc.) "Task" is I think a synonym for process. I haven't heard "flow" before, but I'd guess it means the same as thread. The above definitions hold for pretty much every OS, including Linux. The notion of thread can get tricky because there can be multiple types of threads. The OS kernel manages threads and has system calls for them. There are portability APIs like pthreads that wrap these. But it's also possible for user code to implement it's own threading system, using calls like setjmp and ucontext that let you save and restore CPU state. These are often called "green" threads, a name that came from the original Java runtime. The advantage of these is that they can be extremely lightweight because they don't consume any kernel resources. But they're more difficult to work with because the kernel and system libraries don't understand them. (You usually see green threads in interpreted language runtimes like Java and Ruby.) --Jens {via iPad} On Apr 10, 2010, at 6:06 AM, Ariel Feinerman <arielfapple(a)gmail.com> wrote: > Hi, > sorry for stupid question. What is the difference between process, task, flow and thread in the Darwin? What kind of relationsheeps between calls fork(), exec() and pthreads or mach threads? I heard that in some OS process and thread are the same entity at least in Linux. > Thank you in advance, > > -- > best regards > Ariel > _______________________________________________ > Do not post admin requests to the list. They will be ignored. > Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) > Help/Unsubscribe/Update your Subscription: > http://lists.apple.com/mailman/options/darwin-dev/jens%40mooseyard.com > > This email sent to jens(a)mooseyard.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

processes, tasks, threads
by Ariel Feinerman 10 Apr '10

10 Apr '10

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:date:received:message-id :subject:from:to:content-type; bh=ePsJfbkgkSCZ++p+awg/BRTytrqTZi9ZnnfpSD2YLgs=; b=nKBu7GcpS8E/KyEhoxOXq3t3l/FaIoq7yCLG/XHg7AW0chw8RPQP96325N2WYSTuQm fDQeuQnckk5iWquSEJW/T/lfUs72IBmCCxMh2pa9I2RcO+6RLF6i1SL5kWtRvQuKc4kV 8eC6lP9a6ICXaLBzq69q+o4V/y0IQCOcs7oWk= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=LMpNopqUNP7xNms4wGhB92iWtiUmxdcU0DPV8mqyIGl3CQNEQO3wNJee3g9hwhf5f0 lM9e60ssfOElYbwY0c259PAiJF9catDpuLgRMKmyAdNWa2aQhsbPvmZO9uDpeSBP69rE ok0WCbzy/6U7SuFIZvoc9GQqkbvLA4kMYaYzw= _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: error when opening a top level X11 window
by Martin Costabel 09 Apr '10

09 Apr '10

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com User-agent: Thunderbird 2.0.0.24 (Macintosh/20100228) Hi, -- Martin _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Karl-Michael Schindler wrote: When running pascal programs based on fpGUI, an X11 based interface package, I get an error if the application creates the top level X11 window. but only then. If there is already a toplevel window, for example because xterm runs, then the application open its window and everything behaves as expected. On the x11-users mailing list <X11-users(a)lists.apple.com>, you'll have more chances of getting a response. And don't forget to mention your OS version and the version of X11 you have installed. This email sent to site_archiver(a)lists.apple.com

1 0

error when opening a top level X11 window
by Karl-Michael Schindler 08 Apr '10

08 Apr '10

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Importance: normal Sensitivity: Normal Hi, When running pascal programs based on fpGUI, an X11 based interface package, I get an error if the application creates the top level X11 window. but only then. If there is already a toplevel window, for example because xterm runs, then the application open its window and everything behaves as expected. the problematic call is this: XGetWMProtocols(FDisplay, AWindow, @Protocols, @Count); gdb shows these values: 4: COUNT = 0 3: PROTOCOLS = 0x0 2: AWINDOW = 6291457 1: this->FDISPLAY = 0x803a00 it produces this X11 error: X Error of failed request: BadAtom (invalid Atom parameter) Major opcode of failed request: 18 (X_ChangeProperty) Atom id in failed request: 0x0 Serial number of failed request: 103 Current serial number in output stream: 104 any hints how to resolve this? Michael ___________________________________________________________ NEU: WEB.DE DSL für 19,99 EUR/mtl. und ohne Mindest-Laufzeit! http://produkte.web.de/go/02/ _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Socket read tuning on Mac OS X
by Jakub Bednar 07 Apr '10

07 Apr '10

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Apr 3, 2010, at 1:06 AM, Terry Lambert wrote: > On Apr 2, 2010, at 4:06 PM, Terry Lambert wrote: >> On Apr 2, 2010, at 7:18 AM, Jakub Bednar wrote: >>> I have tried SO_RCVLOWAT along with SO_RCVTIMEO options, but this >>> is not the way. Poll() does not respect SO_RCVLOWAT and the socket >>> will not give me less data but return an error when >>> SO_RCVTIMEO timeout expires. >> >> SO_RCVLOWAT only applies to UNIX domain sockets or FIFOs, where >> there is not potentially an administrative or system limit that will >> prevent enough data accumulating in order to satisfy the low >> watermark. It's going to have no effect because it's not supposed >> to have any effect: you could starvation deadlock yourself >> otherwise, which could be used to stage a local DOS. This is true >> on most other UNIX-like systems as well. One exception is "accept >> filters"-based systems with kernel pre-parsing of data contents for >> recognition of complete messages; another is the NCP streams MUX in >> NetWare for UNIX, which also recognizes complete messages, and does >> not send unchunked data up to user space. These are dangerous from >> a security perspective because they allow a user space process to >> download interpreted code intended to run in supervisor mode. >> >> NB: As To A.M.'s suggestion, the NOTE_LOWAT for kqueue() is only >> respected for sockets, pipes, and BPF (Berkeley Packet Filter); >> unless you are doing raw ethernet frames via BPF, this will >> unfortunately not help you out. > > I spoke too soon here, and misrepresented things. > > A.M.'s suggestion isn't going to work if the poll() didn't work as you > note. > > The SO_RCVLOWAT is supposed to work on all sockets, so why it seems to > not be working in your case is at this point unknown; there are a > couple of theories so far. Stay tuned. > Thanks for a full-range explanation Terry, anyway I generally do not know how much data will arrive and according to SO_RCVLOWAT and SO_RCVTIMEO documentation I'm not able to implement what I want using these options even if the poll() is working correctly. The poll will probably unblock when SO_RCVTIMEO is reached, signaling an error state on the socket. Subsequent read will also return error. I would need to change the socket option before read attempt to get the partial data available and then set the option back, leading to a syscall storm. The idea with a reading thread is basically what I have currently in my code. I'm using poll()/read() on a socket and than put the data to a processing thread and go to another poll(). Currently the highest percentage of time spend according to Shark is in interrupt enabling/disabling (about 20% of the time) which I think means switching to the driver code. Second bottleneck is the synchronization with the worker thread. Putting sleep there works, decreasing CPU usage rapidly, but it also slows down download speed (to 6.4M/s from 10.1M/s). As the sleep is not necessary on some systems, I was looking for a better way how to do it. Following your comments I will most probably end up collecting some statistics (e.g. how much data and how often is delivered to me) and add the short sleep only if needed. Btw. is there a way how to get my current CPU usage directly from the executable? My other tests show that it is really a common problem. e.g. wget on one system eats 6.4% CPU and on the other 30%CPU. Both are downloading with the same speed on the same line from same source on my local LAN. Following Shark's system call trace it is just select()/read()/write to disk with no other overhead so 30% is quiet a lot. The CPU usage increase ratio corresponds to the one of my application. Best regards, Jakub _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

launchd error: System: job_mig_spawn() can't find its session!
by Rosyna 07 Apr '10

07 Apr '10

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com I'm trying to launch an application from a daemon running as the current user using LSOpenApplication(). It worked fine in 10.5.x but returns an error (seen below) on 10.6.x. And before someone brings it up, *yes*, LaunchServices *is* a daemon-safe framework as stated in http://developer.apple.com/mac/library/technotes/tn2005/tn2083.html#SECFRAM… LaunchServices is in the CoreServices umbrella framework as of 10.5. 4/6/10 6:14:09 PM com.apple.WindowServer[71] aped[6485]: [Application Enhancer] Checking for updated versions of Application Enhancer (com.unsanity.ape) 4/6/10 6:14:09 PM com.apple.launchd[1] System: Bug: launchd_core_logic.c:8758 (24003):0 4/6/10 6:14:09 PM com.apple.launchd[1] System: job_mig_spawn() can't find its session! 4/6/10 6:14:09 PM aped[6485] spawn_via_launchd() failed, errno=5 label=[0x0-0x8e08e].com.unsanity.updater path=/Library/Frameworks/ApplicationEnhancer.framework/Versions/A/Resources/Unsanity Updater.app/Contents/MacOS/Unsanity Updater flags=1 --- Sincerely, Rosyna Keller Technical Support/Carbon troll/Always needs a hug Unsanity: Unsane Tools for Insanely Great People It's either this, or imagining Phil Schiller in a thong. _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: c++ exceptions
by David Leimbach 06 Apr '10

06 Apr '10

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:received:message-id:subject:from:to:cc:content-type; bh=ctUBQSzjL7ImTeG0Dp1AM2mheH9I+zXpcpCSvzVI48U=; b=FguNHvB1tMuQ8eLOQmtCRwh8p9Qczd8TGyWHSDZhLKdIYgUaJZc6iEukUXULCAYZak LX/RKI6ov0of+JmDCFCYUhfTB7UZ1L4q6JWKsWDOgxpDMH5ZegLH9pF1GK880k2MfAAo hQFdvE+6UP4I8amHP1hsdmHhnjXfqiI7Kho10= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=AsXU8K90rZCHQ/KxmCFc0jvaM2uf4gpJXPxe03pZWtoCzKkjMZarYXVJD98dLewmA7 Rx6tubhVtYCpvBuJNGWFJirAyIh1srRv+V+CmsgpeKzHNcbwnLLRv4EiA4UdMaK4drgM r7553GGboY3o3UYu8mTIQyCCbb/pGVPSlqyfM= _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: c++ exceptions
by David Leimbach 06 Apr '10

06 Apr '10

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:received:message-id:subject:from:to:cc:content-type; bh=vMMpkteq6L7DXs0sdnaQroY2uaQ+lW+hh51JGS3kaKw=; b=hDCjU5cnl5hdciEANBirzkyqSwtHI8pvi4Q4jhWLY/ofUb4gtV2IHHJuZhgEDBdzjp 3EuQZ0WvuhlSIu0SRxbg8WiKY2McDd5Vi4ATIrJJDA7rTsW98h55R5xFHRZwRdgHlbqu /S5Qg+r0LgkN0pFbXp1ltFv39h4jdacQ5h8do= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=AkGBIKWJ748lwh/EpcGVXVkdAc4n2FKVJ3p7ywTXoRNScz5Qh0KgNButQnLge6Vdpn Iyzt2R/4QmsZy/ONbC0CFpwEj5lKge13pqtuVOJ2D8ZBKs1PwSgKp2q4JR58Fvv2xCc+ 5vD6Cd+73mL2dD4bMxOF6uStgHyVj5e30+6zk= _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0