March 2007 - Darwin-kernel - lists.apple.com

OT: Re: Darwin-kernel Digest, Vol 4, Issue 78
by Andrei E. Warkentin 17 Mar '07

17 Mar '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Dkim-signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:in-reply-to:references:mime-version:content-type:message-id:cc:from:subject:date:to:x-mailer; b=YwlJtUcAjtUDhnuSTSEvwQERhosuiXJhrqOcBrFSLIdghj5hvzI6Y/tc4pXqPbE897DsKM+rROUfGcK3TbFeTjFi4XBpOEPWtty3I6XOM96kQ/aNGUwsh5q4hABNUBsYArT33Tgm4+UAvg5DbqFpgLAiAFcDXZTDE4EUGG7jnBI= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:in-reply-to:references:mime-version:content-type:message-id:cc:from:subject:date:to:x-mailer; b=FPars6QYxfuIeeb7cs78q+2UCZ3hfWY/KQdjuZJP9qpaM27rvTn+Icx0s0aC7HzlLoHRMUmyJnTc+fVoFaGISPFom/oXvj2Tmuwrc1z/5bA+fCIG+yVCwZ7DL4atpj5rZyBaNq3bWiUxbBgivdJ9CRNCZ6vErCMkvo8amUzuvfQ= _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Darwin-kernel Digest, Vol 4, Issue 78
by panxd 17 Mar '07

17 Mar '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Domainkey-signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=jQXQIarfrkG92sUJB3jYI2bZyqmCAKGHW2nI84pqC5nGuG5UBb/Il2Y1kxYTl7Ch5LRODhwGfxCNssg1G+QbXaihr0I97ax4UpuBh3f/2grrHt6KrkrRZ40vJep5qYHOAjZmYXNJTf4Tm14P2LTC8O6pticcwZKMBEPU3LYfGJs= ; _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Fork/Exec vs pthread
by Michael Smith 17 Mar '07

17 Mar '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com On Mar 17, 2007, at 9:48 AM, Tony Scaminaci wrote: = Mike _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… My question relates to the difference between use of fork/exec to launch multiple processes and the use of pthreads. What I want is a guarantee that if the machine has 4 CPU's, all 4 will run a portion of the overall memory tests by launching four separate test processes with each one testing 1/4 of the available memory. I can't find any documentation regarding the difference between pthreads and fork/exec nor anything that states definitively that launching X number of threads or processes will spread those processes or threads across all X CPU's. Can someone please shed light on this and let me know which route I should go? There is no mechanism currently provided for strongly binding a thread to a specific execution context. This is traditionally something grossly abused by application developers that think that the OS should have no part in deciding what is and isn't important. The system reserves the right to schedule your threads as it sees fit; that being said if the system is otherwise idle, is not being power managed for thermal, acoustic or administrative reasons, and you have at least one thread per execution context, you can reasonably expect that on current systems you will run on all of them for much of the time. There will be *no* correlation between thread and CPU package/core, so you're not going to be able to say "this thread detected a cache error so this CPU is defective". There are interfaces to take CPUs offline, however, so you may want to consider a process of elimination in the situation where you have detected a cache error. This email sent to site_archiver(a)lists.apple.com

1 0

Fork/Exec vs pthread
by Tony Scaminaci 17 Mar '07

17 Mar '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Domainkey-signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=sbcglobal.net; h=Received:X-YMail-OSG:Mime-Version:In-Reply-To:References:Content-Type:Message-Id:Content-Transfer-Encoding:From:Subject:Date:To:X-Mailer; b=sdWr9Ye3v0migP27Dd5UWmIV1ITzTgPy3o3Ylra9MNvK1Si6bGpULQq7Jq0xBUfsiduyVKl32OLBjRR0X/pmESxWuaXwQgxjMvJabY4Pkm49kkAF/3MU1pMVotQTgYf79E3GWMNCS3itgsrjO50yrqmkEdyuO2u1/5l0vMsB72U= ; Thanks, Tony _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… I've got a memory test application that runs in both a terminal window as well as in single-user mode. It has recently come to my attention that because my app is only exercising one of the CPU's on multi-processor machines, I can't adequately test the CPU cache paths for the other processors. My app can catch cache failures so it's imperative that I be able to test all processors on a given machine. My question relates to the difference between use of fork/exec to launch multiple processes and the use of pthreads. What I want is a guarantee that if the machine has 4 CPU's, all 4 will run a portion of the overall memory tests by launching four separate test processes with each one testing 1/4 of the available memory. I can't find any documentation regarding the difference between pthreads and fork/exec nor anything that states definitively that launching X number of threads or processes will spread those processes or threads across all X CPU's. Can someone please shed light on this and let me know which route I should go? This email sent to site_archiver(a)lists.apple.com

1 0

RE: 10.3.9 panic
by Michael Welch 16 Mar '07

16 Mar '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Thread-index: AcdoIZjXI+N+RH/ZSx+14UPzJUVjmwAAKg4c Thread-topic: 10.3.9 panic Oops, forgot the PC from the panic: PC: 0x5c264 <vm_map_lookup_entry+152>: lwz r0,12(r29) - Mike -----Original Message----- Hello all, I'm suffering from sporadic hangs on a Powerbook G4 running 10.3.9. Unfortunately they first appeared shortly after two events: 1) The combined "Java for Mac OS X 10.3, Update 5", "Security Update 2007-002", and "Daylight Saving Time Update" updates in mid-February. 2) The failure and subsequent replacement of my PB's logic board. The system would simply freeze, mouse input and all, and I'd get no panic dump on screen, not even the "pretty" one. Since then I've enable panic dumps (nvram boot-args="debug=0xd04"). Nothing gets written in /Library/Logs/panic.log or /cores, but from what I jotted down from the screen at the time it occurs + gdb, I get the following: Unresolved kernel trap: 0x300 - Data access DAR: 0x0000000C MSR: 0x9030 DSISR: 0x40000000 XCP: 0xC backtrace: 0x642d8 <vm_map_lookup_locked+152>: cmpwi cr7,r3,0 0x58998 <vm_fault+364>: mr. r29,r3 0x910fc <trap+2456>: mr. r22,r3 0x9402c <thandler+204>: lis r10,512 There are no kernel modules on the backtrace. So, my two questions: 1) I doubt many are still on Panther, but has anyone else seen this problem? Could it possibly be a bug from the updates? I don't think mach_kernel was touched by them... 2) Could this be a hardware issue? (shoddy repair work? RAM going bad?) It passes the TechTool memory test every time... Any other suggestions on how to debug further are appreciated. I don't have a second Mac, so hooking up the kernel debugger won't be easy. Thanks, - Mike _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

10.3.9 panic
by Michael Welch 16 Mar '07

16 Mar '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Thread-index: AcdoIZjXI+N+RH/ZSx+14UPzJUVjmw== Thread-topic: 10.3.9 panic Hello all, I'm suffering from sporadic hangs on a Powerbook G4 running 10.3.9. Unfortunately they first appeared shortly after two events: 1) The combined "Java for Mac OS X 10.3, Update 5", "Security Update 2007-002", and "Daylight Saving Time Update" updates in mid-February. 2) The failure and subsequent replacement of my PB's logic board. The system would simply freeze, mouse input and all, and I'd get no panic dump on screen, not even the "pretty" one. Since then I've enable panic dumps (nvram boot-args="debug=0xd04"). Nothing gets written in /Library/Logs/panic.log or /cores, but from what I jotted down from the screen at the time it occurs + gdb, I get the following: Unresolved kernel trap: 0x300 - Data access DAR: 0x0000000C MSR: 0x9030 DSISR: 0x40000000 XCP: 0xC backtrace: 0x642d8 <vm_map_lookup_locked+152>: cmpwi cr7,r3,0 0x58998 <vm_fault+364>: mr. r29,r3 0x910fc <trap+2456>: mr. r22,r3 0x9402c <thandler+204>: lis r10,512 There are no kernel modules on the backtrace. So, my two questions: 1) I doubt many are still on Panther, but has anyone else seen this problem? Could it possibly be a bug from the updates? I don't think mach_kernel was touched by them... 2) Could this be a hardware issue? (shoddy repair work? RAM going bad?) It passes the TechTool memory test every time... Any other suggestions on how to debug further are appreciated. I don't have a second Mac, so hooking up the kernel debugger won't be easy. Thanks, - Mike _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: xnu-792.18.15 source
by Andreas Fink 16 Mar '07

16 Mar '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: xnu-792.18.15 source
by Michael Smith 16 Mar '07

16 Mar '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com On Mar 15, 2007, at 3:10 PM, <sci-fi(a)hush.ai> <sci-fi(a)hush.ai> wrote: Really wish you-all would make the whole developer pkgs ready before releasing a massive update like 10.4.9 is. …seems I am having to submit such feedback for every big update, else I feel they’ll never “git-r-dun”…! ;D I can assure you that this sort of grousing doesn't help anything. = Mike _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… You would really hold up a release like this until the open-source bits were ready? Somehow, I don't think you quite comprehend the reality of the situation. Tell you what. Why not try, next release around, not whining at the poor guy that's working his butt off to get this out and see if it makes a difference? This email sent to site_archiver(a)lists.apple.com

1 0

Re: Sockets Closing Unexpectedly
by Josh Graessley 16 Mar '07

16 Mar '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com You can't delay this. -josh On Mar 15, 2007, at 6:22 PM, Jones Curtis wrote: Thanks. -- Curtis Jones curtis.jones(a)gmail.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com The best solution is to write a filter that runs in a process in user space. Your in kernel kext is responsible for intercepting the outbound connection via the connect out filter. If the socket is a synchronous/blocking socket, call sock_connect with the loopback address and the port your user space process is listening on. Send the address and port the connect was initially trying to reach to your user space process. Have your user space process connect to that destination and then relay the connect result back to your kext. If the result was success, return EJUSTRETURN from your out filter function. Otherwise, call sock_shutdown on the socket and return the error. If the socket is a non-blocking socket, things may be a little trickier. I can't remember the exact details, but it can be made to work. Anyhow, once you have done this, the client thinks their connected to some remote server when they're really connected to your process. Your process is responsible for forwarding data between the two sockets. When the remote socket closes, you can finish writing your data before closing the socket between your transparent proxy app and the app that initiated the connection. There are some other tricky things related to TCP half closes and whatnot. My socket filter is deferring the sending/receiving of some data (and specifically in this case, the receiving of some data) for a while and the remote host is closing the socket connection before the data has been re-injected and I've not been able to figure out how to delay the closing of the socket (with respect to the local process that's using the socket) until I've had a chance to re- inject the deferred data. I noted that by the time the detach callback is made, the socket is already closed. I noted that the notify callback is called first for sock_evt_cantrecvmore then sock_evt_closing then sock_evt_disconnecting and finally sock_evt_disconnected and that if I block on any or all of those (until the data is re-injected), it does not prevent the local process from finding out about the closed socket - which appears to happen very shortly after the sock_evt_cantsendmore notification. I've started looking at sock_retain/release and they appear to delay the closing/disconnecting/disconnected, but not the cantrecvmore. I've dug through tcplognke and it doesn't appear to have any specific provisions for this - it just blocks on sock_evt_disconnecting. So I'm not sure what else to try at this point. Any suggestions? _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/jgraessley% 40apple.com This email sent to jgraessley(a)apple.com smime.p7s

1 0

Sockets Closing Unexpectedly
by Jones Curtis 16 Mar '07

16 Mar '07

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Dkim-signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:mime-version:to:message-id:content-type:from:subject:date:x-mailer; b=Zhw7A9OmFOKDEA3F5OnDY87BCizYI/i4dqNlEDkd3vYtr/fVMV9NWkIj/SkVtTWsy9AvB7CBZFQLrmX+v70xMxFow7DI15XIis/g/kVGffABGZnHmtXuSiNDMxjabl4pM2HCLx4We+Nfk9+Q1kUeojbTy1pxVHox+JUKNrFCJ3k= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:mime-version:to:message-id:content-type:from:subject:date:x-mailer; b=a/Zu+5f/FuM8ezDJhd2u4UvfkXj6oqrY4lihyQurr6eUqKMMEApZfXe/qOEfP9j7iwvaEuQZxFdpfFyP3OHyJSk+Zo4pH46S5hmj2baoz2G2q6bw+VwLKXBhXO+dRWLPBGXC5Vh7eiJHil+kfzo82hbH3DZGFORUAxeRHZDeV+o= Thanks. -- Curtis Jones curtis.jones(a)gmail.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com My socket filter is deferring the sending/receiving of some data (and specifically in this case, the receiving of some data) for a while and the remote host is closing the socket connection before the data has been re-injected and I've not been able to figure out how to delay the closing of the socket (with respect to the local process that's using the socket) until I've had a chance to re-inject the deferred data. I noted that by the time the detach callback is made, the socket is already closed. I noted that the notify callback is called first for sock_evt_cantrecvmore then sock_evt_closing then sock_evt_disconnecting and finally sock_evt_disconnected and that if I block on any or all of those (until the data is re-injected), it does not prevent the local process from finding out about the closed socket - which appears to happen very shortly after the sock_evt_cantsendmore notification. I've started looking at sock_retain/release and they appear to delay the closing/disconnecting/disconnected, but not the cantrecvmore. I've dug through tcplognke and it doesn't appear to have any specific provisions for this - it just blocks on sock_evt_disconnecting. So I'm not sure what else to try at this point. Any suggestions? smime.p7s

1 0