February 2009 - Darwin-dev - lists.apple.com

Re: Set process' working set size explictly
by Terry Lambert 18 Feb '09

18 Feb '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Hi, all. Is there any (kernel- or user-mode) way to set a process' working set size explicitly in runtime? -- Terry _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… On Feb 18, 2009, at 6:02 AM, Maxim Zhuravlev wrote: setrlimit(2) will set the resource limit, but it's purely voluntary. Good code like gcc will look at this limit and voluntarily not exceed it. Otherwise, it's completely unenforced by the OS itself, since it computationally expensive to track down shared pages, and controversial as to whether shared pages count against the first process to instance them, all processes that have them instanced, or not processes, since their a common resource. This gets even more complicated when you're talking about something like intentionally shared memory instead of, e.g., a shared library, since then the pages are shared only by a subset of processes, rather than all of them. This email sent to site_archiver(a)lists.apple.com

1 0

Set process' working set size explictly
by Maxim Zhuravlev 18 Feb '09

18 Feb '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:date:message-id:subject :from:to:content-type:content-transfer-encoding; bh=0eDG6Ep9Ni1ixdY5QGKlQWFd2AY5aWkS1Pi1bjPYSDg=; b=eOzsSlIU+fc0dSnqemKc879QnLpYrMcF8fjTrQk2W5fiQ3469VOfG2gFOh6d8HNn+d T5MN1CVAakXQlxHFaQddcgnsP5gtaQbLmISb6EzYn5SOh12433Amn4jjmscDN/oWN9bG NjSjlUXRtldbmK9hvx/NOzEZomKym61RjpiWo= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type :content-transfer-encoding; b=fPhirgTaQGXw4r5os2ZMlJHSyrm/h52QtGtcWflIlWHuZKhPbAkmVOFOd4frjAwYru r/D3iXmcM2XKsDllkMr0HcpIjITA8Kg/JsI/6adEM8JagkAzU8O1NQwjdhkJKO7JRYFU 50H53NnmB3McBmsXa5/mGyLSylTdC4z15u3LQ= Hi, all. Is there any (kernel- or user-mode) way to set a process' working set size explicitly in runtime? Thanks in advance, - Maxim. _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: broken pipe
by Rakesh Singhal 18 Feb '09

18 Feb '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=gqhspmefHEpO9LM9w8icvgsZnpgrF/SwsQlDVf95H3E=; b=slO0cXtjqTFk6X8uKENDNT/Oo2uTplUMtKXya81iY/xV/tYL71VUAacXcsYw37+USD WXlqy8ECY6CX1UD5bz/X9etP8h84e7Rygp/WKV1GRMz6N20P3M1f2KKyX4KV/w8cGxwR tB7H+1vzngAjs0IC3l+oJ0Yf3ush+a2Q/LOyY= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=FRNiUxcDOpPP2gYp8/aaRDwjR1E85Dp4PLQAEgdHOg/7B7cBkf2tKl698l+scZP+Po oJFOALdYoafii7T0A1qtdrWEkHy1a0u8UsQ74ZJXX4UTlYyvMR7dYjWrWyU99t/cKj99 Usc2tC/Tzh9/r2ZCfe4Smb6EGm3m1BtvJhaF8= Thanks M. Yes, you are right. I am first checking using select(), that can app write to port or not then only I am writing to port(descriptor). But before that I was getting SIGPIPE signal few times, and now I am getting once after half an hour or 45 min. But the thing is that still I am getting it. So may be there is one more reason for this signal? I am getting this signal in main thread. Is there anyway to track this signal to know the cause of this? Regards rksinghal On Wed, Feb 18, 2009 at 1:59 AM, A.M. <agentm(a)themactionfaction.com> wrote: > > On Feb 17, 2009, at 2:06 PM, Rakesh Singhal wrote: > >> Hi all, >> >> I am getting SIGPIPE (broken pipe) signal. I have implemented signal >> handler. >> >> I do not know, why I am getting it in my app. I do not have any >> sockets in my app. I am communicating with serial port and my own >> dynamic libraries. How can I find the cause of this signal? Please >> suggest. > > > You are writing to descriptor which has nothing on the other side (reading). > You should ignore the SIGPIPE signal on all threads and check for > errno==EPIPE instead. > > http://www.opengroup.org/onlinepubs/9699919799/functions/write.html > [EPIPE] An attempt is made to write to a pipe or FIFO that is not open for > reading by any process, or that only has one end open. A SIGPIPE signal > shall also be sent to the thread. > > Cheers, > M > > _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

New Mac OS Forge Project: FS Tools
by William Siegrist 17 Feb '09

17 Feb '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com A new project has opened up on Mac OS Forge! http://fstools.macosforge.org/ Thank you. ---- William Siegrist Darwin Team _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… "The Filesystem Tools project is a place where the Apple filesystem teams will be publishing some of the tools we use to test the filesystems that are part of Mac OS X. These tools will be useful to developers who are writing new Mac OS X filesystems, or testing Mac OS X network filesystems against their servers." This email sent to site_archiver(a)lists.apple.com

1 0

Re: [ANN]Yet another CFLite
by David M. Cotter 17 Feb '09

17 Feb '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

broken pipe
by Rakesh Singhal 17 Feb '09

17 Feb '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:date:message-id:subject :from:to:content-type:content-transfer-encoding; bh=SqxQNZ9WrZ/TDJUmn6cV0hLVl56DfhFs+XStNf9QwlE=; b=ov74hq7xAbfi/DHODNS3WgbQeSTsor1Q8bJ389RPH/L4FO/TO1N44h3YR4lNGiOA/c r6FpHu8GktLnP3RjmA97ZjZcYchKnnXmE2gJHBqWQMgqsi1pkt+Yp6MgMW9CdqB3eXX2 499bvLt+ldH/9jvuoDGxSI5aKyK71Z75Is67A= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type :content-transfer-encoding; b=vzweSV+JgdVwAcX65YH4l/7B171L8knprbcOaBoANtLg0zyP5jbWzvGUS4DbsMabnt q8c8RNbTEWsZByra/UT5a3EN4Epa9D/4V65pI+NMGt/7O7DgOWnM+JQxfx+3dljYy3q7 cJV17IjcWYNOL38B88THaKgF7b6oJe8hsuVAQ= Hi all, I am getting SIGPIPE (broken pipe) signal. I have implemented signal handler. I do not know, why I am getting it in my app. I do not have any sockets in my app. I am communicating with serial port and my own dynamic libraries. How can I find the cause of this signal? Please suggest. Thanks in advance. Regards rksinghal _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: OSX vs. Win32 ACL permission bit mappings
by John Michael Zorko 17 Feb '09

17 Feb '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Waking up a network server: 2 threads + semaphore vs 1 thread + pipe
by A.M. 17 Feb '09

17 Feb '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Feb 14, 2009, at 9:54 AM, Joel Reymont wrote: Terry, On Feb 14, 2009, at 2:19 PM, Terry Lambert wrote: My apologies. Certain experts are not on every list... like you. Which is the best design and how efficient? There is one thread (CFSocketManager thread) for all CFSockets. Cheers, M _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Please do not crosspost, especially to subscription-required-to- reply lists. You've actually said almost nothing about your problem space, other than implying that the packets are network MTU sized or smaller by discounting UDP vs. TCP and therefore packet reassembly after fragmentation doesn't come into play.. I tried to give just enough background to make it suitable for the lists I was posting to. The problem space is real-time audio generation on the iPhone (VoIP or synthesized music) and the broadcast of said audio. The application is supposed to send, receive, mix microphone with generated audio and do it without stuttering. Imagine that the iPhone is an instrument and you are trying to put together a distributed orchestra. CoreAudio triggers a callback every few milliseconds to both ask for audio and to supply it. I'm using ring buffers to store generated audio and packets received from the network. I will need to invoke sendto (or CFSocketSendData) in a loop to deliver audio to clients but I don't think it's proper to do it from within the CoreAudio callback. I can wrap CFSockets around my native sockets and add them to the run loop but it seems from reading the source code that CFSocket may run a thread per socket. The "you can read" notification will be handled then and I'll just need to run a thread to iterate through my sockets and send the audio. I figure can wake up this thread from the CoreAudio callback by using a semaphore. Alternatively, I can track my sockets with select or kevent/kqueue and use the same mechanism to track a pipe and wake the sending thread. This will only require one thread since it will be woken up on both sends (byte put into a pipe) and receives. How efficient is it to put a byte into a pipe in a callback that gets triggered every few milliseconds? Would there be a significant gain since an extra thread is not required to wait on a semaphore? Would it even out since (intuitively) a pipe is slower? Thanks, Joel Take a look the CFSocketManager code surrounding the CFRunLoop: http://google.com/codesearch/p?hl=en#Uhw2V3njhPU/Current/CF-368.25/ RunLoop.subproj/CFSocket.c&q=CFSocketManager The problem you will hit is that NSRunLoop will starve user event processing (including app drawing) while processing lots of socket data. It's not sufficient to offload the data receipt notifications from the main runloop, you should also offload the packet processing and then only update the program state from the secondary thread. The ultimate design of you application will depend on how much data needs to be processed and how many sockets you expect to be connected at any time. If I were you, I would start off with a simple secondary thread and NSRunLoop and use CFSockets hanging off of that and optimize later based on what profiling tells you. This email sent to site_archiver(a)lists.apple.com

1 0

Re: OSX vs. Win32 ACL permission bit mappings
by James Peach 17 Feb '09

17 Feb '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=YcHJd7ljjQN8+B68BIVhWC9GXGqaF+X/COXv1k6y0Yc=; b=djPKBe40mZ1dduBSGlDxxdj6xbZ7mUVjf22R+3GCj1wV88L9Mla3eTTDW46sWo98jl K0UqBd1HYurqcVp5cxPskfmyIUN7AGosZW5Dq1bjozDfeZ0rCf1Vhit2l0naNz3TaGTT /YaVhQTIC+gGJfLgxrzezgWY3thaQrJTRvGgs= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; b=dWMyCQpe0Kp11ed7U022S4045nm1dfy55rSMYwC5OdRyKq2faXEbDRAoijYxvzusI8 jDubeWLWDYqW4wiknVDfvaY/MCAsBoDlgs6P3UCbybxrYG3HCCy7lF+HwmC6DA6+kWV2 Y8zhs/2wD7DJWdqXK2LpLVsqKDfyLA/LV0f6Y= 2009/2/16 John Michael Zorko <jmzorko(a)mac.com>: > > Hello, all ... > > This may seem a bit off-topic, but it has some relevance I think. I'm > writing code to save ACL data in an SQLite database, and this code needs to > run on OSX and WIndows. I'd like to give the database field names some > relevance, instead of naming them "field 1", "field 2", "field 3" ... > Regarding ACLs, I need to know which OSX permissions bits correspond to > which Win32 permission bits in their respective ACEs. I understand that > some of them may not map at all, but I need to know which ones do and don't. > Some of them seem obvious, but some do not: > > • Win32 FILE_GENERIC_READ probably corresponds to ACL_READ_DATA > • Win32 FILE_GENERIC_WRITE probably corresponds to ACL_WRITE_DATA > • Win32 FILE_GENERIC_EXECUTE probably corresponds to ACL_EXECUTE > • Win32 GENERIC_READ ? > • Win32 GENERIC_WRITE ? > • Win32 GENERIC_EXECUTE ? > • Win32 GENERIC_ALL ? > • Win32 DELETE probably corresponds to ACL_DELETE > • Win32 READ_CONTROL probably corresponds to ACL_READ_SECURITY ? > • Win32 WRITE_DAC probably corresponds to ACL_WRITE_SECURITY ? > • Win32 WRITE_OWNER probably corresponds to ACL_CHANGE_OWNER > • Win32 SYNCHRONIZE ? > > ... do the following POSIX / OSX permissions map to Win32 permissions? > > ACL_APPEND_DATA > ACL_DELETE_CHILD > ACL_READ_ATTRIBUTES > ACL_WRITE_ATTRIBUTES > ACL_READ_EXTATTRIBUTES > ACL_WRITE_EXTATTRIBUTES Yep, that all sounds broadly on track. You can see how the Samba mapping works here: <http://www.opensource.apple.com/darwinsource/10.5.6/samba-187.8/samba/sourc…> -- James Peach | jorgar(a)gmail.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: [ANN]Yet another CFLite
by Jean-Daniel Dupas 17 Feb '09

17 Feb '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com It does not disappear. http://sourceforge.net/projects/opencflite/ Le 17 févr. 09 à 02:22, David M. Cotter a écrit : http://karaoke.kjams.com/wiki/Code/CFLite On Nov 23, 2008, at 7:24 AM, Jean-Daniel Dupas wrote: Hello, http://code.google.com/p/cf-lite _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/devlists%40shadowlab.org This email sent to devlists(a)shadowlab.org _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… seems that project has disappeared, but i've just updated mine: now with support for localizable strings, and full support for CFBundle (yes, bundles on windows) Be sure to check out the "SuperString" class in the CFTest project. It takes ANY type of string as input, and gives you back ANY other type of string as output. Instantly compatible with all existing code, helps you move old code "forward" to CF strings. I'm not the author of this project, but it may interest everybody that would like to use CF based application on other plateforms (It already compile fine on Windows). « This project attempts to consolidate the work of anyone interested in using the Apple Core Foundation libraries outside of the Mac OS X environment. This project builds on the various open source releases of CFLite, as well as work from the DarwinBuild, PureDarwin, and other locations The hope is that this will become a central source for Core Foundation work outside of the Macintosh, and that there will be free transmission of patches back upstream.» This email sent to site_archiver(a)lists.apple.com

1 0