December 2009 - Darwin-dev - lists.apple.com

Re: shmget() returning EINVAL for constant size and flags
by rohan a 05 Dec '09

05 Dec '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=ChS5V/1Spsrjo/m2oszmoE7Jcn7T9GX8oNHYfo8NVCU=; b=qKSpBbBKM7zgxm6+NLcz0OBqKVsWECRzFhjhwskzNP/KCNTWoD4Spyn2OucwfiNZyJ 9Fn1fHz7UNtfzuyDZXFFQrKUIyIPAO19Z8KlIFGg7OhwKji9SmYyBDgd+Af/dFz52GVn CY7WwxiWrBGLC22ct/D9ZhMrM+NFb59Mphsjs= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=xmaEekCXoR9XEblGYxjlZfDxs7aS6tfzewnNQGaU2dIR64U9C7l9DsHu6BYziPak+p NXAlY5JyLB8EKzNC251KlcDWTP7SQTqXEcGTGt7oo9fGS8rTBd4Gnw2K9NCUNhkt0OK/ 0UVxABz9WA6WHmCG5KbUQP+YdHkOcfDeJohvM= Hi, I do not think the key is invalid because shmget() with the same key has succeeded several times. Is it possible to use another key if either EEXIST or EINVAL is returned or should I necessarily have to check using shmctl() if another process is using that key ? Thanks, Rohan On Sat, Dec 5, 2009 at 11:53 AM, Tyler Sample <tyler.sample(a)gmail.com> wrote: > EINVAL is also returned if your key is entirely invalid. Double check that > before your function call. > > If that's not the problem, if the shmget call fails, you can try making > another call with the size set to 0, then make sure that call succeeds. Then > you can use shmctl to find out about the memory....In particular, you can > print the size. If it's something reasonable, you probably have a duplicate > key with another process. > > > > > > ----- Original Message ----- From: "rohan a" <info1686(a)gmail.com> > To: <darwin-dev(a)lists.apple.com> > Sent: Friday, December 04, 2009 9:30 PM > Subject: shmget() returning EINVAL for constant size and flags > > >> Hello All, >> I am using shmget() to allocate shared memory in my backup/restore >> utility. >> >> int shmget(key_t key, size_t size, int shmflg); >> >> The size and shmflg I am passing are always constant. If shmget() >> returns EEXIST I try again with another key until shared memory is >> allocated. >> >> On some occasions, shmget() fails and I am getting an EINVAL error. >> I dont think the arguments are invalid because, I am using constant >> values for size and shmflg for every call and most of the calls are >> successful. >> >> The Man page says this for EINVAL : >> >> [EINVAL] No shared memory segment is to be created, and a >> shared memory segment exists for >> key, but the size of the segment associated >> with it is less than size, which is non-zero. nonzero. >> zero. >> >> However, with every shmget() call, I use the same size 524288 and same >> flags with different key ofcourse. >> >> Then why should I get an EINVAL ? >> >> Is it possible that another application is allocating shared memory >> using this key but a size lesser than 524288 ? >> >> Along with checking EEXIST for existence of a memory location with >> this key should I also check for EINVAL ? >> That is if EINVAL is returned, should I try to allocate with another key ? >> >> Thanks, >> Rohan >> _______________________________________________ >> Do not post admin requests to the list. They will be ignored. >> Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) >> Help/Unsubscribe/Update your Subscription: >> http://lists.apple.com/mailman/options/darwin-dev/tyler.sample%40gmail.com >> >> This email sent to tyler.sample(a)gmail.com > > _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

shmget() returning EINVAL for constant size and flags
by rohan a 05 Dec '09

05 Dec '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:date:message-id:subject :from:to:content-type; bh=3K8D3PLaXnYIRKeqJZi5NOFSTZQfH6WbAmONwBLNPmU=; b=juSWdIskdLmsmRxBS/uTcY2yMMR9e/OOaDf6fav/XNN6ai/lJUGH9DTHDUKaYQWeB9 gL5Xao+RS7R6v9XXH1k3dZGkW9RXNO8/4vm/6dH9PacCctfRDBgaUENEQeg9TRx7Xnum aCEXG6V6CUlJaQHf/xy0kjICnlRoPeokc5+cY= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=Tmaww/Up+Z3LbNagdrqWQ4KfEsp/DqeOH3wx8GuvB6QyGytD+JeX4FmjLc4JL/3VJ0 XynStDMJFOp5h+Zp3YzET2PeE879u/6QEiPUTsnHSnmjKGbakqTWgwiu+dMIIbL68j2/ yMKL/3pHBExI6z0Wiu4lCaqeZLKS3/NHENS5c= Hello All, I am using shmget() to allocate shared memory in my backup/restore utility. int shmget(key_t key, size_t size, int shmflg); The size and shmflg I am passing are always constant. If shmget() returns EEXIST I try again with another key until shared memory is allocated. On some occasions, shmget() fails and I am getting an EINVAL error. I dont think the arguments are invalid because, I am using constant values for size and shmflg for every call and most of the calls are successful. The Man page says this for EINVAL : [EINVAL] No shared memory segment is to be created, and a shared memory segment exists for key, but the size of the segment associated with it is less than size, which is non-zero. nonzero. zero. However, with every shmget() call, I use the same size 524288 and same flags with different key ofcourse. Then why should I get an EINVAL ? Is it possible that another application is allocating shared memory using this key but a size lesser than 524288 ? Along with checking EEXIST for existence of a memory location with this key should I also check for EINVAL ? That is if EINVAL is returned, should I try to allocate with another key ? Thanks, Rohan _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Inputs required for creating a sqlite db file from dwarfdump output
by Arnab Ganguly 04 Dec '09

04 Dec '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:date:message-id:subject :from:to:content-type; bh=24yBQGk+IdCQmsfHZ+Fb5mSckacBNcm6gQvBZgmOfoA=; b=EqYMa8yKgvyosK0JtaC6csct5Sh0ciBp1GSNf56ygwLNKXLm7Wg3phG4uSp9fUXccu UCDl4mWZQ6UZWrmkGf98hUnYQRifS9Qe7d1iubiqx4/jxJjdNUEgl6Enp8GPIMnX5IoY kV6tk8WjU9YJIjD3wly09sCbyWBDcH8m6tPMM= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=VGvOSn+b6PeG8/3JiS2TC9Z8Spt7pYOyas9TuQZMzD3pvacOUaylh5J2RNlE5F4mbt PH32+x/cG6jRkjuCuJMUJGHFImhglPdAtnUXvT1KuvW4s/pxqvoO+co1w2ZUMP9cnftn xcB29nj0c7f84Rw77aChX174hSFXLEkeNvvPk= _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: which pages of the file are in the cache
by Jonas Maebe 04 Dec '09

04 Dec '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On 04 Dec 2009, at 03:53, Greg Parker wrote: Jonas _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… On Dec 3, 2009, at 6:19 PM, Juan Manuel Palacios wrote: Thing is, it *used* to be called MacOS, without any spaces, back in 'them pre-NeXT days, i.e. MacOS 9 and prior, all the way down to MacOS 7.6. Even prior to that it used to be called something completely different, namely "System Software", all the way down to its first 1.0 iteration, if I'm not mistaken. Once Stevie came back on board and we were dealing with the NeXT based Mac OS that we all now know and love, Apple did a complete Nineteen Eighty-Four on us and renamed the entire thing "Mac OS", with the space, rewriting every name and reference everywhere all the way back to 7.6 days, to make us believe nothing else had ever happened, very Ministry of Truth of you, thank you very much! ;) The "Mac OS" name, as introduced with Mac OS 7.6, had a space in it. This was well before the NeXT deal. http://www.altfuels.org/lilolmcs/graphics/atmnm8_1.gif http://www.apple-collection.com/PhoSysteme/S1.jpg http://www.apple-collection.com/PhoSysteme/Sys.Mc.7.6.B.jpg That's really odd, I was also 100% convinced that it was called "MacOS" rather than "Mac OS" between 7.6 and 9.2.2... I wonder why. This email sent to site_archiver(a)lists.apple.com

1 0

Re: which pages of the file are in the cache
by Greg Parker 04 Dec '09

04 Dec '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Dec 3, 2009, at 6:19 PM, Juan Manuel Palacios wrote: > On Aug 19, 2009, at 1:21 AM, Steve Checkoway wrote: >> On Aug 18, 2009, at 16:39, Michael Smith <msmith(a)freebsd.org> wrote: >> >>> MacOS X (note correct spacing for those that care)? >> >> Close. It's Mac OS X <http://www.apple.com/macosx/> for those _who_ care. =) > > I'm guessing this is pretty old and beaten, but I didn't see any conclusion to this particular branch of the discussion so I felt compelled to step in, even at this time & age. > > Thing is, it *used* to be called MacOS, without any spaces, back in 'them pre-NeXT days, i.e. MacOS 9 and prior, all the way down to MacOS 7.6. Even prior to that it used to be called something completely different, namely "System Software", all the way down to its first 1.0 iteration, if I'm not mistaken. Once Stevie came back on board and we were dealing with the NeXT based Mac OS that we all now know and love, Apple did a complete Nineteen Eighty-Four on us and renamed the entire thing "Mac OS", with the space, rewriting every name and reference everywhere all the way back to 7.6 days, to make us believe nothing else had ever happened, very Ministry of Truth of you, thank you very much! ;) The "Mac OS" name, as introduced with Mac OS 7.6, had a space in it. This was well before the NeXT deal. http://www.altfuels.org/lilolmcs/graphics/atmnm8_1.gif http://www.apple-collection.com/PhoSysteme/S1.jpg http://www.apple-collection.com/PhoSysteme/Sys.Mc.7.6.B.jpg Before Mac OS 7.6, the OS was generally referred to as "System 7.1", for example. http://en.wikipedia.org/wiki/File:Macintosh_System_7.5.3_screenshot.png http://en.wikipedia.org/wiki/File:Macintosh_System_7_boxes.png http://en.wikipedia.org/wiki/File:Sys6screenshotbusy.png -- Greg Parker gparker(a)apple.com Runtime Wrangler _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: which pages of the file are in the cache
by Juan Manuel Palacios 04 Dec '09

04 Dec '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Aug 19, 2009, at 1:21 AM, Steve Checkoway wrote: > > On Aug 18, 2009, at 16:39, Michael Smith <msmith(a)freebsd.org> wrote: > >> MacOS X (note correct spacing for those that care)? > > Close. It's Mac OS X <http://www.apple.com/macosx/> for those _who_ care. =) I'm guessing this is pretty old and beaten, but I didn't see any conclusion to this particular branch of the discussion so I felt compelled to step in, even at this time & age. Thing is, it *used* to be called MacOS, without any spaces, back in 'them pre-NeXT days, i.e. MacOS 9 and prior, all the way down to MacOS 7.6. Even prior to that it used to be called something completely different, namely "System Software", all the way down to its first 1.0 iteration, if I'm not mistaken. Once Stevie came back on board and we were dealing with the NeXT based Mac OS that we all now know and love, Apple did a complete Nineteen Eighty-Four on us and renamed the entire thing "Mac OS", with the space, rewriting every name and reference everywhere all the way back to 7.6 days, to make us believe nothing else had ever happened, very Ministry of Truth of you, thank you very much! ;) Mactracker (cf. http://mactracker.dreamhosters.com/) is usually of help in this sort of thing. Regards,... - jmpp > > > -- > Steve Checkoway > _______________________________________________ > Do not post admin requests to the list. They will be ignored. > Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) > Help/Unsubscribe/Update your Subscription: > http://lists.apple.com/mailman/options/darwin-dev/jmpalaciosp%40eml.cc > > This email sent to jmpalaciosp(a)eml.cc _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Socket Filter NKE
by Josh Graessley 03 Dec '09

03 Dec '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Sent from my iPhone On Dec 3, 2009, at 7:38, Jakub Bednar <jakub.bednar(a)avg.com> wrote: Hello list, Thanks a lot for Your help, Jakub _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/jgraessley%40apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… The recommeded solution is to manipulate connections to connect to your process instead of their intended destination. You may pass the intended destination out of band to your processs and then relay the data in user space between the socket connection from their process and your socket connection to their intended destination. I am writing a socket filter NKE that will intercept any TCP connections, pass its data to user-space processing using SYS_PROTO_CONTROL and then re-inject them back. I have read many posts in Apple mailing lists and the guides discussing NKE and Kernel Programming and up to now everything worked great. Today I have found a problem with one-way traffic ended with FIN sequence. In this case, the TCP reacts on the FIN and a sf_detach_func is called to my filter, while I still have some data swallowed and waiting for user-space to process it. I can't reinject the packets as I don't want to leave any data unprocessed. If I drop the packets, the client won't get them all, leading to errors. Can anyone please point me to any documentation discussing the socket filters in more detail? Can I msleep in sf_notify_func or sf_detach_func to let user-space process finish the scanning? Or can I somehow deny the socket detach and do it myself later? This email sent to jgraessley(a)apple.com This email sent to site_archiver(a)lists.apple.com

1 0

Socket Filter NKE
by Jakub Bednar 03 Dec '09

03 Dec '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Hello list, Thanks a lot for Your help, Jakub _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… I am writing a socket filter NKE that will intercept any TCP connections, pass its data to user-space processing using SYS_PROTO_CONTROL and then re-inject them back. I have read many posts in Apple mailing lists and the guides discussing NKE and Kernel Programming and up to now everything worked great. Today I have found a problem with one-way traffic ended with FIN sequence. In this case, the TCP reacts on the FIN and a sf_detach_func is called to my filter, while I still have some data swallowed and waiting for user-space to process it. I can't reinject the packets as I don't want to leave any data unprocessed. If I drop the packets, the client won't get them all, leading to errors. Can anyone please point me to any documentation discussing the socket filters in more detail? Can I msleep in sf_notify_func or sf_detach_func to let user-space process finish the scanning? Or can I somehow deny the socket detach and do it myself later? This email sent to site_archiver(a)lists.apple.com

1 0

Re: implementing plugins
by Greg Parker 02 Dec '09

02 Dec '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Dec 2, 2009, at 3:04 PM, Joel Reymont wrote: > Firefox loadable binary components ("plugins") link against dynamic libraries at the moment. Firefox links against too many dynamic libraries, though, and I have noticed a nice performance increase from a mostly static build compiled with -mdynamic-no-pic. > > Unfortunately, the static build breaks binary components since they no longer have dylibs to link against. Components still need string and other facilities now housed inside the static body of Firefox. Components also need to be compiled despite using undefined functions. > > This seems like a regular "plugin" issue, solved many times by now. I can't figure out how to solve this, though. Any suggestions? Try the -bundle_loader flag. When building a plugin, -bundle_loader tells the linker what executable will load the plugin, so the plugin's dependencies may link to the main executable itself. Then make sure the symbol visibility options for the main executable publish any symbols that the plugins might use. -- Greg Parker gparker(a)apple.com Runtime Wrangler _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

implementing plugins
by Joel Reymont 02 Dec '09

02 Dec '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:from:content-type :content-transfer-encoding:subject:date:message-id:to:mime-version :x-mailer; bh=f7unpkCiAz5marfPniH8PD9kDtFGsPiot4Pgl6I4VPg=; b=mn7g+/x9h+bTNeN+AJExQKejKW9CtrcWS6iSapv2bcX6F+xfxntkK0C/19DZKw9KCH ogYP8W5nC0M2JVnnXDh0Jghx7mSw4d4yj9msBWgSrHhtbX/EsZQP6ediTJlVJ9XuhaXD J/ng+VOQOlk1aKeQ+f0NhRJHd4gRjK3+zKmR0= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:content-type:content-transfer-encoding:subject:date:message-id :to:mime-version:x-mailer; b=OspwkuU2XMaia+tuoYlDrd8fHoIxTMxXQyj3TKmp8FhG3w0xiiHDzOrwfSIruTnYqx f9uy8y48qSjuy3LhgvoVrjCTerC+VrUFXKe133kjry28Ij0yHBR3VTnymPzGWkupyTCv ngfIdYZ4sjikJfP4f6C+dfAAITbDOr6K1YoVg= Firefox loadable binary components ("plugins") link against dynamic libraries at the moment. Firefox links against too many dynamic libraries, though, and I have noticed a nice performance increase from a mostly static build compiled with -mdynamic-no-pic. Unfortunately, the static build breaks binary components since they no longer have dylibs to link against. Components still need string and other facilities now housed inside the static body of Firefox. Components also need to be compiled despite using undefined functions. This seems like a regular "plugin" issue, solved many times by now. I can't figure out how to solve this, though. Any suggestions? Thanks in advance, Joel --- Mac hacker with a performance bent http://www.linkedin.com/in/joelreymont _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0