December 2009 - Darwin-dev - lists.apple.com

Re: -mdynamic-no-pic on x86-32 vs 64
by Joel Reymont 11 Dec '09

11 Dec '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:subject:mime-version :content-type:from:in-reply-to:date:cc:content-transfer-encoding :message-id:references:to:x-mailer; bh=k81Kli7PasbxmR8ZlaSUmMxSoEgBA80w2itROdavE7A=; b=Y/TIbt/V3X/hoWkOG0n+ZrtgjVrWSBURnjw8sEYlnI5GlLy+2ewuf3iC1KSkm9MTSg q9AXANX2ko8234P9pJVDixrnCTdJ37ffpBqUJ765Ep9gaxq5H4f4jHENtJHpPNXVOxyh qClcfDHPjXcm1IkscIajnWvquCVSBDndXERUI= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=subject:mime-version:content-type:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to:x-mailer; b=Y8ZV8MhK0Pm47YsAKBuxnBxV1hnitirUD6aEd3/BySly1i8Zws1TJlHMCu8MchnLO4 eyfy53UYxRVNOI7jNExfcHZBXKmdvqHWB0DkO2z9LF+tT0YRDV3eeQfBQ2No6oI2DDQH CveZ4BdfLj25PtiXji9zQ2csj0W8nV2WEqM/E= On Dec 11, 2009, at 5:18 PM, Shantonu Sen wrote: > Also, I'm not sure what "cross-compiling" you're referring to. Are you building this on non-Mac OS X? By cross-compiling I mean using '-arch i386' since the default architecture on Snow Leopard is x86-64. gcc-4.2 -arch i386 -o prvrsion.o -c -fvisibility=hidden -mdynamic-no-pic -Wall -fno-common -pthread -O2 -fPIC -UDEBUG -DMOZILLA_CLIENT=1 -DNDEBUG=1 -DHAVE_VISIBILITY_HIDDEN_ATTRIBUTE=1 -DHAVE_VISIBILITY_PRAGMA=1 -DXP_UNIX=1 -DDARWIN=1 -DHAVE_BSD_FLOCK=1 -DHAVE_SOCKLEN_T=1 -DXP_MACOSX=1 -DHAVE_LCHOWN=1 -DHAVE_STRERROR=1 -DFORCE_PR_LOG -D_PR_PTHREADS -UHAVE_CVAR_BUILT_ON_SEM -D_NSPR_BUILD_ -I/Users/joelr/work/mozilla/static32/dist/include/nspr -I../../../../mozilla-central/nsprpub/pr/include -I../../../../mozilla-central/nsprpub/pr/include/private -I. ../../../../mozilla-central/nsprpub/pr/src/prvrsion.c Yes, I know that -mdynamic-no-pic overrides -fPIC. The full error is this: gcc-4.2 -arch i386 -dynamiclib -compatibility_version 1 -current_version 1 -all_load -install_name @executable_path/libnspr4.dylib -headerpad_max_install_names -o libnspr4.dylib ./prvrsion.o io/./prfdcach.o io/./prmwait.o io/./prmapopt.o io/./priometh.o io/./pripv6.o io/./prlayer.o io/./prlog.o io/./prmmap.o io/./prpolevt.o io/./prprf.o io/./prscanf.o io/./prstdio.o threads/./prcmon.o threads/./prrwlock.o threads/./prtpd.o linking/./prlink.o malloc/./prmalloc.o malloc/./prmem.o md/./prosdep.o memory/./prshm.o memory/./prshma.o memory/./prseg.o misc/./pralarm.o misc/./pratom.o misc/./prcountr.o misc/./prdtoa.o misc/./prenv.o misc/./prerr.o misc/./prerror.o misc/./prerrortable.o misc/./prinit.o misc/./prinrval.o misc/./pripc.o misc/./prlog2.o misc/./prlong.o misc/./prnetdb.o misc/./prolock.o misc/./prrng.o misc/./prsystem.o misc/./prthinfo.o misc/./prtpool.o misc/./prtrace.o misc/./prtime.o pthreads/./ptsynch.o pthreads/./ptio.o pthreads/./ptthread.o pthreads/./ptmisc.o md/unix/./unix.o md/unix/./unix_errors.o md/unix/./uxproces.o md/unix/./uxrng.o md/unix/./uxshm.o md/unix/./uxwrap.o md/unix/./darwin.o md/unix/./os_Darwin.o -framework CoreServices -framework CoreFoundation ld: absolute addressing (perhaps -mdynamic-no-pic) used in _libVersionPoint from ./prvrsion.o not allowed in slidable image. Use '-read_only_relocs suppress' to enable text relocs collect2: ld returned 1 exit status Thanks, Joel --- Mac hacker with a performance bent http://www.linkedin.com/in/joelreymont _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: -mdynamic-no-pic on x86-32 vs 64
by Jean-Daniel Dupas 11 Dec '09

11 Dec '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Le 11 déc. 2009 à 18:10, Joel Reymont a écrit : > I get this error when cross-compiling for x86-32 on Snow Leopard: > > --- > ld: absolute addressing (perhaps -mdynamic-no-pic) used in _libVersionPoint from ./prvrsion.o not allowed in slidable image. Use '-read_only_relocs suppress' to enable text relocs > --- > > Why does this error only show up when cross-compiling? > Details about what it means was already discussed here: http://lists.apple.com/archives/darwin-dev/2009/Jul/msg00123.html It may be due to some hand written assembly, so it would explain why you get it in 32 bits and not 64 bits (as the assembly is obviously arch specific) _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: -mdynamic-no-pic on x86-32 vs 64
by Shantonu Sen 11 Dec '09

11 Dec '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com There's not enough information here to give an answer. Please provide the compiler and linker options you're using for prvrsion.o, another source file that doesn't complain, and the final link. Also, I'm not sure what "cross-compiling" you're referring to. Are you building this on non-Mac OS X? Shantonu Sen ssen(a)apple.com Sent from my Mac Pro On Dec 11, 2009, at 9:10 AM, Joel Reymont wrote: > I get this error when cross-compiling for x86-32 on Snow Leopard: > > --- > ld: absolute addressing (perhaps -mdynamic-no-pic) used in _libVersionPoint from ./prvrsion.o not allowed in slidable image. Use '-read_only_relocs suppress' to enable text relocs > --- > > Why does this error only show up when cross-compiling? > > Thanks, Joel > > --- > Mac hacker with a performance bent > http://www.linkedin.com/in/joelreymont > > _______________________________________________ > Do not post admin requests to the list. They will be ignored. > Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) > Help/Unsubscribe/Update your Subscription: > http://lists.apple.com/mailman/options/darwin-dev/ssen%40apple.com > > This email sent to ssen(a)apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

-mdynamic-no-pic on x86-32 vs 64
by Joel Reymont 11 Dec '09

11 Dec '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:from:content-type :content-transfer-encoding:subject:date:message-id:to:mime-version :x-mailer; bh=ISlIvhFhnxawq5HIvlTSBwovo0TV9v2YIMqDwRn0KV8=; b=jeThJOY8kinzXVQxhBT4H3c4E6iOOnZn+/Jdawj2dys+dxWJtbmA1bQi0u7smW//UT PVph30a1SJsRfIYs1AsztpG1oCiX5QPdw9DQnpvaeZwMAMT4o+LaI0Ch1AbCoZ42cfM6 NlxzviVsOq8BJxpECtO6ElxXj20XE59tZ1npQ= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:content-type:content-transfer-encoding:subject:date:message-id :to:mime-version:x-mailer; b=PV185luaQ30jXPEL3iNNonRgv6x71L1rJqAxS2mWfCqunlKwXoGwDEtLzsM3GbkoXH rd34NXRCur6zKA5afPk3d41RMQJBUAn6dYXty1k8ZJLjlULaqmZS84lnCJFp/iwtSt+f oj/lZbTbI7Rk+lE8DJi/YwSpyrVBxVkYNa0z0= I get this error when cross-compiling for x86-32 on Snow Leopard: --- ld: absolute addressing (perhaps -mdynamic-no-pic) used in _libVersionPoint from ./prvrsion.o not allowed in slidable image. Use '-read_only_relocs suppress' to enable text relocs --- Why does this error only show up when cross-compiling? Thanks, Joel --- Mac hacker with a performance bent http://www.linkedin.com/in/joelreymont _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

hdiutil and launchd
by Thomas Fritz 11 Dec '09

11 Dec '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha1; c=relaxed/relaxed; t=1260536945; l=771; s=domk; d=thomasf.com; h=Mime-Version:To:Date:Subject:Content-Transfer-Encoding:Content-Type: From:X-RZG-CLASS-ID:X-RZG-AUTH; bh=IO4P2PSjJaiBKVrFedWqA2JcjEg=; b=GZkP1RWGPMXtunW79seUo43TEhkqZE3CWh4or36F/Z7lyTaS4in0RagJEfX5/OfKFND D7oEwu4TqgYSYr8+m5Dp+a/kVbq8/0nGq7FtqAt0/qTdqQAffg4a64S9aT9fr5ZZPtH3W tc/gH2d/FR5XtpXX5pRMrEkRvENSNksCzec= Hi everybody I want to use launchd to mount an encrypted dmg image which contains my home directory (AES 256 - enterprise encryption guidelines ) and other directories i want to encrypt like /tmp, etc ... Therefore i created a launchd.plist which starts hdiutils to attach the image. To be able to enter the password, i directed stdin, stderr and stdout to /dev/console. Furthermore i modified com.apple.loginwindow.plist to wait until the image is mounted. Everything seems to work but after I logged in, the images isn't mounted anymore. Does anyone has an idea how to solve this problem ? By the way, which key derivation algorithm is used to derive the encryption key from the password. Kind regards Thomas Fritz _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: explanation of page in and page cache hit
by Joel Reymont 11 Dec '09

11 Dec '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:subject:mime-version :content-type:from:in-reply-to:date:cc:content-transfer-encoding :message-id:references:to:x-mailer; bh=JZwzpMTp79d9nC1GI54tTrZxDZsAt5UqJj8xo8oAhgQ=; b=TVC6DFhv4ao248waatQZBllph1UyN6AEzaJI7qzY+Wzo09GbS+CpBe1QLfeM9BgKWF HeCDfBAixF4OD3qUMKUoE/v17mRry9V6GNnqdD/HSkBgQsImeepez/viZpe4bVG2XhdQ AYFzO7pM2EqCoEiEsS8N8iYYaa1goMfaDPjlk= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=subject:mime-version:content-type:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to:x-mailer; b=wk9DfWIY/BJu+nNZiovuKV3lp4uDXVlbw9N36nspORsAc7pT7F8vbxH/fAXNF5eb93 wy2N++JgxJPyffcJl44UNSYp5bE9ajDcIEio6LP5IqY4XCIDKB77BjzoXvSCMcbWQ9ca CUdZr3gr0XoN9PC/okoBxXPX/BoyULOo+tB0U= On Dec 11, 2009, at 4:06 AM, Dan Shoop wrote: > Use of the word "unmapped" here is rather fuzzy. What does the OP mean by this? All the terms used by the OP are taken from Shark documentation ;-). --- Mac hacker with a performance bent http://www.linkedin.com/in/joelreymont _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: explanation of page in and page cache hit
by Dan Shoop 11 Dec '09

11 Dec '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Dec 10, 2009, at 6:03 PM, Shawn Erickson wrote: > On Thu, Dec 10, 2009 at 1:08 PM, Joel Reymont <joelr1(a)gmail.com> wrote: >> --- >> Page In: A nonresident page was read from disk. Generally you should say it's read from "backing store", since a page could come from the application binary (there's no program loader), swap, shared memory, data that is backed by a file, or be a special page type. (And "file" has a very loose term in unix parlance.) Demand-Zero pages would be a special page type and would not be read from disk either. Swap may also not be "disk." Likewise the page could be faulted in from an encrypted data store (perhaps in memory), or through a user-space pager and who knows where that means it could come from. Therefore a page could certainly be paged into the working set of a process' virtual address space but *not* be read from disk making that definition very poor. For example, a shared or a COW page. It's already in memory so it wouldn't be faulted from disk and would only get instantiated separately when it was written to by the process. >> Page Cache Hit: A resident, but unmapped page was touched. Use of the word "unmapped" here is rather fuzzy. What does the OP mean by this? I suspect he means that it's not physically mapped, that is it's not pmap'ed, but this is different than being mapped as an entry in the process' virtual address space. This may or may not be part of its working set and the page may or may not also be considered "cached" if it was COW or demand-zero, depending on your definitions. A page could be retrieved from cache if it had previously been unmapped and was mapped back in and requested, or if it had faulted out of the active working set due to active page quotas (but would still be mapped) and was cached on the inactive list. If it was physically faulted out and requested it could be either swapped back (in the case it was modified) or re-read directly from its original backing store (it wasn't swapped.) >> >> >> Does a page become resident but unmapped after a page-in? > > Don't think so (if I understand what you are asking). A page-in makes > it both resident and mapped for the requesting process. Again, depending on exactly what the OP means here, the page would certainly be mapped, otherwise it could not generate a fault. A page would have to exist as part of the process virtual address space in order to be referenced. A page in the virtual address space would be mapped but may or may not be resident and may or may not yet have been referenced so it may or may not be resident in physical memory. > >> What is a resident, but unmapped page? > > IIRC the need page exists in physical memory already but it isn't > currently mapped into the requesting process. Again this comes down to what the OP means by "unmapped". A shared page may be resident in memory but not in the current process' virtual address space yet. It would be resident but not mapped. A page that would be unmapped could be one that the process "threw away" or de-referenced, that is it's not part of the processes virtual address space. That page could then be on the inactive list and if it was shared or COW and never written, it could be resident and no longer be mapped by the process. Likewise all shared and active pages are resident but would only be mapped when the process added it to its virtual address space. (For instance it references a shared library that's dynamically loaded.) You may want to pick up a book on Operating Systems, I normally point people to Deitel's book which has a fairly readable Virtual Memory section, however I defer even my own comments here to Sigh's "Mac OS X Internals" for Mac OS X functionality and any Mac specific parlance. -d ------------------------------------------------------------------------ Dan Shoop Computer Scientist shoop(a)iwiring.net GoogleVoice: 1-646-402-5293 aim: iWiring twitter: @colonelmode _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: explanation of page in and page cache hit
by Shawn Erickson 10 Dec '09

10 Dec '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:cc:content-type; bh=18rzCvFvjBHP/+wCnHd4cOFFKj//PZhHyaOI4loLcZw=; b=NQw2a8gU5EycphnQImtHUJ+2Nif9yrk27cyOKv7NJBg2iC61YyJK07Hk/N1z5DnkNk f+tvbXZpJ0hgqDCFt63uo3ZhniQyqXfZIXecJBrsVTJQOHBFe4j6HUaA+u8zqcPLfUa4 6imX2VNWoxJX97vnsaXtfXPlLP+h0lXtxjR3Y= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=ejmwJr+611wM6vtrbymfjwIrJQ5F3dM/A8Qw3Ii6jrf5TMWtYObcMQl7huFRF8zLWa APK1ULoZhwqDG2Z4GI6Pi+4OB7vRPq496fQ7TZdmQQgymuO2KTVsIa48Nvqwycw4xU+U U5ap0O7/g3/AmD+1o3u70s7RaBDMzNCEH72v4= On Thu, Dec 10, 2009 at 1:08 PM, Joel Reymont <joelr1(a)gmail.com> wrote: > --- > Page In: A nonresident page was read from disk. > Page Cache Hit: A resident, but unmapped page was touched. > --- > > Does a page become resident but unmapped after a page-in? Don't think so (if I understand what you are asking). A page-in makes it both resident and mapped for the requesting process. > What is a resident, but unmapped page? IIRC the need page exists in physical memory already but it isn't currently mapped into the requesting process. -Shawn _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: zero-fill and memory allocation size
by Eric Gouriou 10 Dec '09

10 Dec '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Dec 10, 2009, at 11:43 AM, Joel Reymont wrote: > I understand that allocations over a certain size come from the virtual memory manager and have to be zero-filled. Is 15K still that size? Define "still". In SnowLeopard the limit for "large" allocations was raised to 127kB for systems containing more than 1GB of physical memory. The limit remains 15kB for 1GB systems, the minimum memory size specified at <http://www.apple.com/macosx/specs.html>. Note however that SnowLeopard also introduced a "death row" optimization for large allocations. A limited amount of freed large allocations does stick around. This means that large allocations can often be satisfied without invoking a system call. One side-effect of this optimization is that those allocations will not always be zero-filled, unless calloc() is being used. This was never guaranteed previously but was a side-effect of large allocations being serviced via vm_allocate() (< 10.5) or anonymous mmap() (>= 10.5). I believe that, for compatibility purposes, zero-filling is still performed for applications linked with a target version early than SnowLeopard. The details can be found in the Libc sources: <http://www.opensource.apple.com/source/Libc/Libc-583/gen/magazine_malloc.c> Eric > Thanks, Joel > > --- > Mac hacker with a performance bent > http://www.linkedin.com/in/joelreymont _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

explanation of page in and page cache hit
by Joel Reymont 10 Dec '09

10 Dec '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:from:content-type :content-transfer-encoding:subject:date:message-id:to:mime-version :x-mailer; bh=/B7+iHnWMJTLOJum0hogOkZvPyWwZmKWrGUQxW5qL4A=; b=ulQmxp/vSup9DV6kthh4ONMiL28o9ZhCAMKuOM4Ei42cca+w/FRw/88UkldAbz8n41 XO32F+K6BVNMhtMEBaJ52wwKN8pLKKfSr+WBZo0Qu9vHEIDLYoC0+sJ91wDs1uJnlSpY OpfNhehsz1iueoS5WtIkH+qKJPwxsldBLXBos= Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:content-type:content-transfer-encoding:subject:date:message-id :to:mime-version:x-mailer; b=ci/2ie6wbWIpClIL1PhaIyF46H4qmrZTwI0/DCWOgpt/GTsnuGykhY3mzlsG8Z+qxr Wc3otZnbguXuqqU1kg9mvWFQ6FIlxf5EoZEJKtCmOnyXYYp3W0iNAnCBsxWvj8Ec1XEO P87NFgLO0nyuDdFH8B0Ne8TRUzG0n0e6jlXTM= --- Page In: A nonresident page was read from disk. Page Cache Hit: A resident, but unmapped page was touched. --- Does a page become resident but unmapped after a page-in? What is a resident, but unmapped page? Thanks, Joel --- Mac hacker with a performance bent http://www.linkedin.com/in/joelreymont _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0