August 2009 - Darwin-dev - lists.apple.com

Re: dyld cache: shared_region_roots/Applications.paths
by Joel Reymont 27 Aug '09

27 Aug '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Applications.paths does stick around after a reboot. Is it safe for an application to add itself there? Thanks, Joel On Aug 27, 2009, at 12:06 AM, Joel Reymont wrote: How do entries get into the Applications.paths file below? Thanks, Joel --- --- fastest mac firefox! http://wagerlabs.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Can it be edited manually or is there a tool to add and remove entries? cat /var/db/dyld/shared_region_roots/Applications.paths /System/Library/CoreServices/Finder.app/Contents/MacOS/Finder /System/Library/CoreServices/loginwindow.app/Contents/MacOS/ loginwindow /System/Library/Frameworks/ApplicationServices.framework/Frameworks/ CoreGraphics .framework/Resources/WindowServer /Applications/Safari.app/Contents/MacOS/Safari /Applications/Mail.app/Contents/MacOS/Mail /Applications/QuickTime Player.app/Contents/MacOS/QuickTime Player /Applications/iChat.app/Contents/MacOS/iChat /bin/sh /bin/bash This email sent to site_archiver(a)lists.apple.com

1 0

setuid root problem
by Duane Murphy 27 Aug '09

27 Aug '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 We have a product that uses an the older root tool helper process from MoreSecurity. We have installations of the product where the setuid-root bit doesn't seem to work. The program always asks for authentication (outside of the 5 minute timeout period). The tool lives in a framework inside of /Library/Frameworks. On other installations this works fine. On this installation, the setuid bit seems to have no affect. The system is connected to Active Directory if that makes any difference. What could be happening here? What situations would cause setuid-root to fail to launch a tool as root? Thanks for the help, ...Duane -----BEGIN PGP SIGNATURE----- Version: PGP Desktop 9.10.0 (Build 500) Charset: US-ASCII wsBVAwUBSpbTUkrg9acQ4r2CAQhTewgAlcefNDlIkHTtqgit8nxw+4MSv1EbR/IK efCmKg+Y2J0syJrZ0sq8gTkyPKHXFBNyQcJzati6Fi0ilnvtkfOim33VHeVrAFb6 ry/Rlz8EPiFOBXPD4tXdnK7eDwpiRbXayaQHunx3M3Bpg39CI0Lvuz2CxiigxGO+ uMJAbwkxChsBWSJD3IvH46/VYcnqYAzknayWhvVEtxm133NR6taDCOqHE/yieIq+ 1ua5/7k09JM4l9fUbujGAFw08qLQJF/Yp4egEbzNUElAFPY5PxJfiFeseAuUPD+3 e9EFz2iIRtYfquWtRtORPrcoqFy2BHB22zYKUEJlatNmVuDyrMgzkg== =yK2x -----END PGP SIGNATURE----- _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: safari dynamic linking
by Jean-Daniel Dupas 27 Aug '09

27 Aug '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Le 27 août 2009 à 00:57, Joel Reymont a écrit : On Aug 26, 2009, at 11:32 PM, Jean-Daniel Dupas wrote: _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… The list you get is the libraries that are loaded after the entry point is reached. I must not be thinking clearly since it's very late but I was under the impression that to resolve symbols, the dynamic linker runs before the program entry point is reached. What circumstances might cause libraries to be loaded after the program entry point, apart from manually invoking dlopen? Is Safari manually loading the RawCamera, HelpData or Shortcut frameworks, for example? It may be Safari, it may be some System frameworks that do it lazily. There is a lot of reason why a library will be load at runtime. Loading a plugin or a component that require it is one. Internet plugins are not loaded before the browser entry point and they may have reference on not yet loaded libraries. This email sent to site_archiver(a)lists.apple.com

1 0

Re: dyld shared cache: firefox vs safari
by Joel Reymont 27 Aug '09

27 Aug '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Aug 27, 2009, at 2:49 AM, Greg Parker wrote: Is there anything in the stats below that can hint at slowness? Thanks, Joel --- [1] Firefox dyld stats [2] Safari dyld stats --- fastest mac firefox! http://wagerlabs.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… DYLD_PRINT_STATISTICS may also be useful in identifying where your startup time is going. I have the stats for Firefox [1] and Safari [2], using the dyld shared cache. I don't know if I'm reading this correctly but it seems that Firefox goes through dyld more than twice as fast as Safari! total time: 49.1 milliseconds (100.0%) total images loaded: 106 (93 from dyld shared cache, 56 needed no fixups) total segments mapped: 49, into 5903 pages with 684 pages pre-fetched total images loading time: 9.5 milliseconds (19.4%) total rebase fixups: 149,011 total rebase fixups time: 4.1 milliseconds (8.4%) total binding fixups: 24,932 total binding symbol lookups: 797, average images searched per symbol: 2.3 total binding fixups time: 4.3 milliseconds (8.7%) total bindings lazily fixed up: 45 of 19,109 total init time time: 31.1 milliseconds (63.3%) total images with weak exports: 3 total time: 105.3 milliseconds (100.0%) total images loaded: 116 (114 from dyld shared cache, 114 needed no fixups) total segments mapped: 5, into 30 pages with 10 pages pre-fetched total images loading time: 3.6 milliseconds (3.4%) total rebase fixups: 1,298 total rebase fixups time: 0.1 milliseconds (0.0%) total binding fixups: 2,476 total binding symbol lookups: 234, average images searched per symbol: 1.6 total binding fixups time: 6.3 milliseconds (6.0%) total bindings lazily fixed up: 3 of 901 total init time time: 95.2 milliseconds (90.4%) total images with weak exports: 1 This email sent to site_archiver(a)lists.apple.com

1 0

Re: dyld shared cache: firefox vs safari
by Greg Parker 27 Aug '09

27 Aug '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Aug 26, 2009, at 2:06 PM, Joel Reymont wrote: --- #!/bin/bash -- Greg Parker gparker(a)apple.com Runtime Wrangler _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… I wrote io.d, a DTrace script and a derivative of iosnoop, to roll up disk io time during the first 20s of the Firefox startup [1]. I already have a 'cold startup' shell script that I use to trace Firefox, e.g. cmd="./Minefield.app/Contents/MacOS/firefox-bin -no-remote - foreground -P 2" sync && purge && dtrace -x dynvarsize=64m -x evaltime=exec -c "$cmd" -wZs $1 --- I cold-started and traced both Firefox [2] and Safari [3]. I now have a hunch that the slow Firefox startup may have a lot to do with the fact that most of the Safari bits are pulled from the dyld shared cache. Exercise: run both Safari and Firefox with environment variable DYLD_SHARED_REGION=avoid. This will turn off the dyld shared cache, removing that variable from your startup time measurements. If Safari is still faster to launch, it's not the shared cache's fault. DYLD_PRINT_STATISTICS may also be useful in identifying where your startup time is going. This email sent to site_archiver(a)lists.apple.com

1 0

Re: safari dynamic linking
by Greg Parker 27 Aug '09

27 Aug '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Yes, somebody is manually loading those with dlopen() or NSBundle. -- Greg Parker gparker(a)apple.com Runtime Wrangler _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… On Aug 26, 2009, at 3:57 PM, Joel Reymont wrote: On Aug 26, 2009, at 11:32 PM, Jean-Daniel Dupas wrote: The list you get is the libraries that are loaded after the entry point is reached. I must not be thinking clearly since it's very late but I was under the impression that to resolve symbols, the dynamic linker runs before the program entry point is reached. It does. That's when it loads the libraries in the `otool -L` list. You can see them with DYLD_PRINT_LIBRARIES. DYLD_PRINT_LIBRARIES_POST_LAUNCH prints only the libraries that are loaded post-launch, if any. In practice this means calls to dlopen() or NSBundle. What circumstances might cause libraries to be loaded after the program entry point, apart from manually invoking dlopen? Is Safari manually loading the RawCamera, HelpData or Shortcut frameworks, for example? This email sent to site_archiver(a)lists.apple.com

1 0

update_dyld_shared_cache and @executable_path
by Joel Reymont 26 Aug '09

26 Aug '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Thanks, Joel --- fastest mac firefox! http://wagerlabs.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… I added the path to my firefox binary to /var/db/dyld/ shared_region_roots/Applications.paths which now looks like this: /System/Library/CoreServices/Finder.app/Contents/MacOS/Finder /System/Library/CoreServices/loginwindow.app/Contents/MacOS/loginwindow /System/Library/Frameworks/ApplicationServices.framework/Frameworks/ CoreGraphics.framework/Resources/WindowServer /Applications/Safari.app/Contents/MacOS/Safari /Users/joelr/work/mozilla/startup/Minefield.app/Contents/MacOS/firefox- bin /Applications/Mail.app/Contents/MacOS/Mail /Applications/QuickTime Player.app/Contents/MacOS/QuickTime Player /Applications/iChat.app/Contents/MacOS/iChat /bin/sh /bin/bash I then ran update_dyld_shared_cache and went through another round of io snooping with dtrace. I noticed that Firefox libraries are still not loaded from the dyld shared cache. I'm thinking that @executable_path may have something to do with this, e.g. (otool -L firefox-bin) /Users/joelr/work/mozilla/startup/Minefield.app/Contents/MacOS/firefox- bin: /System/Library/Frameworks/Cocoa.framework/Versions/A/Cocoa (compatibility version 1.0.0, current version 12.0.0) @executable_path/XUL (compatibility version 1.0.0, current version 1.0.0) @executable_path/libmozjs.dylib (compatibility version 1.0.0, current version 1.0.0) ... Is it kosher to edit /var/db/dyld/shared_region_roots/ Applications.paths and does update_dyld_shared_cache have a rule against @executable_path? This email sent to site_archiver(a)lists.apple.com

1 0

dyld cache: shared_region_roots/Applications.paths
by Joel Reymont 26 Aug '09

26 Aug '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com How do entries get into the Applications.paths file below? Can it be edited manually or is there a tool to add and remove entries? Thanks, Joel --- --- fastest mac firefox! http://wagerlabs.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… cat /var/db/dyld/shared_region_roots/Applications.paths /System/Library/CoreServices/Finder.app/Contents/MacOS/Finder /System/Library/CoreServices/loginwindow.app/Contents/MacOS/loginwindow /System/Library/Frameworks/ApplicationServices.framework/Frameworks/ CoreGraphics .framework/Resources/WindowServer /Applications/Safari.app/Contents/MacOS/Safari /Applications/Mail.app/Contents/MacOS/Mail /Applications/QuickTime Player.app/Contents/MacOS/QuickTime Player /Applications/iChat.app/Contents/MacOS/iChat /bin/sh /bin/bash This email sent to site_archiver(a)lists.apple.com

1 0

Re: dyld shared cache: firefox vs safari
by Joel Reymont 26 Aug '09

26 Aug '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Aug 26, 2009, at 10:06 PM, Joel Reymont wrote: Thanks, Joel --- fastest mac firefox! http://wagerlabs.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… I cold-started and traced both Firefox [2] and Safari [3]. I now have a hunch that the slow Firefox startup may have a lot to do with the fact that most of the Safari bits are pulled from the dyld shared cache. I mean to say that Firefox startup is slow because Firefox libraries are NOT pulled from the dynamic library shared cache! I apologize for any misunderstanding this have caused :-). This email sent to site_archiver(a)lists.apple.com

1 0

Re: safari dynamic linking
by Joel Reymont 26 Aug '09

26 Aug '09

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Aug 26, 2009, at 11:32 PM, Jean-Daniel Dupas wrote: Thanks, Joel --- fastest mac firefox! http://wagerlabs.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… The list you get is the libraries that are loaded after the entry point is reached. I must not be thinking clearly since it's very late but I was under the impression that to resolve symbols, the dynamic linker runs before the program entry point is reached. What circumstances might cause libraries to be loaded after the program entry point, apart from manually invoking dlopen? Is Safari manually loading the RawCamera, HelpData or Shortcut frameworks, for example? This email sent to site_archiver(a)lists.apple.com

1 0