October 2004 - Darwin-dev - lists.apple.com

Numerical Computation Apps on OSX and/or Darwin
by Billie Pate 21 Oct '04

21 Oct '04

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Is it possible to run and install applications made for unix (e.g. Matlab, Mathematica, Cadence unix versions) on MAC OSX and/or Darwin? Also how do use Xemacs on Mac OSX or Darwin? Thanks for your help. _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Memory stats on a process...
by stephane sudre 21 Oct '04

21 Oct '04

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Oct 21, 2004, at 7:10 PM, Michael Burbidge wrote: _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… I'm looking for an API to get statistics about a process, such as processor time used, virtual memory used, physical memory used. The kind of statistics that the Mac OS X "Activity Monitor" give you. Can someone point me at the appropriate API? You can probably have a look at the source code for the ps command line tool. This email sent to site_archiver(a)lists.apple.com

1 0

Memory stats on a process...
by Michael Burbidge 21 Oct '04

21 Oct '04

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Can someone point me at the appropriate API? Thanks, Michael- _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… I'm looking for an API to get statistics about a process, such as processor time used, virtual memory used, physical memory used. The kind of statistics that the Mac OS X "Activity Monitor" give you. This email sent to site_archiver(a)lists.apple.com

1 0

Hdiutil fails when executed from detached (daemon) processes.
by Kevin Harris 19 Oct '04

19 Oct '04

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com User-agent: Mozilla Thunderbird 0.6 (X11/20040502) Thank you in advance for your help. #!/bin/bash # This script will create a disk image, detach itself from the calling process, # and attempt to mount the disk image. The purpose of this script is to show # failures in hdiutil trying to reach the framework server with an error like # the following: # # 2004-10-18 13:59:17.921 hdiutil[1089] error: unable to set up framework server. # # This seems to happen any time hdiutil is used, but the parent process tree # can't trace back to a login. Try this locally. It will work. Run it again # and log out--it will fail. # # The easiest way to test this is remotely through ssh, since it is by far the # easiset way to quickly log out: # ssh USER@MACHINE_NAME $PATH_TO/hdiutil_test.sh set -e # Specifies if the script completed successfully (1=success). COMPLETED_SUCCESSFULLY=0 # The amount of time to wait after this script is executed (detached) before # doing anything. This will give time for the calling process to quit and the # user to log out. DELAY_TIME=10 # The path of the device file that the dmg file was mounted under (used to # unmount it). DEVICE_PATH= # The name of the DMG file. DMG_FILENAME= # Abort the script, returning an error, and printing anything given as arguments. abort_script() { echo $@ exit 1 } # Create a 1 megabyte dmg file. create_dmg() { echo "Creating dmg file: $DMG_FILENAME" if hdiutil create -ov -size 1024k -fs HFS+ -volname "deleteme" ${DMG_FILENAME}; then return 0 else return 1 fi } # Remove the dmg file. erase_dmg() { echo "Removing dmg file." rm -f ${DMG_FILENAME} } # This function makes sure that the image is unmounted (and only unmounted once) at exit. unmount_dmg() { sync if [ "x$DEVICE_PATH" != "x" ]; then echo "Unmounting (detaching) dmg file." hdiutil detach $DEVICE_PATH DEVICE_PATH= fi if [ $# -ne 1 ]; then if [ ${COMPLETED_SUCCESSFULLY} -ne 1 ]; then erase_dmg echo "An error occurred." exit 1 fi fi } # Mount the dmg file mount_dmg() { set +e TEMP_MOUNT_LOG=`mktemp ${DMG_FILENAME}.mount.XXXXXX` if [ $? -ne 0 ]; then echo "Failed to create log file. Eeeeeeeeeeeeeeep." exit 1 fi echo "Mounting dmg file: $DMG_FILENAME" hdiutil mount ${DMG_FILENAME} -private >& ${TEMP_MOUNT_LOG} results=$? cat ${TEMP_MOUNT_LOG} if [ $results -eq 0 ]; then IMAGE_MOUNT_POINT=`grep /dev ${TEMP_MOUNT_LOG} | tail -1 | sed 's|.*$/Volumes.*$$|\1|g'` DEVICE_PATH=`df "${IMAGE_MOUNT_POINT}" | grep "${IMAGE_MOUNT_POINT}" | awk '{ print $1; }'` trap unmount_dmg EXIT fi rm -f ${TEMP_MOUNT_LOG} set -e return $results } # Detach from the parent process, saving all output in a log file. This will # re-execute the script, and the result will have no parent process. detach() { LOG_FILE=/tmp/hdiutil_test.$$.log echo "Detaching... Sending output to $LOG_FILE" # Close stdin, since the child process won't need to inherit it. exec 0<&- # Set a variable to prevent a runaway process. export ALREADY_DETACHED=1 # Re-execute this script passing in the name of the DMG file that was # created while the script was still attached. /bin/bash $0 $DMG_FILENAME >$LOG_FILE 2>&1 & disown $! echo "Detached." } # The main portion of the script. main() { if [ "x$ALREADY_DETACHED" != "x1" ]; then # Not detached... Create the disk image file and detach. DMG_FILENAME=/tmp/hdiutil_test.$$.dmg create_dmg || abort_script "Failed to create DMG file: $DMG_FILENAME" detach else # We're detached here. Do the real work. echo "Waiting for $DELAY_TIME seconds for the parent process to quit." sleep $DELAY_TIME echo "Ready to try mounting..." DMG_FILENAME=$1 mount_dmg || abort_script "Failed to mount dmg file." unmount_dmg NOERROR erase_dmg COMPLETED_SUCCESSFULLY=1 echo "Everything appeared to work correctly." fi } main "$@" _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com First of all, I apologize if I am sending this to the wrong mailing list. I read through Apple's mailing lists and this seemed like the closest match. Also, I don't believe that Darwin (without MacOS) supports hdiutil yet. I am writing a program which needs to use hdiutil for disk image manipulation. This will run in the background as a daemon and is not a gui application, nor is it directly using any of the OSX framework libraries. If the process is created and is detached from its parents, any use of hdiutil will fail after the parent processes exit. This means that if a user starts (or restarts) the program, it will continue to work only as long as that user is logged in. When the process is started from its init script during system startup, it will continue to function properly. This leads me to believe that the parent processes of the calling process are examined when using hdiutil. The error message from hdiutil is as follows: 2004-10-18 15:30:56.722 hdiutil[1691] error: unable to set up framework server. A google turned up nothing, as did a search on the Apple developer site and the "fink" mailing lists. I have written (and attached) a fairly simple script which can reproduce this problem. This is just an example and has nowhere near the functionality of my real project. I have only tested it on MacOS 10.3.x, so I don't know how any other versions would react in the same situation. Here's the output I get in my log file: ------------------------------------------------------------- Waiting for 10 seconds for the parent process to quit. Ready to try mounting... Mounting dmg file: /tmp/hdiutil_test.1681.dmg 2004-10-18 15:30:56.722 hdiutil[1691] error: unable to set up framework server. hdiutil: mount failed - Device not configured Failed to mount dmg file. ------------------------------------------------------------- I am attaching the complete script, and hope that it won't be stripped from this message. I don't believe that a required reboot is acceptable for normal operation, so I would appreciate any suggestions you may have. -Kevin-

1 0

Re: System Log facilities
by Damien Bobillot 19 Oct '04

19 Oct '04

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Resent-date: Tue, 19 Oct 2004 20:40:11 +0200 Resent-from: Damien Bobillot <damien.bobillot.2002+applelist(a)m4x.org> Resent-message-id: <D0990D84-21FD-11D9-B60C-000A959E9418(a)m4x.org> Resent-to: darwin-dev(a)lists.apple.com Le 19 oct. 04, à 15:31, stephane sudre a écrit : Is there any global API to log information into a .log file. You should use the syslog API. See "man syslog", "man syslogd" and "man syslog.conf" for more details. -- Damien Bobillot _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Logging information in system.log is easy. But from what I'm seeing in netinfo-324.6 for instance, there seems to be no global API to create .log files. Am I missing something? In a nutshell, you ask the system to log a message for a given priority (alert, warning, debug…) and type (auth, kernel, ftp, daemon…). According to the syslog configuration (/etc/syslog.conf), the messages are redirected to .log files in /var/log/. This email sent to site_archiver(a)lists.apple.com

1 0

Re: Wanted: rsync --rsrc
by Boyd Waters 19 Oct '04

19 Oct '04

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com On Oct 19, 2004, at 9:41 AM, Chris Kacoroski wrote: Thanks for that information! I will look at xtar... I think this solution is working well: _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… I have been testing backups options to linux servers extensively and found that xtar is really the only option. See the following thread from the backuppc list: http://news.gmane.org/gmane.comp.sysutils.backup.backuppc.general/ cutoff=2608 1) For initial bulk backups, I mount a volume on my Linux server via NFS or SAMBA. Then I use "ditto --rsrc" to move the data over. That way, the NFS/SAMBA client on the Mac side takes care of filename mappings and resource forks. I tried to pipe ditto output through ssh as shown in the ditto man page, but for 100 GB transfers this was too fragile. Actually any net connection when moving 100 GB is fraught: sometimes I use external hard disks to save the data from the Macintosh onto EXT2 partitions as pax archives. (If you have a developer release of 10.4.x, ditto has an additional option to prevent out-of-memory errors for large transfers: "--nocache") 2) For subsequent incremental backups, rsync+hfsmode tunneled through ssh. My "ultimate" solution would probably be to patch resource-fork support into the "star" (ess-tar) program; star strives for full POSIX compliance, and is the *only* tar/pax/cpio program that I have run across that does not choke on weird file names or very large files. I use star on my FreeBSD and Linux servers for full and incremental system dumps and the archives are totally portable across different OS types and system architectures. This email sent to site_archiver(a)lists.apple.com

1 0

System Log facilities
by stephane sudre 19 Oct '04

19 Oct '04

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Is there any global API to log information into a .log file. _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… Logging information in system.log is easy. But from what I'm seeing in netinfo-324.6 for instance, there seems to be no global API to create .log files. Am I missing something? This email sent to site_archiver(a)lists.apple.com

1 0

Re: Wanted: rsync --rsrc
by Boyd Waters 19 Oct '04

19 Oct '04

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com unofficial rsync "hfsmode" patch: http://www.quesera.com/reynhout/misc/rsync+hfsmode/ _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… I tried the Apple/OpenDarwin extended rsync, but it needs to be running on both client and server. I could not get it to compile on my Linux server. In contrast, this "hfsmode" patch splits the files out into AppleDouble, and then submits the two files that result to any rsync server. If you turn around and publish the resulting AppleDouble file collections via NFS or SMB, then they should appear correctly on your client Macs. I also tried "psync", which is an rsync like this implemented in Perl, but I had some problems with it on large transfers. Actually, I should warn against using rsync for bulk data transfers or backups -- I tried using rsync to manage my 100 GB volume and rsync ran out of memory, as it holds the file list and some metadata in a cache -- that is, don't point rsync at the root of your 100 GB filesystem if you have lots of files! This can be worked around, of course, by iterating over subdirs. But that's tedious and error-prone. This email sent to site_archiver(a)lists.apple.com

1 0

Re: Wanted: rsync --rsrc
by Dave Rehring 18 Oct '04

18 Oct '04

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com User-agent: Microsoft-Entourage/11.1.0.040913 On 10/18/04 1:00 PM, Dave Yost at ListMailForDave(a)Yost.com wrote: > Has anybody hacked rsync to do resource forks? http://www.versiontracker.com/dyn/moreinfo/macosx/16814 This is a GUI on top of a tool called rsync_hfs from www.opendarwin.org $129 cheaper than the other suggestion and you can start using it right away :-) Later, -- David Rehring Psychos do not explode when light hits VP of Research and Development them, no matter how crazy they are... Atimi Software, Inc. www.atimi.com And totally insane guy! _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Wanted: rsync --rsrc
by Giulio Cesare Solaroli 18 Oct '04

18 Oct '04

site_archiver(a)lists.apple.com Delivered-To: darwin-dev(a)lists.apple.com Domainkey-signature: a=rsa-sha1; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:references; b=IK/pzmmkz2hX0WzrobmXSNh3sSHbp3amBlu0SAz6zO5Z1hvlnvGgEjX9AaqB6bRu76LizJjkQkUFckji3AwBSScj4Dgfe0pxNhEslz+qwNXiaS4VRibvd08WqPBdc7rNoCjJ+SH+hO0MRK9DamuFeW82UxwceCCINQbCKe2W6vQ http://www.apple.com/downloads/macosx/system_disk_utilities/rsyncx.html On Mon, 18 Oct 2004 13:00:22 -0700, Dave Yost <listmailfordave(a)yost.com> wrote: > Has anybody hacked rsync to do resource forks? > > Thanks > > Dave _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-dev mailing list (Darwin-dev(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-dev/site_archiver%40lists.app… This email sent to site_archiver(a)lists.apple.com

1 0