July 2005 - Darwin-kernel - lists.apple.com

OT? 10.4 VFS - ls works, but Carbon File Mgr listing does not
by Brian Bergstrand 28 Jul '05

28 Jul '05

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Here's the pertinent info: Preferred I/O size is 64K. vfs_setflags(mp, MNT_NODEV|MNT_NOSUID) vfs_setauthopaque() is called as the last step in our mount VNOP vfs_fsadd flags: VFS_TBLTHREADSAFE|VFS_TBLNOTYPENUM vol caps: /* Capabilities we know about */ capsp->valid[VOL_CAPABILITIES_FORMAT] = VOL_CAP_FMT_PERSISTENTOBJECTIDS | VOL_CAP_FMT_SYMBOLICLINKS | VOL_CAP_FMT_HARDLINKS | VOL_CAP_FMT_CASE_PRESERVING | VOL_CAP_FMT_FAST_STATFS #ifdef OSX_KPI | VOL_CAP_FMT_2TB_FILESIZE #endif ; capsp->valid[VOL_CAPABILITIES_INTERFACES] = VOL_CAP_INT_SEARCHFS | VOL_CAP_INT_ATTRLIST | VOL_CAP_INT_NFSEXPORT | VOL_CAP_INT_READDIRATTR; capsp->valid[VOL_CAPABILITIES_RESERVED1] = 0; capsp->valid[VOL_CAPABILITIES_RESERVED2] = 0; } vol attrs: Any ideas would be much appreciated. Thanks. Brian Bergstrand <http://www.bergstrand.org/brian/> PGP Key ID: 0xB6C7B6A2 -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (Darwin) iD8DBQFC6TxUedHYW7bHtqIRAuAQAJ92yzYZRR/HJlVyqlGEF6eKLD2+9QCg+wZJ SggltMA3BcbaMHW0C9BygJs= =nPXi -----END PGP SIGNATURE----- _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This may be OT, and if so let me know, but there are no lists for Carbon File Mgr / VFS interaction. I've been porting our VFS plugin to 10.4 and we are just about ready to go for a public beta release. However there's one huge problem left: File listings in the Finder and Open dialogs appear empty 99% of the time. I can see readdir being called, and returning the dir entries, and lookup seems to be called on most of them as well as access, none of these are returning errors, and everything works with ls (and it's various flags -l -F -C -i, etc) -- but for whatever reason Carbon File Mgr is just ignoring the entries. Sometimes I'll see the entries flash in a window for less than a second and then disappear and then other times they'll never appear. I think the problem may be related to our access/getattr calls, but I don't know what to look for. I've looked at NFS and WebDav and our access/getattr are as similar as possible to those. Network FS, we don't support native Carbon interfaces, no persistent id's, we do have unique object ID's, but they are a generated on the fly and can change with a Rename/Move. I've tried with an all access admin account and a limited access acct that has r/w to a few of the sub-folders on the volume, but not the vol itself. No difference in what is observed. __private_extern__ void volcaps(mount_t mp, vol_capabilities_attr_t *capsp) { /* Capabilities we support */ capsp->capabilities[VOL_CAPABILITIES_FORMAT] = VOL_CAP_FMT_CASE_PRESERVING /* Not true for DOS NS */ | VOL_CAP_FMT_FAST_STATFS /* NCIOM caches stat info */ #ifdef OSX_KPI | VOL_CAP_FMT_2TB_FILESIZE // We support at least 2TB files. #endif ; capsp->capabilities[VOL_CAPABILITIES_INTERFACES] = VOL_CAP_INT_ATTRLIST; capsp->capabilities[VOL_CAPABILITIES_RESERVED1] = 0; capsp->capabilities[VOL_CAPABILITIES_RESERVED2] = 0; #define NCP_ATTR_CMN_NATIVE ( \ ATTR_CMN_FSID | ATTR_CMN_OBJTAG | \ ATTR_CMN_OBJID | ATTR_CMN_MODTIME | ATTR_CMN_CHGTIME | \ ATTR_CMN_ACCTIME | ATTR_CMN_OWNERID | ATTR_CMN_GRPID ) #define NCP_ATTR_CMN_SUPPORTED NCP_ATTR_CMN_NATIVE #define NCP_ATTR_VOL_NATIVE ( \ ATTR_VOL_FSTYPE | ATTR_VOL_SIGNATURE | ATTR_VOL_SIZE | \ ATTR_VOL_SPACEFREE | ATTR_VOL_SPACEAVAIL | ATTR_VOL_IOBLOCKSIZE | \ ATTR_VOL_MOUNTPOINT | ATTR_VOL_NAME | ATTR_VOL_MOUNTPOINT | \ ATTR_VOL_MOUNTFLAGS | ATTR_VOL_MOUNTEDDEVICE | ATTR_VOL_CAPABILITIES | \ ATTR_VOL_ATTRIBUTES | ATTR_VOL_INFO ) This email sent to site_archiver(a)lists.apple.com

1 0

Re: get current time in kernel module
by Andrew Gallatin 28 Jul '05

28 Jul '05

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Allan Hoeltje writes: > > > "Mike Smith" <drivers(a)mu.org> wrote on 7/28/05 11:47 AM: > > > The kernel has no notion of the "time of day"; it is purely a > > userland conceit. It's quite possible, common and correct for > > different parts of the system to have different ideas about the > > current time of day. The kernel only knows about absolute time. > > Then why does my System Log file contain entries from the kernel such as > this one: > > Jul 28 11:00:40 MyMac kernel[0]: AirPort: Link UP: > > Maybe I misunderstand your response but it seems to me that there must be > some way for the kernel to get the "current now" time of day. I think syslog is recording the time of day that the entry was received from the kernel and that it bears no relationship to when the kernel actually generated the message. It may be timestamped, but if it were, it would be timestamped with time since the epoch, not the string "Jul 28 11:00:40" In general, a *nix kernel has no concept of timezones, adjustments for "daylight saving", etc. It just knows about uptime, and the time elapsed since the epoch. Translating timestamps is best done by something in userspace.. Drew _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: get current time in kernel module
by Allan Hoeltje 28 Jul '05

28 Jul '05

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com User-agent: Microsoft-Entourage/10.1.4.030702.0 "Mike Smith" <drivers(a)mu.org> wrote on 7/28/05 11:47 AM: > The kernel has no notion of the "time of day"; it is purely a > userland conceit. It's quite possible, common and correct for > different parts of the system to have different ideas about the > current time of day. The kernel only knows about absolute time. Then why does my System Log file contain entries from the kernel such as this one: Jul 28 11:00:40 MyMac kernel[0]: AirPort: Link UP: Maybe I misunderstand your response but it seems to me that there must be some way for the kernel to get the "current now" time of day. -Allan _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: get current time in kernel module
by Mike Smith 28 Jul '05

28 Jul '05

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: POSIX Async I/O
by Jerry Cottingham 28 Jul '05

28 Jul '05

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

POSIX Async I/O
by Ran Atkinson 28 Jul '05

28 Jul '05

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com I'm not sure if this is the right list or not, so please bear with me if I've guessed incorrectly. I think it belongs on the kernel list because these are kernel services (or would be if they were present). I have some existing UNIX-based (i.e. not Carbon/Cocoa) software that uses the POSIX Asynchronous I/O interfaces. These seem not to be present in Darwin (MacOS X 10.4), at least if unistd.h is to be believed. The same issue arises (for the same software) with respect to the POSIX Timer interfaces. Has someone else already run into either of these issues ? Is there a suggested workaround for either ? Is it worth reporting these through official channels, or are these issues just unlikely to be addressed anytime soon, and if so what is the correct process for that reporting ? Thanks, Ran _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: get current time in kernel module
by Andrew Gallatin 28 Jul '05

28 Jul '05

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Mekhala Patil writes: > Hi All, > > I want to print current date and time in a kernel module. I have also tried to use gettimeofday() by including sys/time.h But still it says undeclared. > > 1) do we have direct functions that we could use in kernel? > > 2) Can get time from epoch using gettimeofday? So, how do I convert it to the current date and time string. Is there something similar to > > userspace ctime in kernel? > > Please suggest. For time elapsed since the epoch, I think clock_get_calendar_microtime() from <kern/clock.h> is what you want. I have no idea how to turn that into a human readable date/time inside the kernel though. When I used it, it was to timestamp an event log buffer which was copied out to a user-level deamon, which did the printing of the time in userspace. Drew _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

get current time in kernel module
by Mekhala Patil 28 Jul '05

28 Jul '05

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: Serious Bug
by lakshmipathy bsn 27 Jul '05

27 Jul '05

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com Domainkey-signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=f8AkBGV3zI8Q8ANo4wQBJGhkMUjfeuo8mDwZIveVRDpY/TF615e3xmtM4mLjsK5YyGAQeuMH0ZXSXbP6igQ1sNYsYuOFv2S6g6TkkM4U9+CqRYi5X6yK1MXe/ZhSoRJO1mR6U1dplUCpRV+YoTA7O2xp9G3Jy7zMZnthhuL+FSg= I reported the bug in bugreporter. Thanks for the suggestion. Thanks, Lakshmipathy On 7/27/05, Terry Lambert <tlambert(a)apple.com> wrote: > Thanks for investigating the bug. > > You should file a bug report (http://bugreporter.apple.com) As > Justin usually points out, this list isn't an official (or even an > unofficial) channel for reporting bugs to Apple. > > -- Terry > > On Jul 26, 2005, at 10:46 AM, B. S. N. Lakshmipathy wrote: > > Hi all, > > The kernel released with 10.4.* (Tiger) has a serious bug. The > > following user program causes kernel panic. > > > > /* @@@@@@@@@@@@@@@@@@@*/ > > #include <stdio.h> > > #include <stdlib.h> > > #include <sys/types.h> > > #include <sys/event.h> > > > > int main (int argc, char **argv) { > > int kq; > > struct kevent ke; > > > > if (argc < 1) > > return -1; > > > > if ((kq = kqueue ()) < 0) { > > fprintf (stderr, "kqueue creation error\n"); > > return -1; > > } > > > > EV_SET (&ke, atoi (argv[1]), EVFILT_PROC, EV_ADD, NOTE_FORK | > > NOTE_TRACK, 0, NULL); > > > > if (kevent(kq, &ke, 1, NULL, 0, NULL) < 0) { > > fprintf (stderr, "kevent set error\n"); > > return -1; > > } > > > > while (1) { > > memset(&ke, 0, sizeof(struct kevent)); > > > > if (kevent(kq, NULL, 0, &ke, 1, NULL) < 0) { > > fprintf (stderr, "kevent get error\n"); > > return -1; > > } > > > > if (ke.fflags & NOTE_FORK) > > printf("%d forked\n", ke.ident); > > > > if (ke.fflags & NOTE_CHILD) > > printf("child of %d is %d\n", ke.data, ke.ident); > > > > if (ke.fflags & NOTE_TRACKERR) > > printf("NOTE_TRACK error\n"); > > } > > > > return 0; > > } > > /* @@@@@@@@@@@@@@@@@@@*/ > > > > LOCATION OF BUG: > > > > The problem is with the NULL pointer reference in fp_lookup() > > in bsd/kern/kern_descrip.c. The function call sequence is fork() -> > > fork1 () -> knote () -> filt_proc () -> kevent_register () -> > > fp_lookup (). filt_proc () calls kevent_register () with NULL as > > third argument. (kern_event.c:501), which is referenced in > > fp_lookup () without check for NULL. > > > > Whoever re-organized the kqueue/kevent code, please fix it. > > > > Thanks, > > Lakshmipathy > > > > _______________________________________________ > > Do not post admin requests to the list. They will be ignored. > > Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) > > Help/Unsubscribe/Update your Subscription: > > http://lists.apple.com/mailman/options/darwin-kernel/tlambert% > > 40apple.com > > > > This email sent to tlambert(a)apple.com > > > > -- Thanks, Lakshmipathy _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… This email sent to site_archiver(a)lists.apple.com

1 0

Re: sock_receive_internal() and its (ab)use of uio
by Brian Bergstrand 27 Jul '05

27 Jul '05

site_archiver(a)lists.apple.com Delivered-To: darwin-kernel(a)lists.apple.com -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Brian Bergstrand <http://www.bergstrand.org/brian/> PGP Key ID: 0xB6C7B6A2 -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (Darwin) iD8DBQFC5s+OedHYW7bHtqIRAh5yAKD2rE1WFWKwX8ILnjAy37LYRq71fgCeMXGO Z5Y4vWZBBmfQOWyln21p87w= =O+kT -----END PGP SIGNATURE----- _______________________________________________ Do not post admin requests to the list. They will be ignored. Darwin-kernel mailing list (Darwin-kernel(a)lists.apple.com) Help/Unsubscribe/Update your Subscription: http://lists.apple.com/mailman/options/darwin-kernel/site_archiver%40lists.… On Jul 26, 2005, at 6:46 PM, Sam Vaughan wrote: It's not that I don't want to use the KPI, it's just that there are so many areas where things are missing. Sockets are just this week. I'm also trying to deal with setting arbitrary dev_t values in buf_t objects, accessing the try variants and determining the current state of read-write locks, getting a device switch table entry from a major number, interrupting threads sleeping on sockets, timeout/untimeout, thread_abort_safely, ... and that's just the platform support code. Who knows what vfs, vnode lifetime, lookup, mmap and UBC issues still await! I've been porting our Network FS to tiger for the past two months and have run into my own set of KPI deficiencies with the socket KPI and the locking KPI (those try variants need to be exposed and R/W lock state too). I've opened Radars and talked with Josh at WWDC, but just wanted to reinforce Sam's experiences with what the KPI lacks. I've not run into any real problems with the VFS KPI, and we don't use buf_t's so I can't comment on that interface. Finally, I want to say thanks to Josh and everyone else from Apple for the replies to this list, they are very helpful. This email sent to site_archiver(a)lists.apple.com

1 0