Authentication-results: mail-in11.apple.com x-tls.subject="/C=US/ST=Oregon/L=Eugene/OU=Information Services/O=University of Oregon/CN=smtp.uoregon.edu"; auth=fail (cipher=AES256-SHA)
Delivered-to: email@hidden
Delivered-to: email@hidden
Rhon,
I may be wrong, but to me this is bringing up memories of a thread a while back on xsanity dealing with a max vnode issue. How much ram does your MDC have? Is spotlight enabled on the volume (shouldn't matter since it's offline)?
You might look at this: http://www.xsanity.com/forum/viewtopic.php?p=39353
And see maybe if adjusting the vnode option within sysctl might help. It's a long shot, but it could be it (I remember hearing about people having issues with Xsan 2.2 on 10.5.8, that don't happen with 10.6.x).
Thanks,
-Ryan Stasel
Systems Administrator
School of Journalism and Communication
University of Oregon
On May 28, 2010, at 08:12 , Rhon Fitzwater wrote:
> I have an XSan volume that crashed/panic on Monday. The crash appeared to be related to an XATTR error. After running several variations of csfsck (-w -X, etc), I was able to clear the errors. When remounting the volume, it mounted for minute and then crashed again. cvfsck reported no problems this time around. After digging further in logs I see that the RPL_Upgrade process was kicked off. We have been running XSan 2.2 for some time now (2.2.1 prior to crash). To my knowledge this process should only be executed once when upgrading from 1.4.X to 2. This process did run for us when we upgraded six months ago. I talked to Apple and they said to let the RPL process finish and things should come back online. Unfortunately, this is not the case. After taking 2 days to run the [RPL_Upgrade: removal part, it started doing the rebuild part. This gets to 50% and crashes every time now.
>
>
>> [0527 15:07:14] 0xa04f8720 (Info) RPL_Upgrade: 0% complete (1 of 8105 IEL blocks)
>> [0527 15:22:41] 0xa04f8720 (Info) RPL_Upgrade: 10% complete (811 of 8105 IEL blocks)
>> [0527 15:40:47] 0xa04f8720 (Info) RPL_Upgrade: 20% complete (1621 of 8105 IEL blocks)
>> [0527 15:53:23] 0xa04f8720 (Info) RPL_Upgrade: 30% complete (2432 of 8105 IEL blocks)
>> [0527 16:04:46] 0xa04f8720 (Info) RPL_Upgrade: 40% complete (3242 of 8105 IEL blocks)
>> [0527 16:23:49] 0xa04f8720 (Info) RPL_Upgrade: 50% complete (4053 of 8105 IEL blocks)
>> [0527 16:41:00] 0xa04f8720 (**FATAL**) PANIC: /Library/Filesystems/Xsan/bin/fsm ASSERT failed "pthread_mutex_lock(&ip->i_ref_lock) == 0" file inode.c, line 12288
>> [0527 16:41:00] 0xa04f8720 (**FATAL**) PANIC: wait 3 secs for journal to flush
>> [0527 16:41:03] 0xa04f8720 (**FATAL**) PANIC: aborting threads now.
>> Logger_thread: sleeps/353748 signals/0 flushes/420 writes/420 switches 0
>> Logger_thread: logged/448 clean/448 toss/0 signalled/0 toss_message/0
>> Logger_thread: waited/0 awakened/0
>
> So far the only solution I have read about is to downgrade to XSan 1.4.2. This should allow me to mount the volume, pull the data off, destroy the volume and start fresh with XSan 2.2.1.
>
> My problem is I do NOT have a copy of the XSan 1.4 installer and Apple does not make it available on their website. Does anyone out there have a copy they can provide with? Possibly just a disk image I can download?
>
> For those that say it would be easier to start from scratch and just restore the data from a backup; thanks, but unfortunately, we do not have a backup. Funding for that was denied when we purchased the XSan. Conveniently it was approved and was going to be installed next month.
>
> FYI: All servers are running are running 10.5.8 with all updates and XSan 2.2.1. RAID is a 16TB Promise system with latest firmware.
>
> If anyone has any other ideas, please let me know.
>
> Thanks!
>
> -Rhon
> P.S: Apologies for those who hate cross posting.
>
>
>
> _______________________________________________
> Do not post admin requests to the list. They will be ignored.
> Xsan-Users mailing list (email@hidden)
> Help/Unsubscribe/Update your Subscription:
>
> This email sent to email@hidden
_______________________________________________
Do not post admin requests to the list. They will be ignored.
Xsan-Users mailing list (email@hidden)
Help/Unsubscribe/Update your Subscription:
This email sent to email@hidden
