After updating ESXI 5.1 GA Host to Update 3, some of the Datastores are showing as inactive (unmounted). at the same time other ESXi hosts which are at 5.1 GA and 5.1 U1, can see those Datastores which are showing as inactive on this problematic Host. there are active VMs (VMDKs) on these datastores and is accessible to VMs and other Hosts but not to the problematic Host. checked with vmkernel logs and get to see as the device is read only and copied part of tail vmkernel.lo below:
so far, rebooted ESXi host couple of times, detach Device/ unmounted datastore and tried attach device, mount datastore, rescan storage devices and VMFS but nothing seems to work in this case.
it fails with this error message, when we try to mount the device:
Call "HostStorageSystem.MountVmfsVolume" for object "storageSystem-293" on vCenter Server "vcenter.domain.local" failed.
Operation failed, diagnostics report: Sysinfo error on operation returned status : Read only. Please see the VMkernel log for detailed error information
2015-03-24T15:20:46.781Z cpu6:18291)WARNING: UserLinux: 1631: UNIMPLEMENTED! write-back of mmap regions unsupported
2015-03-24T15:20:48.724Z cpu22:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:22:04.092Z cpu20:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:23:19.038Z cpu22:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:24:34.023Z cpu22:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:25:49.104Z cpu22:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:26:40.028Z cpu22:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:27:55.114Z cpu22:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:29:10.042Z cpu20:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:30:24.122Z cpu24:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:31:39.283Z cpu26:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:32:55.040Z cpu26:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:34:09.166Z cpu26:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:35:25.053Z cpu20:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:36:40.039Z cpu22:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:37:54.184Z cpu22:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:38:37.479Z cpu1:18290)VMK_PCI: 815: device 00:05:00.0 capType 16 capIndex 76
2015-03-24T15:38:37.482Z cpu1:18290)VMK_PCI: 815: device 00:05:00.1 capType 16 capIndex 76
2015-03-24T15:38:37.485Z cpu1:18290)WARNING: UserLinux: 1631: UNIMPLEMENTED! write-back of mmap regions unsupported
2015-03-24T15:38:37.488Z cpu1:18290)VmkAccess: 637: sfcb-smx: access denied:: dom:pluginDom(3), obj:forkSys(86), mode:syscall_allow(2)
2015-03-24T15:38:37.488Z cpu1:18290)VmkAccess: 922: Posix syscall clone (0)
2015-03-24T15:38:38.487Z cpu1:18290)WARNING: UserLinux: 1631: UNIMPLEMENTED! write-back of mmap regions unsupported
2015-03-24T15:38:46.319Z cpu1:18290)VMK_PCI: 815: device 00:05:00.0 capType 16 capIndex 76
2015-03-24T15:38:46.322Z cpu1:18290)VMK_PCI: 815: device 00:05:00.1 capType 16 capIndex 76
2015-03-24T15:38:46.325Z cpu1:18290)WARNING: UserLinux: 1631: UNIMPLEMENTED! write-back of mmap regions unsupported
2015-03-24T15:38:46.329Z cpu1:18290)VmkAccess: 637: sfcb-smx: access denied:: dom:pluginDom(3), obj:forkSys(86), mode:syscall_allow(2)
2015-03-24T15:38:46.329Z cpu1:18290)VmkAccess: 922: Posix syscall clone (0)
2015-03-24T15:38:47.327Z cpu1:18290)WARNING: UserLinux: 1631: UNIMPLEMENTED! write-back of mmap regions unsupported
2015-03-24T15:39:09.252Z cpu22:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:40:24.196Z cpu22:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:40:43.663Z cpu8:16392)NMP: nmp_ThrottleLogForDevice:2346: Cmd 0x2a (0x4124042694c0, 17321) to dev "naa.60002ac000000000000000330000xxxxx" on path "vmhba33:C0:T5:L9" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x7 0x27 0xc7. Act:NONE
2015-03-24T15:40:43.663Z cpu8:16392)ScsiDeviceIO: 2358: Cmd(0x4124042694c0) 0x2a, CmdSN 0x2 from world 17321 to dev "naa.60002ac000000000000000330000xxxxx" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x7 0x27 0xc7.
2015-03-24T15:40:43.664Z cpu2:17321)LVM: 11717: Failed to open device naa.60002ac000000000000000330000xxxxx:1 : Read only
2015-03-24T15:41:40.046Z cpu0:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:42:55.055Z cpu6:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:44:09.241Z cpu0:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:45:25.069Z cpu2:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:46:39.142Z cpu12:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
2015-03-24T15:47:54.644Z cpu12:18088)etherswitch: ESVsiGetParamPortCfg:392: : not found
could someone please check with this and let me know how to get this resolved.
thx