Advertisements

Tag Archives: rmsf

HP-UX: UXMON:Critical multipath error detected. Please see /var/opt/OV/log/OpC/scsi_mon.log for details.

I received this problem where the disk was showing some multipath erros on an HP-UX server

UXMON:Critical multipath error detected. Please see /var/opt/OV/log/OpC/scsi_mon.log for details.

Node : hpux.setaoffice.com
Node Type : Itanium 64/32(HTTPS)
Severity : critical
OM Server Time: 2016-05-24 11:35:09
Message : UXMON:Critical multipath error detected. Please see /var/opt/OV/log/OpC/scsi_mon.log for details.
Msg Group : OS
Application : scsimon
Object : No
Event Type :
Instance Name :
Instruction : No

root@hpux:~ # cat /var/opt/OV/log/OpC/scsi_mon.log
Tue May 24 12:35:07 2016 : Critical /dev/rdisk/disk670 has failed lunpaths! Please check with scsimgr -p lun_map -D /dev/rdisk/disk670

root@hpux:~ # scsimgr -p lun_map -D /dev/rdisk/disk670
lunpath:647:38/0/0/2/0/0/0.0x50060e800574f200.0x405c000000000000:fibre_channel:FAILED:FAILED
lunpath:632:38/0/0/2/0/0/1.0x50060e800574f210.0x405c000000000000:fibre_channel:FAILED:FAILED
lunpath:617:36/0/0/2/0/0/0.0x50060e800574f200.0x405c000000000000:fibre_channel:FAILED:FAILED
lunpath:602:36/0/0/2/0/0/1.0x50060e800574f210.0x405c000000000000:fibre_channel:FAILED:FAILED
lunpath:33:36/0/0/2/0/0/0.0x50060e800574f200.0x40a5000000000000:fibre_channel:ACTIVE:ACTIVE
lunpath:35:36/0/0/2/0/0/1.0x50060e800574f210.0x40a5000000000000:fibre_channel:ACTIVE:ACTIVE
lunpath:37:38/0/0/2/0/0/0.0x50060e800574f200.0x40a5000000000000:fibre_channel:ACTIVE:ACTIVE
lunpath:39:38/0/0/2/0/0/1.0x50060e800574f210.0x40a5000000000000:fibre_channel:ACTIVE:ACTIVE

Removing invalid paths

root@hpux:~ # rmsf -H 38/0/0/2/0/0/0.0x50060e800574f200.0x405c000000000000
root@hpux:~ # rmsf -H 38/0/0/2/0/0/1.0x50060e800574f210.0x405c000000000000
root@hpux:~ # rmsf -H 36/0/0/2/0/0/0.0x50060e800574f200.0x405c000000000000
root@hpux:~ # rmsf -H 36/0/0/2/0/0/1.0x50060e800574f210.0x405c000000000000

Checking LUN paths

root@hpux:~ # scsimgr -p lun_map -D /dev/rdisk/disk670
lunpath:33:36/0/0/2/0/0/0.0x50060e800574f200.0x40a5000000000000:fibre_channel:ACTIVE:ACTIVE
lunpath:35:36/0/0/2/0/0/1.0x50060e800574f210.0x40a5000000000000:fibre_channel:ACTIVE:ACTIVE
lunpath:37:38/0/0/2/0/0/0.0x50060e800574f200.0x40a5000000000000:fibre_channel:ACTIVE:ACTIVE
lunpath:39:38/0/0/2/0/0/1.0x50060e800574f210.0x40a5000000000000:fibre_channel:ACTIVE:ACTIVE

Checking another disk

root@hpux:~ # scsimgr -p lun_map -D /dev/rdisk/disk31
lunpath:61:0/2/1/0.0x21230002ac001673.0x4001000000000000:fibre_channel: FAILED:AUTH_FAILED
lunpath:62:0/2/1/0.0x21230002ac001673.0x4002000000000000:fibre_channel:ACTIVE:ACTIVE
lunpath:71:0/5/1/0.0x20240002ac001673.0x4001000000000000:fibre_channel: FAILED:AUTH_FAILED
lunpath:72:0/5/1/0.0x20240002ac001673.0x4002000000000000:fibre_channel:ACTIVE:ACTIVE

root@hpux:~ # ioscan -m lun /dev/rdisk/disk31
Class I Lun H/W Path Driver S/W State H/W Type Health Description
=======================================================================
disk 31 64000/0xfa00/0x8c esdisk CLAIMED DEVICE limited 3PARdataVV
0/2/1/0.0x21230002ac001673.0x4001000000000000
0/2/1/0.0x21230002ac001673.0x4002000000000000
0/5/1/0.0x20240002ac001673.0x4001000000000000
0/5/1/0.0x20240002ac001673.0x4002000000000000
/dev/disk/disk31 /dev/rdisk/disk31

2 Failed LUN paths

root@hpux:~ # scsimgr get_info -D /dev/rdisk/disk31|more

STATUS INFORMATION FOR LUN : /dev/rdisk/disk31

Generic Status Information

SCSI services internal state = ONLINE
Device type = Direct_Access
EVPD page 0x83 description code = 1
EVPD page 0x83 description association = 0
EVPD page 0x83 description type = 3
World Wide Identifier (WWID) = 0x50002ac0031a1673
Serial number = ” 1405747″
Vendor id = “3PARdata”
Product id = “VV ”
Product revision = “3131”
Other properties = “”
SPC protocol revision = 6
Open count (includes chr/blk/pass-thru/class) = 1
Raw open count (includes class/pass-thru) = 0
Pass-thru opens = 0
LUN path count = 4
Active LUN paths = 2
Standby LUN paths = 0
Failed LUN paths = 2
Maximum I/O size allowed = 2097152
Preferred I/O size = 2097152
Outstanding I/Os = 0
I/O load balance policy = round_robin
Path fail threshold time period = 0
Transient time period = 120
Tracing buffer size = 1024
LUN Path used when policy is path_lockdown = NA
LUN access type = NA
Asymmetric logical unit access supported = No
Asymmetric states supported = NA
Preferred paths reported by device = No
Preferred LUN paths = 0

Driver esdisk Status Information :

Capacity in number of blocks = 213909504
Block size in bytes = 512
Number of active IOs = 0
Special properties =
Maximum number of IO retries = 45
IO transfer timeout in secs = 30
FORMAT command timeout in secs = 86400
START UNIT command timeout in secs = 60
Timeout in secs before starting failing IO = 120
IO infinite retries = false

Validating disk paths for disk31

root@hpux:~ # scsimgr -f replace_wwid -D /dev/rdisk/disk31
scsimgr: Successfully validated binding of LUN paths with new LUN.

The invalid paths were removed

root@hpux:~ # ioscan -m lun /dev/rdisk/disk31
Class I Lun H/W Path Driver S/W State H/W Type Health Description
======================================================================
disk 31 64000/0xfa00/0x8c esdisk CLAIMED DEVICE online 3PARdataVV
0/2/1/0.0x21230002ac001673.0x4002000000000000
0/5/1/0.0x20240002ac001673.0x4002000000000000
/dev/disk/disk31 /dev/rdisk/disk31

Advertisements

DMESG-UNCLASSIFIED: to probe existing LUN id 0x0 failed with errno of 6.

DMESG-UNCLASSIFIED: to probe existing LUN id 0x0 failed with errno of 6.

Node : hp-ux.setaoffice.com
Node Type : Itanium 64/32(HTTPS)
Severity : major
OM Server Time: 2015-11-06 10:30:53
Message : DMESG-UNCLASSIFIED: to probe existing LUN id 0x0 failed with errno of 6.
Msg Group : OS
Application : HPUX_dmesg
Object : dmesg_UNCLASSIFIED
Event Type :
not_found

Instance Name :
not_found

Instruction : No

 

Message showing in dmesg and /var/adm/syslog/syslog.log

root@hp-ux:/root # dmesg | grep probe
An attempt to probe existing LUN id 0x0 failed with errno of 22.
An attempt to probe existing LUN id 0x0 failed with errno of 22.

root@hp-ux:/root # grep probe /var/adm/syslog/syslog.log | tail
Nov 4 16:08:31 vlunx012 vmunix: An attempt to probe existing LUN id 0x0 failed with errno of 6.
Nov 4 16:08:31 vlunx012 vmunix: An attempt to probe existing LUN id 0x0 failed with errno of 6.
Nov 4 16:08:33 vlunx012 vmunix: An attempt to probe existing LUN id 0x0 failed with errno of 22.

Scanning the hardware and it is shown that some tapes are in NO_HW status. Removed these tapes

root@hp-ux:/root # ioscan -fnkNC lunpath | grep NO_HW
lunpath 139 0/0/4/0.0xb.0x0 eslpt NO_HW LUN_PATH LUN path for tape95
lunpath 147 0/0/4/0.0×19.0x0 eslpt NO_HW LUN_PATH LUN path for tape99
lunpath 141 0/0/4/0.0x1a.0x0 eslpt NO_HW LUN_PATH LUN path for tape96
lunpath 144 0/0/4/0.0x1c.0x0 eslpt NO_HW LUN_PATH LUN path for tape97
lunpath 155 0/0/4/0.0x1d.0x0 eslpt NO_HW LUN_PATH LUN path for tape115
lunpath 150 0/0/4/0.0x1e.0x0 eslpt NO_HW LUN_PATH LUN path for tape47
lunpath 157 0/0/4/0.0×24.0x0 eslpt NO_HW LUN_PATH LUN path for tape98
lunpath 408 0/0/6/0.0×26.0x0 eslpt NO_HW LUN_PATH LUN path for tape199
lunpath 410 0/0/6/0.0×27.0x0 eslpt NO_HW LUN_PATH LUN path for tape203
lunpath 412 0/0/6/0.0×28.0x0 eslpt NO_HW LUN_PATH LUN path for tape200
lunpath 415 0/0/6/0.0×29.0x0 eslpt NO_HW LUN_PATH LUN path for tape201
lunpath 418 0/0/6/0.0x2a.0x0 eslpt NO_HW LUN_PATH LUN path for tape212
lunpath 423 0/0/6/0.0x2b.0x0 eslpt NO_HW LUN_PATH LUN path for tape204

root@hp-ux:/root # rmsf -H 0/0/4/0.0xb.0x0
root@hp-ux:/root # rmsf -H 0/0/4/0.0×19.0x0
root@hp-ux:/root # rmsf -H 0/0/4/0.0x1a.0x0
root@hp-ux:/root # rmsf -H 0/0/4/0.0x1c.0x0
root@hp-ux:/root # rmsf -H 0/0/4/0.0x1d.0x0
root@hp-ux:/root # rmsf -H 0/0/4/0.0x1e.0x0
root@hp-ux:/root # rmsf -H 0/0/4/0.0×24.0x0
root@hp-ux:/root # rmsf -H 0/0/6/0.0×26.0x0
root@hp-ux:/root # rmsf -H 0/0/6/0.0×27.0x0
root@hp-ux:/root # rmsf -H 0/0/6/0.0×28.0x0
root@hp-ux:/root # rmsf -H 0/0/6/0.0×29.0x0
root@hp-ux:/root # rmsf -H 0/0/6/0.0x2a.0x0
root@hp-ux:/root # rmsf -H 0/0/6/0.0x2b.0x0

root@hp-ux:/root # ioscan -fnkNC lunpath | grep NO_HW
root@hp-ux:/root #

dmesg output
class : lunpath, instance 139
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 147
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 141
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 144
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 155
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 150
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 157
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 408
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 410
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 412
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 415
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 418
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 423
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 139
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 147
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 141
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 144
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 155
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 150
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 157
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 412
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 408
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 410
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 415
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 418
An attempt to probe existing LUN id 0x0 failed with errno of 22.

class : lunpath, instance 423
An attempt to probe existing LUN id 0x0 failed with errno of 22.

%d bloggers like this: