Tag: lsdev

Checking HBA status on AIX

Storage team checked and it was not showing light on the fiber

Index Slot Port Address Media Speed State Proto
===================================================
298 3 42 28a280 id N4 In_Sync FC
314 4 42 28b280 id N4 In_Sync FC

298 3/42 28a280 Online F 4 G AN A_S4_VIT_aix_HBA5C93 Emulex HBA 10:00:00:00:c9:86:5c:93
314 4/42 28b280 Online F 4 G AN A_S4_VIT_aix_HBA5C92 Emulex HBA 10:00:00:00:c9:86:5c:92

Listing HBA cards on AIX

root@aix:/ # lsdev -Cc adapter |grep fcs
fcs0 Available 01-00 4Gb FC PCI Express Adapter (df1000fe)
fcs1 Available 01-01 4Gb FC PCI Express Adapter (df1000fe)
fcs2 Available 06-00 4Gb FC PCI Express Adapter (df1000fe)
fcs3 Available 06-01 4Gb FC PCI Express Adapter (df1000fe)
fcs4 Available 0B-00 4Gb FC PCI Express Adapter (df1000fe)
fcs5 Available 0B-01 4Gb FC PCI Express Adapter (df1000fe)
fcs6 Available 0I-00 4Gb FC PCI Express Adapter (df1000fe)
fcs7 Available 0I-01 4Gb FC PCI Express Adapter (df1000fe)
fcs8 Available 0K-00 4Gb FC PCI Express Adapter (df1000fe)
fcs9 Available 0K-01 4Gb FC PCI Express Adapter (df1000fe)

Listing the WWPN of the HBA cards

root@aix:/ # lsdev -Cc adapter |grep fcs | awk ‘{print “echo “$1” `lscfg -vl “$1” | grep \”Network Address\”`”‘} | sh
fcs0 Network Address………….10000000C986EF2E
fcs1 Network Address………….10000000C986EF2F
fcs2 Network Address………….10000000C9865C92
fcs3 Network Address………….10000000C9865C93
fcs4 Network Address………….10000000C986ECDC
fcs5 Network Address………….10000000C986ECDD
fcs6 Network Address………….10000000C986F158
fcs7 Network Address………….10000000C986F159
fcs8 Network Address………….10000000C9865B8C
fcs9 Network Address………….10000000C9865B8D

Shows that the cable is connected

root@aix:/ # lsattr -El fscsi2 | grep attach
attach switch How this adapter is CONNECTED False
root@aix:/ # lsattr -El fscsi3 | grep attach
attach switch How this adapter is CONNECTED False

Fibre was replaced

Checking HBA link status

root@aix:/ # fcstat fcs2

FIBRE CHANNEL STATISTICS REPORT: fcs2

Device Type: 4Gb FC PCI Express Adapter (df1000fe) (adapter/pciex/df1000fe)
Serial Number: 1C910080BA
Option ROM Version: 02E8277F
ZA: Z1F2.70A5
World Wide Node Name: 0x20000000C9865C92
World Wide Port Name: 0x10000000C9865C92

FC-4 TYPES:
Supported: 0x0000012000000000000000000000000000000000000000000000000000000000
Active: 0x0000010000000000000000000000000000000000000000000000000000000000
Class of Service: 3
Port Speed (supported): 4 GBIT
Port Speed (running): 4 GBIT
Port FC ID: 0x28b280
Port Type: Fabric
Attention Type: Link Up
Topology: Point to Point or Fabric

Seconds Since Last Reset: 11518131

Transmit Statistics Receive Statistics
——————- ——————
Frames: 391415147 1672088546
Words: 100836128512 731260150528

LIP Count: 0
NOS Count: 124979
Error Frames: 0
Dumped Frames: 0
Link Failure Count: 3
Loss of Sync Count: 2
Loss of Signal: 1
Primitive Seq Protocol Error Count: 0
Invalid Tx Word Count: 1420
Invalid CRC Count: 0

IP over FC Adapter Driver Information
No DMA Resource Count: 0
No Adapter Elements Count: 0

FC SCSI Adapter Driver Information
No DMA Resource Count: 0
No Adapter Elements Count: 0
No Command Resource Count: 0

IP over FC Traffic Statistics
Input Requests: 0
Output Requests: 0
Control Requests: 0
Input Bytes: 0
Output Bytes: 0

FC SCSI Traffic Statistics
Input Requests: 143103337
Output Requests: 57507565
Control Requests: 1604694
Input Bytes: 2879322009348
Output Bytes: 387479621632
root@aix:/ # fcstat fcs3

FIBRE CHANNEL STATISTICS REPORT: fcs3

Device Type: 4Gb FC PCI Express Adapter (df1000fe) (adapter/pciex/df1000fe)
Serial Number: 1C910080BA
Option ROM Version: 02E8277F
ZA: Z1F2.70A5
World Wide Node Name: 0x20000000C9865C93
World Wide Port Name: 0x10000000C9865C93

FC-4 TYPES:
Supported: 0x0000012000000000000000000000000000000000000000000000000000000000
Active: 0x0000010000000000000000000000000000000000000000000000000000000000
Class of Service: 3
Port Speed (supported): 4 GBIT
Port Speed (running): 4 GBIT
Port FC ID: 0x28a280
Port Type: Fabric
Attention Type: Link Up
Topology: Point to Point or Fabric

Seconds Since Last Reset: 11518140

Transmit Statistics Receive Statistics
——————- ——————
Frames: 4294967295 4294967295
Words: 1099511627520 1099511627520

LIP Count: 0
NOS Count: 305070
Error Frames: 0
Dumped Frames: 0
Link Failure Count: 3
Loss of Sync Count: 310
Loss of Signal: 2
Primitive Seq Protocol Error Count: 0
Invalid Tx Word Count: 633
Invalid CRC Count: 0

IP over FC Adapter Driver Information
No DMA Resource Count: 0
No Adapter Elements Count: 0

FC SCSI Adapter Driver Information
No DMA Resource Count: 0
No Adapter Elements Count: 0
No Command Resource Count: 0

IP over FC Traffic Statistics
Input Requests: 0
Output Requests: 0
Control Requests: 0
Input Bytes: 0
Output Bytes: 0

FC SCSI Traffic Statistics
Input Requests: 262598606
Output Requests: 731955157
Control Requests: 736433
Input Bytes: 68507685800533
Output Bytes: 191832750846466
root@aix:/ # lsattr -El fscsi2
attach switch How this adapter is CONNECTED False
dyntrk no Dynamic Tracking of FC Devices True+
fc_err_recov delayed_fail FC Fabric Event Error RECOVERY Policy True+
scsi_id 0x28b280 Adapter SCSI ID False
sw_fc_class 3 FC Class for Fabric True

Replacing a disk in AIX

IBM technician informed that disk on DQD 82MC-P3-D5 needs to be replaced.

Server is ESERVER P5 570 9117 with 2 LPARs

aix6
aix7

Listing disks

root@aix6:/ # lsdev -Cc disk
hdisk0 Available 08-08-00 SAS Disk Drive
hdisk1 Available 08-08-00 SAS Disk Drive
hdisk2 Available 08-08-00 SAS RAID 5 Disk Array
hdisk3 Available 0D-08-00 SAS RAID 5 Disk Array
hdisk4 Available 01-00-02 MPIO FC 2145
hdisk21 Available 01-00-02 MPIO FC 2145
hdisk22 Available 01-00-02 MPIO FC 2145
hdisk44 Available 01-00-02 MPIO FC 2145
hdisk55 Available 01-00-02 MPIO FC 2145
hdisk56 Available 01-00-02 MPIO FC 2145
hdisk57 Available 01-00-02 MPIO FC 2145

Trying to find disk with Hardware Location Code DQD 82MC-P3-D5

root@aix6:/ # lsdev -Cc disk | awk ‘{print “lscfg -vpl “$1’}
lscfg -vpl hdisk0
lscfg -vpl hdisk1
lscfg -vpl hdisk2
lscfg -vpl hdisk3
lscfg -vpl hdisk4
lscfg -vpl hdisk21
lscfg -vpl hdisk22
lscfg -vpl hdisk44
lscfg -vpl hdisk55
lscfg -vpl hdisk56
lscfg -vpl hdisk57

root@aix6:/ # lsdev -Cc disk | awk ‘{print “lscfg -vpl “$1” | grep \”Hardware Location Code\””‘} | sh
Hardware Location Code……U789D.001.DQD60VA-P3-D5
Hardware Location Code……U789D.001.DQD60VA-P3-D6

Found on LPAR aix7

root@aix7:/root # lsdev -Cc disk | awk ‘{print “lscfg -vpl “$1” | grep \”Hardware Location Code\””‘} | sh
Hardware Location Code……U789D.001.DQD82MC-P3-D1
Hardware Location Code……U789D.001.DQD82MC-P3-D2
Hardware Location Code……U789D.001.DQD82MC-P3-D3
Hardware Location Code……U789D.001.DQD82MC-P3-D4
Hardware Location Code……U789D.001.DQD82MC-P3-D5
Hardware Location Code……U789D.001.DQD82MC-P3-D6

root@aix7:/root # lscfg -vpl hdisk4
hdisk4 U789D.001.DQD82MC-P3-D5 SAS Disk Drive (450000 MB)

Manufacturer…………….IBM
Machine Type and Model……ST3450856SS
FRU Number………………44V4432
ROS Level and ID…………45363134
Serial Number……………3QQ0KZEP
EC Level………………..L35857
Part Number……………..44V4433
Device Specific.(Z0)……..000005329F001002
Device Specific.(Z1)……..1217E614
Device Specific.(Z2)……..0021
Device Specific.(Z3)……..000-0
Device Specific.(Z4)……..
Device Specific.(Z5)……..22
Device Specific.(Z6)……..L35857
Hardware Location Code……U789D.001.DQD82MC-P3-D5

PLATFORM SPECIFIC

Name: disk
Node: disk
Device Type: block

Before replacing the disk using diag, remove disk definition otherwise you will receive the error: The device is currently in use and cannot be removed

root@aix7:/root # rmdev -dl hdisk4
hdisk4 deleted

Run diag

root@aix7:/root # diag
DIAGNOSTIC OPERATING INSTRUCTIONS VERSION 7.1.3.15 801001

LICENSED MATERIAL and LICENSED INTERNAL CODE – PROPERTY OF IBM
(C) COPYRIGHTS BY IBM AND BY OTHERS 1982, 2014.
ALL RIGHTS RESERVED.

These programs contain diagnostics, service aids, and tasks for
the system. These procedures should be used whenever problems
with the system occur which have not been corrected by any
software application procedures available.

In general, the procedures will run automatically. However,
sometimes you will be required to select options, inform the
system when to continue, and do simple tasks.

Several keys are used to control the procedures:
– The Enter key continues the procedure or performs an action.
– The Backspace key allows keying errors to be corrected.
– The cursor keys are used to select an option.

Press the F3 key to exit or press Enter to continue.

FUNCTION SELECTION 801002

Move cursor to selection, then press Enter.

Diagnostic Routines
This selection will test the machine hardware. Wrap plugs and
other advanced functions will not be used.
Advanced Diagnostics Routines
This selection will test the machine hardware. Wrap plugs and
other advanced functions will be used.
Task Selection (Diagnostics, Advanced Diagnostics, Service Aids, etc.)
This selection will list the tasks supported by these procedures.
Once a task is selected, a resource menu may be presented showing
all resources supported by the task.
Resource Selection
This selection will list the resources in the system that are supported
by these procedures. Once a resource is selected, a task menu will
be presented showing all tasks that can be run on the resource(s).

TASKS SELECTION LIST 801004

From the list below, select a task by moving the cursor to
the task and pressing ‘Enter’.
To list the resources for the task highlighted, press ‘List’.

Run Diagnostics
Run Error Log Analysis
Run Exercisers
Display or Change Diagnostic Run Time Options

Add Resource to Resource List
Automatic Error Log Analysis and Notification
Backup and Restore Media
Certify Media
Change Hardware Vital Product Data
Configure Platform Processor Diagnostics
Delete Resource from Resource List
Disk Maintenance
Display Configuration and Resource List
Display Firmware Device Node Information
Display Hardware Error Report
Display Hardware Vital Product Data
Display Multipath I/O (MPIO) Device Configuration
Display Previous Diagnostic Results
Display Resource Attributes
Display Service Hints
Display Software Product Data
Display or Change Bootlist
Format Media
Gather System Information
Hot Plug Task
IBM Tape Drive Service Aids
This selection provides a set of tools to perform utility functions on
Tape and Medium Changer Devices supported by the Atape Device Driver.
Identify and Attention Indicators
Log Repair Action
Microcode Tasks
Periodic Diagnostics
RAID Array Manager
Update Disk Based Diagnostics

Hot Plug Task 801004

Move cursor to desired item and press Enter.

PCI Hot Plug Manager
SCSI and SCSI RAID Hot Plug Manager

SCSI and SCSI RAID HOT PLUG MANAGER 802481

The following operations can be performed on devices attached to
SCSI and SCSI RAID Hot Plug Enclosure devices.

Make selection, use Enter to continue.

List Hot Swap Enclosure Devices
This selection lists all scsi hot swap slots and their contents.
Identify a Device Attached to a SCSI Hot Swap Enclosure Device
This selection sets the Identify indication.
Attach a Device to an SCSI Hot Swap Enclosure Device
This selection sets the Add indication and prepares
the slot for insertion of a device.
Replace/Remove a Device Attached to an SCSI Hot Swap Enclosure Device
This selection sets the Remove indication and prepares
the device for removal.
Configure Added/Replaced Devices
This selection runs the configuration manager on the
parent adapter where devices have been added or replaced.

REMOVE OR REPLACE DEVICE ATTACHED TO A SCSI HOT SWAP ENCLOSURE DEVICE 802485

The following is a list of configured, unconfigured and populated
SCSI Hot Swap Enclosure device slots. Select a slot to remove or
replace the device attached to that slot.
ENSURE THAT NO OTHER HOST IS USING THE DEVICE BEFORE REMOVING IT.

Make selection, use Enter to continue.

U789D.001.DQD50B4-
ses0 P4-Y1
slot 1 P4-D1 cd0

U789D.001.DQD82MC-
ses1 P3-Y2
ses2 P3-Y1
slot 1 P3-D1 hdisk0
slot 2 P3-D2 hdisk1
slot 3 P3-D3 hdisk2
slot 4 P3-D4 hdisk3
slot 5 P3-D5 [populated]
slot 6 P3-D6 hdisk5

Tell the technician to replace the disk. After disk is replaced, press Enter

The LED should be in the Remove state for the selected device. You may now remove or replace the device. Use ‘Enter’ to indicate you are finished.

Instead of showing populated, it will show the disk name

REMOVE OR REPLACE DEVICE ATTACHED TO A SCSI HOT SWAP ENCLOSURE DEVICE 802485

The following is a list of configured, unconfigured and populated
SCSI Hot Swap Enclosure device slots. Select a slot to remove or
replace the device attached to that slot.
ENSURE THAT NO OTHER HOST IS USING THE DEVICE BEFORE REMOVING IT.

Make selection, use Enter to continue.

U789D.001.DQD50B4-
ses0 P4-Y1
slot 1 P4-D1 cd0

U789D.001.DQD82MC-
ses1 P3-Y2
ses2 P3-Y1
slot 1 P3-D1 hdisk0
slot 2 P3-D2 hdisk1
slot 3 P3-D3 hdisk2
slot 4 P3-D4 hdisk3
slot 5 P3-D5 hdisk4
slot 6 P3-D6 hdisk5

Source:
Replacing a disk drive with the AIX system or logical partition powered on
Replacing a SCSI disk drive

UXMON: AIX syslog alarm: TAPE DRIVE FAILURE with ID 5537AC5F

Node : aix.setaoffice.com
Node Type : IBM RS/6000 64 HTTPS
Severity : warning
OM Server Time: 2017-01-21 12:03:23
Message : UXMON: AIX syslog alarm: TAPE DRIVE FAILURE with ID 5537AC5F
Msg Group : OS
Application : syslog
Object : 5537AC5F
Event Type :
not_found

Instance Name :
not_found

Instruction : Has been detected an alarm in the AIX errpt module
The annotation of this case will show the template description of this ID
If you feel this event is useless you can filter out it using the uxmonsyslog.cfg, see this
same file and/or documentation for details

Checking device status

root@aix:/ # lsdev -Cc tape | grep rmt109
rmt109 Available 0I-00-02 IBM 3580 Ultrium Tape Drive (FCP)

Checking device information

root@aix:/ # lscfg -vpl rmt109
rmt109 U789D.001.DQD16LD-P1-C1-T1-W50050763004BE309-L0 IBM 3580 Ultrium Tape Drive (FCP)

Manufacturer…………….IBM
Machine Type and Model……ULT3580-TD5
Serial Number……………00078AE800
Device Specific.(FW)……..F990

PLATFORM SPECIFIC

Name: tape
Node: tape
Device Type: byte

In our environment rmt109 is part of a tape library. BUR team needs to check tape W50050763004BE309

AIX – Removing disks from a volume group and then inserting a new disk

This activity they intend to remove a disk array drawer and so a new disk will be added and some old disks will be removed

Listing the disks

root@aix:/ # lspv
hdisk0 0003416af966647d rootvg active
hdisk1 0003416af740bb45 rootvg active
hdisk2 0003416a783c13a2 datavg active
hdisk3 0003416af7cc1c47 datavg active
hdisk4 0003416af7cc1cef datavg active
hdisk5 0003416af7cc1d8e datavg active
hdisk6 0003416af7cc1e47 datavg active
hdisk7 0003416a702e8968 datavg active
hdisk8 0003416af7cc1f97 datavg active
hdisk9 0003416afae71331 datavg active
hdisk10 0003416afae713de None
hdisk11 0003416afae7147e datavg active
hdisk12 0003416afae71520 datavg active
hdisk13 0003416afae715c5 datavg active
hdisk14 0003416afae7166c datavg active
hdisk15 0003416abe0699e3 datavg active
hdisk18 0003416a96438ea0 poolvg active
hdisk19 0003416a964390f3 poolvg active
hdisk20 0003416a96439327 poolvg active
hdisk21 0003416a964395d5 poolvg active
hdisk16 0003416a2f20c609 pool02vg active
hdisk17 0003416a2f20e88c pool03vg active

The command to find the newly inserted disk

root@aix:/ # cfgmgr

Listing the disk again. The new disk is the hdisk22

root@aix:/ # lspv
hdisk0 0003416af966647d rootvg active
hdisk1 0003416af740bb45 rootvg active
hdisk2 0003416a783c13a2 datavg active
hdisk3 0003416af7cc1c47 datavg active
hdisk4 0003416af7cc1cef datavg active
hdisk5 0003416af7cc1d8e datavg active
hdisk6 0003416af7cc1e47 datavg active
hdisk7 0003416a702e8968 datavg active
hdisk8 0003416af7cc1f97 datavg active
hdisk9 0003416afae71331 datavg active
hdisk10 0003416afae713de None
hdisk11 0003416afae7147e datavg active
hdisk12 0003416afae71520 datavg active
hdisk13 0003416afae715c5 datavg active
hdisk14 0003416afae7166c datavg active
hdisk15 0003416abe0699e3 datavg active
hdisk18 0003416a96438ea0 poolvg active
hdisk19 0003416a964390f3 poolvg active
hdisk20 0003416a96439327 poolvg active
hdisk21 0003416a964395d5 poolvg active
hdisk16 0003416a2f20c609 pool02vg active
hdisk17 0003416a2f20e88c pool03vg active
hdisk22 none None

Checking if the hdisk22 is coming from the disk array

root@aix:/ # lsdev -Cc disk
hdisk0 Available 1Z-08-00-8,0 16 Bit LVD SCSI Disk Drive
hdisk1 Available 1Z-08-00-9,0 16 Bit LVD SCSI Disk Drive
hdisk2 Available 1Z-08-00-10,0 16 Bit LVD SCSI Disk Drive
hdisk3 Available 1Z-08-00-11,0 16 Bit LVD SCSI Disk Drive
hdisk4 Available 25-08-00-8,0 16 Bit LVD SCSI Disk Drive
hdisk5 Available 25-08-00-9,0 16 Bit LVD SCSI Disk Drive
hdisk6 Available 25-08-00-10,0 16 Bit LVD SCSI Disk Drive
hdisk7 Available 25-08-00-11,0 16 Bit LVD SCSI Disk Drive
hdisk8 Available 25-08-00-12,0 16 Bit LVD SCSI Disk Drive
hdisk9 Available 25-08-00-13,0 16 Bit LVD SCSI Disk Drive
hdisk10 Available 25-09-00-8,0 16 Bit LVD SCSI Disk Drive
hdisk11 Available 25-09-00-9,0 16 Bit LVD SCSI Disk Drive
hdisk12 Available 25-09-00-10,0 16 Bit LVD SCSI Disk Drive
hdisk13 Available 25-09-00-11,0 16 Bit LVD SCSI Disk Drive
hdisk14 Available 25-09-00-12,0 16 Bit LVD SCSI Disk Drive
hdisk15 Available 25-09-00-13,0 16 Bit LVD SCSI Disk Drive
hdisk16 Available 1f-08-02 1722-600 (600) Disk Array Device
hdisk17 Available 2a-08-02 1722-600 (600) Disk Array Device
hdisk18 Available 2a-08-02 1722-600 (600) Disk Array Device
hdisk19 Available 2a-08-02 1722-600 (600) Disk Array Device
hdisk20 Available 2a-08-02 1722-600 (600) Disk Array Device
hdisk21 Available 2a-08-02 1722-600 (600) Disk Array Device
hdisk22 Available 1f-08-02 1722-600 (600) Disk Array Device

Adding hdisk22 to the volume group poolvg

root@aix:/ # extendvg poolvg hdisk22
0516-1254 extendvg: Changing the PVID in the ODM.

Listing the disks to check if hdisk22 is in the poolvg

root@aix:/ # lspv | grep hdisk22
hdisk22 0003416a16888bf6 poolvg active

Listing the logical volumes from the volume group poolvg

root@aix:/ # lsvg -l poolvg
poolvg:
LV NAME TYPE LPs PPs PVs LV STATE MOUNT POINT
pool_lv001 raw 128 128 4 open/syncd N/A
pool_lv002 raw 128 128 4 open/syncd N/A
pool_lv003 raw 128 128 4 open/syncd N/A
pool_lv004 raw 128 128 4 open/syncd N/A
pool_lv005 raw 128 128 4 open/syncd N/A
pool_lv006 raw 128 128 4 open/syncd N/A
pool_lv007 raw 128 128 4 open/syncd N/A
pool_lv008 raw 128 128 4 open/syncd N/A
pool_lv009 raw 128 128 4 open/syncd N/A
pool_lv010 raw 128 128 4 open/syncd N/A
pool_lv011 raw 128 128 4 open/syncd N/A
pool_lv012 raw 128 128 4 open/syncd N/A

Checking the characteristics from hdisk22

root@aix:/ # lspv hdisk22
PHYSICAL VOLUME: hdisk22 VOLUME GROUP: hsm_pool_vg
PV IDENTIFIER: 0003416a16888bf6 VG IDENTIFIER 0003416a00004c00000001129644220a
PV STATE: active
STALE PARTITIONS: 0 ALLOCATABLE: yes
PP SIZE: 256 megabyte(s) LOGICAL VOLUMES: 0
TOTAL PPs: 4462 (1142272 megabytes) VG DESCRIPTORS: 1
FREE PPs: 4462 (1142272 megabytes) HOT SPARE: no
USED PPs: 0 (0 megabytes) MAX REQUEST: 1 megabyte
FREE DISTRIBUTION: 893..892..892..892..893
USED DISTRIBUTION: 00..00..00..00..00

Removing the logical volumes. Repeat with all the logical volumes

root@aix:/ # rmlv -f hsm_pool_lv003
rmlv: Logical volume pool_lv003 is removed.

Removing the disks hdisk18, hdisk19, hdisk20 and hdisk21 from the volume group poolvg

root@aix:/ # reducevg poolvg hdisk18
root@aix:/ # reducevg poolvg hdisk19
root@aix:/ # reducevg poolvg hdisk20
root@aix:/ # reducevg poolvg hdisk21

Checking if the disks were removed

root@aix:/ # lspv
hdisk0 0003416af966647d rootvg active
hdisk1 0003416af740bb45 rootvg active
hdisk2 0003416a783c13a2 datavg active
hdisk3 0003416af7cc1c47 datavg active
hdisk4 0003416af7cc1cef datavg active
hdisk5 0003416af7cc1d8e datavg active
hdisk6 0003416af7cc1e47 datavg active
hdisk7 0003416a702e8968 datavg active
hdisk8 0003416af7cc1f97 datavg active
hdisk9 0003416afae71331 datavg active
hdisk10 0003416afae713de None
hdisk11 0003416afae7147e datavg active
hdisk12 0003416afae71520 datavg active
hdisk13 0003416afae715c5 datavg active
hdisk14 0003416afae7166c datavg active
hdisk15 0003416abe0699e3 datavg active
hdisk18 0003416a96438ea0 None
hdisk19 0003416a964390f3 None
hdisk20 0003416a96439327 None
hdisk21 0003416a964395d5 None
hdisk16 0003416a2f20c609 pool02vg active
hdisk17 0003416a2f20e88c pool03vg active
hdisk22 0003416a16888bf6 poolvg active

Removing the disk definition from the system

root@aix:/ # rmdev -dl hdisk18
hdisk18 deleted
root@aix:/ # rmdev -dl hdisk19
hdisk19 deleted
root@aix:/ # rmdev -dl hdisk20
hdisk20 deleted
root@aix:/ # rmdev -dl hdisk21
hdisk21 deleted

Checking if the disks are ready to be physically removed

root@aix:/ # lspv
hdisk0 0003416af966647d rootvg active
hdisk1 0003416af740bb45 rootvg active
hdisk2 0003416a783c13a2 datavg active
hdisk3 0003416af7cc1c47 datavg active
hdisk4 0003416af7cc1cef datavg active
hdisk5 0003416af7cc1d8e datavg active
hdisk6 0003416af7cc1e47 datavg active
hdisk7 0003416a702e8968 datavg active
hdisk8 0003416af7cc1f97 datavg active
hdisk9 0003416afae71331 datavg active
hdisk10 0003416afae713de None
hdisk11 0003416afae7147e datavg active
hdisk12 0003416afae71520 datavg active
hdisk13 0003416afae715c5 datavg active
hdisk14 0003416afae7166c datavg active
hdisk15 0003416abe0699e3 datavg active
hdisk16 0003416a2f20c609 pool02vg active
hdisk17 0003416a2f20e88c pool03vg active
hdisk22 0003416a16888bf6 poolvg active

The disks don’t appear anymore

root@aix:/ # lspv | egrep ‘hdisk18|hdisk19|hdisk20|hdisk21’
root@aix:/ #

Creating the logical volumes in the volume group to replace the old ones deleted

mklv -t raw -y pool_lv001 poolvg 128
mklv -t raw -y pool_lv002 poolvg 128
mklv -t raw -y pool_lv003 poolvg 128
mklv -t raw -y pool_lv004 poolvg 128
mklv -t raw -y pool_lv005 poolvg 128
mklv -t raw -y pool_lv006 poolvg 128
mklv -t raw -y pool_lv007 poolvg 128
mklv -t raw -y pool_lv008 poolvg 128
mklv -t raw -y pool_lv009 poolvg 128
mklv -t raw -y pool_lv010 poolvg 128
mklv -t raw -y pool_lv011 poolvg 128
mklv -t raw -y pool_lv012 poolvg 128
mklv -t raw -y pool_lv013 poolvg 128
mklv -t raw -y pool_lv014 poolvg 128
mklv -t raw -y pool_lv015 poolvg 128
mklv -t raw -y pool_lv016 poolvg 128
mklv -t raw -y pool_lv017 poolvg 128
mklv -t raw -y pool_lv018 poolvg 128
mklv -t raw -y pool_lv019 poolvg 128
mklv -t raw -y pool_lv020 poolvg 128
mklv -t raw -y pool_lv021 poolvg 128
mklv -t raw -y pool_lv022 poolvg 128
mklv -t raw -y pool_lv023 poolvg 128
mklv -t raw -y pool_lv024 poolvg 128
mklv -t raw -y pool_lv025 poolvg 128
mklv -t raw -y pool_lv026 poolvg 128
mklv -t raw -y pool_lv027 poolvg 128
mklv -t raw -y pool_lv028 poolvg 128
mklv -t raw -y pool_lv029 poolvg 128
mklv -t raw -y pool_lv030 poolvg 128
mklv -t raw -y pool_lv031 poolvg 128
mklv -t raw -y pool_lv032 poolvg 128
mklv -t raw -y pool_lv033 poolvg 128
mklv -t raw -y pool_lv034 poolvg 128

Verifying the volume group poolvg

root@aix:/ # lsvg poolvg
VOLUME GROUP: poolvg VG IDENTIFIER: 0003416a00004c00000001129644220a
VG STATE: active PP SIZE: 256 megabyte(s)
VG PERMISSION: read/write TOTAL PPs: 4462 (1142272 megabytes)
MAX LVs: 256 FREE PPs: 110 (28160 megabytes)
LVs: 34 USED PPs: 4352 (1114112 megabytes)
OPEN LVs: 0 QUORUM: 2
TOTAL PVs: 1 VG DESCRIPTORS: 2
STALE PVs: 0 STALE PPs: 0
ACTIVE PVs: 1 AUTO ON: yes
MAX PPs per VG: 30480
MAX PPs per PV: 5080 MAX PVs: 6
LTG size (Dynamic): 1024 kilobyte(s) AUTO SYNC: no
HOT SPARE: no BB POLICY: relocatable

Checking Disk Array status in AIX

This AIX server has a disk array connected.

root@aix:/ # lscfg -vl hdisk2
hdisk2           U0.1-P2-I3/Z3-A0  SCSI RAID 5 Disk Array

The array has 7 physical disks
root@aix:/ # lsdev -C | grep pdisk

pdisk0         Available 1A-08-01-0,0  Physical SCSI Disk Drive
pdisk1         Available 1A-08-01-1,0  Physical SCSI Disk Drive
pdisk2         Available 1A-08-01-2,0  Physical SCSI Disk Drive
pdisk3         Available 1A-08-01-3,0  Physical SCSI Disk Drive
pdisk4         Available 1A-08-01-4,0  Physical SCSI Disk Drive
pdisk5         Available 1A-08-01-5,0  Physical SCSI Disk Drive
pdisk6         Available 1A-08-01-6,0  Physical SCSI Disk Drive

Connected through a PCI-X SCSI RAID adapter
root@aix:/ # lscfg -vl sisioa0

sisioa0          U0.1-P2-I3  PCI-X Dual Channel U320 SCSI RAID Adapter
PCI-X Dual Channel Ultra320 SCSI RAID Adapter:
Part Number……………..97P3960
FRU Number………………97P3960
Serial Number……………YL10C4077074
Manufacture ID…………..000C
EC Level………………..0
ROM Level.(alterable)…….0709000c
Product Specific.(Z0)…….5703
Product Specific.(Z1)…….1
Device Specific.(YL)……..U0.1-P2-I3

When we checked the status we saw that the array was running in degraded state.
root@aix:/ #sisraidmgr -L -j1 -l sisioa0

————————————————————————
Name      Location      State       Description        Size
————————————————————————
sisioa0   1A-08         Available   PCI-X Dual Channel U320 SCSI RAID Adapter
scsi2    1A-08-00-07,0 NoLink      No remote adapter target
scsi3    1A-08-01-07,0 NoLink      No remote adapter target
hdisk2    1A-08-ff-0,0  Degraded RAID 5 Array     428.0GB
pdisk0   1A-08-01-0,0  Active      Array Member      71.4GB
pdisk1   1A-08-01-1,0  Active      Array Member      71.4GB
pdisk2   1A-08-01-2,0  Active      Array Member      71.4GB
pdisk3   1A-08-01-3,0  Active      Array Member      71.4GB
pdisk4   1A-08-01-4,0  Active      Array Member      71.4GB
pdisk5   1A-08-01-5,0  Active      Array Member      71.4GB
pdisk6   1A-08-01-6,0  Active      Array Member      71.4GB
hdisk0    1A-08-00-10,0 Available   16 Bit LVD SCSI  146.8GB
hdisk1    1A-08-00-11,0 Available   16 Bit LVD SCSI  146.8GB