12C RAC for ASM添加磁盤步驟

RHEL 7.2使用EMC Powerpath擴容2T磁盤空間，需要添加至以用12C RAC for ASM系統中。下面是具體步驟，主機人員告知擴容別名為data_center_16、data_center_17

1：linux 7 系統下添加映射存儲LUN(無需重啟)
1>查看機器HBA卡信息--兩個節點機器都得root用戶執行
#ls /sys/class/fc_host
host0-10
2>通過修改文件“scan”權限，讓系統重新掃描新的硬件設備
echo '- - -' > /sys/class/scsi_host/host0/scan
echo '- - -' > /sys/class/scsi_host/host1/scan
echo '- - -' > /sys/class/scsi_host/host2/scan
echo '- - -' > /sys/class/scsi_host/host3/scan
echo '- - -' > /sys/class/scsi_host/host4/scan
echo '- - -' > /sys/class/scsi_host/host5/scan
echo '- - -' > /sys/class/scsi_host/host6/scan
echo '- - -' > /sys/class/scsi_host/host7/scan
echo '- - -' > /sys/class/scsi_host/host8/scan
echo '- - -' > /sys/class/scsi_host/host9/scan
echo '- - -' > /sys/class/scsi_host/host10/scan

3>查詢新識別出的來設備，兩個節點機器都得執行root用戶
#powermt display dev=all
#ls -al /dev/emcpower*
#powermt display
#powermt config
#powermt save

4>查詢新增的擴容盤為data_center_16、data_center_17
Pseudo name=emcpowert
VNX ID=CKM00141100044 [data_center]
Logical device ID=60060160F7303500ACF6E88706A1E811 [data_center_16]
state=alive; policy=CLAROpt; queued-IOs=0
Owner: default=SP B, current=SP B Array failover mode: 4

==============================================================================
--------------- Host --------------- - Stor - -- I/O Path -- -- Stats ---

HW Path I/O Paths Interf. Mode State Q-IOs Errors

==============================================================================
9 lpfc sdcx SP B0 active alive 0 0
9 lpfc sdcv SP A1 active alive 0 0
1 lpfc sdct SP A0 active alive 0 0
1 lpfc sdcr SP B1 active alive 0 0

Pseudo name=emcpoweru
VNX ID=CKM00141100044 [data_center]
Logical device ID=60060160F7303500ADF6E88706A1E811 [data_center_17]
state=alive; policy=CLAROpt; queued-IOs=0
Owner: default=SP B, current=SP B Array failover mode: 4

--------------- Host --------------- - Stor - -- I/O Path -- -- Stats ---

HW Path I/O Paths Interf. Mode State Q-IOs Errors

==============================================================================
9 lpfc sdcy SP B0 active alive 0 0
9 lpfc sdcw SP A1 active alive 0 0
1 lpfc sdcu SP A0 active alive 0 0
1 lpfc sdcs SP B1 active alive 0 0

并且查看有關系統信息是否有emcpowert、emcpoweru此次擴容盤別名
cat /proc/partitions | awk {'print $4'} |grep emcpower|sort

5> 執行root下腳本asm_udev_ol7.sh

[root@dwdb1 ~]# more asm_udev_ol7.sh
#!/bin/bash
for i in $(cat /proc/partitions | awk {'print $4'} |grep emcpower|sort);
do
echo "ACTION==\"add|change\", KERNEL==\"emcpower*\", ENV{DEVTYPE}==\"disk\",SUBSYSTEM==\"block\", PROGRAM==\"
/usr/lib/udev/scsi_id -g -u -d --whitelisted --replace-whitespace --device=\$devnode\", RESULT==\"/usr/lib/u<br/>dev/scsi_id -g -u -d --whitelisted --replace-whitespace --device=/dev/$i\",RUN+=\"/bin/sh -c 'mknod /dev/asm
-$i b \$major \$minor; chown grid:asmadmin /dev/asm-$i; chmod 0660 /dev/asm-$i'\"" >> /etc/udev/rules.d/
99-oracle-asmdevices.rules_bak
done

6>生成的/etc/udev/rules.d/99-oracle-asmdevices.rules_bak中取出（360060160f7303500acf6e88706a1）
ACTION=="add|change", KERNEL=="emcpower", ENV{DEVTYPE}=="disk",SUBSYSTEM=="block", PROGRAM=="/usr/lib/udev/s
csi_id -g -u -d --whitelisted --replace-whitespace --device=$devnode", RESULT=="360060160f7303500acf6e88706a1
e811",RUN+="/bin/sh -c 'mknod /dev/asm-emcpowert b $major $minor; chown grid:asmadmin /dev/asm-emcpowert; chm
od 0660 /dev/asm-emcpowert'"
ACTION=="add|change", KERNEL=="emcpower", ENV{DEVTYPE}=="disk",SUBSYSTEM=="block", PROGRAM=="/usr/lib/udev/s
csi_id -g -u -d --whitelisted --replace-whitespace --device=$devnode", RESULT=="360060160f7303500adf6e88706a1
e811",RUN+="/bin/sh -c 'mknod /dev/asm-emcpoweru b $major $minor; chown grid:asmadmin /dev/asm-emcpoweru; chm
od 0660 /dev/asm-emcpoweru'"

7>然后vi /etc/udev/rules.d/99-oracle-asmdevices.rules新增兩條信息，將改好的文件，scp到節點二。

ACTION=="add|change", KERNEL=="emcpower", ENV{DEVTYPE}=="disk",SUBSYSTEM=="block", PROGRAM=="/usr/lib/udev/s
csi_id -g -u -d --whitelisted --replace-whitespace --device=$devnode", RESULT=="360060160f7303500acf6e88706a1
e811",RUN+="/bin/sh -c 'mknod /dev/asm-data15 b $major $minor; chown grid:asmadmin /dev/asm-data15; chmod 066
0 /dev/asm-data15'"
ACTION=="add|change", KERNEL=="emcpower", ENV{DEVTYPE}=="disk",SUBSYSTEM=="block", PROGRAM=="/usr/lib/udev/s
csi_id -g -u -d --whitelisted --replace-whitespace --device=$devnode", RESULT=="360060160f7303500adf6e88706a1
e811",RUN+="/bin/sh -c 'mknod /dev/asm-data16 b $major $minor; chown grid:asmadmin /dev/asm-data16; chmod 066
0 /dev/asm-data16'"

2、udev 確認99.rules文件在兩邊后，兩個節點執行以下命令；
/sbin/udevadm control --reload
/sbin/udevadm trigger --type=devices --action=change
檢查磁盤是否屬組正確

3、ASM磁盤組加磁盤或創建新的磁盤組。
[grid@dwdb1 ~]$ sqlplus / as sysasm
sysasm$alter diskgroup DATA add disk '/dev/asm-data15','/dev/asm-data16' rebalance power 10; ###該參數可以動態調整，10太慢的話，可以改到中間值5.

--查看執行效率
select group_number,operation,state ,power,est_minutes from v$asm_operation;

--等到執行完成后，改回1，11值為最小性能，1為最大性能
alter diskgroup DATA rebalance power 1;

--至此擴容工作已經完成，下面是具體監控辦法
--檢查header_status狀態，不應該有MEMBER以外的狀態
select group_number,disk_number,name,state,path,header_status from v$asm_disk;

--監控alert日志輸出結果
2018-08-17T16:43:33.399676+08:00
NOTE: Assigning number (3,14) to disk (/dev/asm-data15)
SUCCESS: completed reconfiguration of group 3 (DATA)
NOTE: Assigning number (3,15) to disk (/dev/asm-data16)
SUCCESS: completed reconfiguration of group 3 (DATA)

--監控查看rebalance進度，完成后查詢為空，改回power 為1
select inst_id, operation, state, power, sofar, est_work, est_rate, est_minutes from gv$asm_operation;