I have an old clustered FAS8040 in 7-mode I'm trying to understand which has a bunch of chassis and drives (mixture of SSD and 4TB SATA).
Doing a "disk show" lists all the disks which are all part of a Pool0 pool, some of which are managed by controller A, the other by controller B. I have a total of 132 disks.
a> disk show
DISK OWNER POOL
------------ ------- -----
3c.00.9 b Pool0
3c.00.21 b Pool0
3c.00.7 b Pool0
3c.00.3 a Pool0
3c.00.5 a Pool0
3c.00.15 a Pool0
3c.00.19 b Pool0
3c.00.11 b Pool0
3c.00.1 a Pool0
3c.00.23 b Pool0
3c.00.13 a Pool0
3c.00.17 a Pool0
3c.00.0 a Pool0
3c.00.8 b Pool0
3c.00.2 a Pool0
3c.00.4 a Pool0
3c.00.22 b FAILED
3c.00.12 a Pool0
3c.00.14 a Pool0
3c.00.18 b Pool0
3c.00.20 b Pool0
3c.00.16 a Pool0
3c.00.10 b Pool0
0d.12.11 a Pool0
0d.12.0 a Pool0
3d.10.2 b Pool0
3d.11.7 b Pool0
3d.10.1 b Pool0
3d.10.8 b Pool0
3d.10.21 a Pool0
3d.10.14 a Pool0
3d.10.18 a Pool0
3d.10.4 b Pool0
3d.10.5 b Pool0
3d.11.2 b Pool0
3d.10.13 a Pool0
3d.11.4 b Pool0
3d.11.5 b Pool0
3d.11.8 b Pool0
3d.11.3 b Pool0
3d.10.17 a Pool0
3d.10.19 a Pool0
3d.10.7 b Pool0
3d.10.3 b Pool0
3d.10.12 a Pool0
3d.10.10 b Pool0
3d.11.9 b Pool0
3d.11.0 b Pool0
3d.10.6 b Pool0
3d.10.23 a Pool0
3d.11.11 b Pool0
3d.10.16 a Pool0
3d.10.15 a Pool0
3d.11.6 b Pool0
3d.11.1 b Pool0
3c.00.6 b Pool0
3d.10.20 a Pool0
3d.10.9 b Pool0
3d.10.22 a Pool0
3d.10.11 b Pool0
3d.11.10 b Pool0
0d.12.5 a Pool0
0d.12.12 a Pool0
0d.12.3 a Pool0
0d.12.2 a Pool0
0d.12.20 b Pool0
0d.12.10 a Pool0
0d.12.21 b Pool0
0d.12.23 b Pool0
0d.12.8 a Pool0
0d.12.17 a Pool0
0d.12.22 b Pool0
0d.12.9 a Pool0
0d.12.15 a Pool0
0d.12.4 a Pool0
0d.12.6 a Pool0
0d.12.7 a Pool0
0d.12.1 a Pool0
0d.12.14 a Pool0
0d.12.13 a Pool0
0d.12.19 b Pool0
0d.12.16 a Pool0
0d.12.18 b Pool0
0d.13.7 a Pool0
0d.13.18 b Pool0
0d.13.20 b Pool0
0d.13.13 b Pool0
0d.13.4 a Pool0
0d.13.17 b Pool0
0d.13.15 b Pool0
0d.13.9 a Pool0
0d.13.22 b Pool0
0d.13.0 a Pool0
0d.13.2 a Pool0
0d.13.11 a Pool0
0d.13.16 b Pool0
0d.13.12 b Pool0
0d.13.1 a Pool0
0d.13.23 b Pool0
0d.13.14 b Pool0
0d.13.19 b Pool0
0d.13.8 a Pool0
0d.13.5 a Pool0
0d.13.6 a Pool0
0d.13.10 a Pool0
0d.13.3 a Pool0
0d.13.21 b Pool0
0a.01.19 a Pool0
0a.01.18 a Pool0
0a.01.5 a Pool0
0a.01.22 a Pool0
0a.01.23 a Pool0
0a.01.20 a Pool0
0a.01.9 a Pool0
0a.01.16 a Pool0
0a.01.12 a Pool0
0a.01.17 a Pool0
3d.10.0 a Pool0
0a.01.3 a Pool0
0a.01.6 b Pool0
0a.01.10 b Pool0
0a.01.14 b Pool0
0a.01.11 b Pool0
0a.01.0 b Pool0
0a.01.8 b Pool0
0a.01.15 b Pool0
0a.01.1 b Pool0
0a.01.13 b Pool0
0a.01.2 b Pool0
0a.01.4 b Pool0
0a.01.7 b Pool0
0a.01.21 a Pool0
When I do an "aggr status -r aggr0" on each controller, I can see the usage of these disks in the aggregate and how they are broken up into different raid groups.
a> aggr status -r aggr0
Aggregate aggr0 (online, mixed_raid_type, hybrid) (block checksums)
Plex /aggr0/plex0 (online, normal, active)
RAID group /aggr0/plex0/rg0 (normal, block checksums, raid_dp)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 0d.12.0 0d 12 0 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
parity 0d.13.0 0d 13 0 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.12.1 0d 12 1 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.1 0d 13 1 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.2 0d 13 2 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.3 0d 13 3 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.4 0d 13 4 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.5 0d 13 5 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.6 0d 13 6 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.7 0d 13 7 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.8 0d 13 8 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.9 0d 13 9 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.10 0d 13 10 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.12.2 0d 12 2 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.12.3 0d 12 3 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.12.4 0d 12 4 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.12.5 0d 12 5 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.12.6 0d 12 6 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.12.7 0d 12 7 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.12.8 0d 12 8 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
RAID group /aggr0/plex0/rg1 (normal, block checksums, raid_dp)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 0d.12.9 0d 12 9 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
parity 0d.12.10 0d 12 10 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.12.12 0d 12 12 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.11 0d 13 11 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.12.14 0d 12 14 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.12.15 0d 12 15 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.12.16 0d 12 16 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.12.17 0d 12 17 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.12 3d 10 12 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.13 3d 10 13 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.14 3d 10 14 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.15 3d 10 15 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.16 3d 10 16 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.17 3d 10 17 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.18 3d 10 18 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.19 3d 10 19 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.20 3d 10 20 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.21 3d 10 21 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.22 3d 10 22 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.23 3d 10 23 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
RAID group /aggr0/plex0/rg2 (normal, block checksums, raid4)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
parity 3c.00.0 3c 0 0 SA:B 0 SSD N/A 762847/1562312192 763097/1562824368
data 3c.00.1 3c 0 1 SA:B 0 SSD N/A 762847/1562312192 763097/1562824368
data 3c.00.2 3c 0 2 SA:B 0 SSD N/A 762847/1562312192 763097/1562824368
data 3c.00.3 3c 0 3 SA:B 0 SSD N/A 762847/1562312192 763097/1562824368
data 3c.00.4 3c 0 4 SA:B 0 SSD N/A 762847/1562312192 763097/1562824368
b> aggr status -r aggr0
Aggregate aggr0 (online, mixed_raid_type, hybrid) (block checksums)
Plex /aggr0/plex0 (online, normal, active)
RAID group /aggr0/plex0/rg0 (normal, block checksums, raid_dp)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 3d.11.8 3d 11 8 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
parity 3d.11.10 3d 11 10 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.1 3d 10 1 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.12.18 0d 12 18 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.12.19 0d 12 19 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.12.20 0d 12 20 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.12.21 0d 12 21 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.12.22 0d 12 22 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.12 0d 13 12 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.13 0d 13 13 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.14 0d 13 14 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.15 0d 13 15 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.16 0d 13 16 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.17 0d 13 17 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.18 0d 13 18 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.19 0d 13 19 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.20 0d 13 20 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.21 0d 13 21 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.22 0d 13 22 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.2 3d 10 2 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
RAID group /aggr0/plex0/rg1 (normal, block checksums, raid4)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
parity 3c.00.6 3c 0 6 SA:A 0 SSD N/A 762847/1562312192 763097/1562824368
data 3c.00.7 3c 0 7 SA:A 0 SSD N/A 762847/1562312192 763097/1562824368
data 3c.00.8 3c 0 8 SA:A 0 SSD N/A 762847/1562312192 763097/1562824368
data 3c.00.9 3c 0 9 SA:A 0 SSD N/A 762847/1562312192 763097/1562824368
data 3c.00.10 3c 0 10 SA:A 0 SSD N/A 762847/1562312192 763097/1562824368
RAID group /aggr0/plex0/rg2 (normal, block checksums, raid_dp)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 3d.10.3 3d 10 3 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
parity 3d.10.4 3d 10 4 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.5 3d 10 5 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.6 3d 10 6 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.7 3d 10 7 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.8 3d 10 8 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.9 3d 10 9 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.10 3d 10 10 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.10.11 3d 10 11 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.11.1 3d 11 1 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.11.2 3d 11 2 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.11.3 3d 11 3 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.11.4 3d 11 4 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.11.5 3d 11 5 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.11.6 3d 11 6 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.11.7 3d 11 7 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.13.23 0d 13 23 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.11.9 3d 11 9 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 0d.12.23 0d 12 23 SA:A 0 FSAS 7200 3807816/7798408704 3815447/7814037168
data 3d.11.11 3d 11 11 SA:B 0 FSAS 7200 3807816/7798408704 3815447/7814037168
However, I still appear to have a bunch of drives which are part of the pool but don't come up as used in any of the RAID groups. If I total all the disks shown here, I come up with just 90 listed disks.
There are no unassigned disks.
How do I go about finding out why these disks are hidden and how can I allocate / use them?
The other question is I have one failed disk in 3c.00.22, however, it's not part of any of the disks listed in the aggregate. As the system is no longer under a support contract, I'm trying to ascertain the risk and how many disks I can afford to lose before data integrity becomes an issue. Critical data has been backed up, so it's not a disaster, just a risk assessment I'm trying to do. I guess it depends which combination of disks fail - more than two in a same RAID group and it goes down, but more drives can fail if spread across different RAID groups.
Any suggestions appreciated.