Quick Links

Some archival material is stored in a separate page at disks-old.xml.

Disks

Keeping track of disk drives is almost as much as a headache as keeping track of systems. So here is a tally of disks, currently not up-to-date, but which will be added to as more info comes to hand.

Most disks are mounted on spencer, unless otherwise noted.

Spencer Disk Farm

Geelong Disk Farm

Top Level Allocations

Seaweed File System

20240211:105718 first installation

New Lizard Structure

20181024, revised 20200514, 20210905, 20220523, 20230526, 20240723 (not confirmed)

Some useful configuration information about setting up LizardFS can be found at https://docs.lizardfs.com/adminguide/basic_configuration.html

Geelong Weed System

The Geelong Weed system is a multi-disk redundant storage system under development. We are using a new 20-bay hot-swap disk farm (named geelong) to support this project.

This is part of the hardware we are to use: HBA 12Gbs x 16 ports

Disks by Mount Point (spencer)

BUT see also next section!

Disks by Device Name (Spencer)

This table relates to disks on the spencer disk farm only, and was generated by my script mkdiskch.sh at 20240723:135157

/dev/sda LABEL="6013" UUID="1f7ae87f-170a-45d5-b535-a6daebaa2249" TYPE="ext4" on /mnt/6013 type ext4 (rw,relatime,data=ordered)
/dev/sdb LABEL="18006" UUID="07158ed2-c877-4ef8-b8c5-5d722e9506c0" TYPE="ext4" on /mnt/18006 type ext4 (rw,relatime,data=ordered)
/dev/sdc LABEL="8006" UUID="d41a39a0-c6a6-4eee-b932-ef7baad604cd" TYPE="ext4" on /mnt/8006 type ext4 (rw,relatime,data=ordered)
/dev/sdd LABEL="6004" UUID="6e0bc74a-f372-43da-b167-f1d8dca33adc" TYPE="ext4" on /mnt/6004 type ext4 (rw,relatime,data=ordered)
/dev/sdg LABEL="6011" UUID="6fdce28b-36ff-4e29-9609-eccb5de33471" TYPE="ext4" on /mnt/6011 type ext4 (rw,relatime,data=ordered)
/dev/sdh LABEL="6014" UUID="7a3747fb-58bb-46c3-8d3d-fe50d3265790" TYPE="ext4" on /mnt/6014 type ext4 (rw,relatime,data=ordered)
/dev/sdi LABEL="6006" UUID="125328d4-ccad-4b45-ad92-3c41c756c878" TYPE="ext4" on /mnt/6006 type ext4 (rw,relatime,data=ordered)
/dev/sdj LABEL="6009" UUID="fbad107d-e9a9-4915-bb44-a0a354c036f3" TYPE="ext4" on /mnt/6009 type ext4 (rw,relatime,data=ordered)
/dev/sdl LABEL="6005" UUID="0070afdf-6bb5-4714-973b-8dadc8411cc2" TYPE="ext4" on /mnt/6005 type ext4 (rw,relatime,data=ordered)
/dev/sdo LABEL="12001" UUID="386fc600-4c9d-42a8-ac8e-50f84f09caca" TYPE="ext4" on /mnt/12001 type ext4 (rw,relatime,data=ordered)
/dev/sdp LABEL="8001" UUID="0e938631-dd26-447c-b095-4cd66f708c76" TYPE="ext4" on /mnt/8001 type ext4 (rw,relatime,data=ordered)
      

Disks by Device Name (Geelong)

/dev/sda LABEL="18001" UUID="72819300-3e8f-4e4c-a914-330853463f96" BLOCK_SIZE="4096" TYPE="ext4" on /mnt/18001 type ext4 (rw,relatime)
/dev/sdb LABEL="18002" UUID="63ff0204-3228-4757-a051-7ca6fb4b3742" BLOCK_SIZE="4096" TYPE="ext4" on /mnt/18002 type ext4 (rw,relatime)
/dev/sdc LABEL="18003" UUID="b04e917a-dc15-4975-aa82-c3c71aad8861" BLOCK_SIZE="4096" TYPE="ext4" on /mnt/18003 type ext4 (rw,relatime)
/dev/sdd LABEL="18004" UUID="e076b613-e748-46ae-89dc-9afb9ea9fe7b" BLOCK_SIZE="4096" TYPE="ext4" on /mnt/18004 type ext4 (rw,relatime)
      

Other Current Disks

Other Obsolete Disks

Tips

Naming a Disk

To (re)name a disk using Ubuntu, use:

          e2label /dev/sdx name
        

Also a reminder to setup /etc/fstab to auto mount the disk if required.

Finding the serial number of a disk

If the disk is mounted then (substitute disk mount point for /dev/sd?):

          smartctl -a /dev/sd? | grep Serial
        

Alternatively, try this:

          lsblk -n -o SERIAL /dev/sd?
        

Lizard Fixes

Dirty Disks

If you get the message temporary metadata file exists, metadata directory is in dirty state on starting the lizardfs master service, then chances are there is a metadata file that needs removing:

          # rm /var/lib/lizardfs/metadata.mfs.tmp
        

Cleaning up lizard

To remove corrupted files, use the command:

          lizardfs-admin list-defective-files localhost 9421 --unavailable >~/unavails.txt
        

          for f in `cat ~/unavails.txt` ; do rm $f ; echo $f ; done
        

Procedure for replacing disks on lizard

This assumes that the lizard file system is running, that one (or more) disks are showing signs of needing replacement, and that new replacement disks are to hand.

1. mark the disk needing replacement
2. when the disk is showing few chunks remaining, it should be removed from the appropriate mfshdd configuration file mfshddY.cfg. Then systemctl reload lizardfs-chunkserverX.service, where X is the appropriate mfschunkserverX.cfg file containing mfshddY.cfg
3. Once reloaded, the faulty disk can be unmounted and removed
4. Install the new disk, and mkfsext4 /dev/sdZ, where Z is the disk drive number
5. Create a new mount point for the new disk drive mkdir /mnt/MP (where MP is an appropriate name), and then mount the disk mount /dev/sdZ /mnt/MP
6. Create a lizard data directory on this disk, and make it owned by the lizardfs file system. mkdir /mnt/MP/LIZDAT (where LIZDAT) is an appropriate name), and then add this directory to the appropriate mfshdd and lizardfs-chunkserver configuration files.
7. Reload the lizardfs-chunkserverX.service. The new disk should now appear in the lizard disk list on the lizard info web page, and it should start collecting chunks, as lizard utilises the new-found space to rebalance its chunk load.
8. At this stage, you can give the new disk a name: e2label /dev/sdZ diskname
9. You should also add the disk to /etc/fstab to ensure that it is mounted on reboots.

Restoring lizard version 3.12.0

From time to time, the system may get upgraded without flagging the lizard client as exempt from upgrade. This causes lizard mounting to break, and needs to be repaired by reverting to the old version of the lizard client that is compatible with the version running on spencer, viz., 3.12.0. Here are the steps:

1. apt remove lizardfs-client
2. apt remove lizardfs-client3
3. sudo apt update
4. sudo apt dist-upgrade
5. sudo apt install ca-certificates gnupg lsb-release
6. sudo mkdir -p /root/.gnupg
7. sudo chmod -R u+rwX,go= /root/.gnupg
8. sudo mkdir -p /usr/share/keyrings
9. sudo gpg --no-default-keyring --keyring /usr/share/keyrings/lizardfs-archive-keyring.gpg --keyserver hkps://keyserver.ubuntu.com --receive-keys 0x87026F04A1B61746
10. sudo chmod 644 /usr/share/keyrings/lizardfs-archive-keyring.gpg
11. echo "deb [signed-by=/usr/share/keyrings/lizardfs-archive-keyring.gpg] https://dev.lizardfs.com/packages focal/" | sudo tee /etc/apt/sources.list.d/lizardfs.list > /dev/null
12. sudo apt update
13. sudo apt install lizardfs-client=3.12.0
14. mfsmount -H spencer /lizard # this will take a long time to complete!

Decommissioned Disks

Disk Economy Metrics

Document History

This page is copyright, and maintained by John Hurst.		74 accesses all since 05 Apr 2022
Local servers: Localhost Newport Burnley Geelong Jeparit Reuilly Spencer (accessible only on local network.) Public Web Servers: ajhurst.org ajh.co ajh.id.au (not all may be active.) Dynamically generated at 20240908:0422 from an XML file modified on 20240905:0918, by index.py version 1.6.7.