Quick Links

Some archival material is stored in a separate page at disks-old.xml.

Disks

Keeping track of disk drives is almost as much as a headache as keeping track of systems. So here is a tally of disks, currently not up-to-date, but which will be added to as more info comes to hand.

Most disks are mounted on spencer, unless otherwise noted.

Top Level Allocations

New Lizard Structure

20181024, revised 20200514, 20210905, 20220523, 20230526

Some useful configuration information about setting up LizardFS can be found at https://docs.lizardfs.com/adminguide/basic_configuration.html

Disk Farm

Disks by Mount Point (spencer)

Disks by Device Name

This table relates to disks on the spencer disk farm only, and was generated by my script mkdiskch.sh at 20230526:164520

/dev/sdb LABEL="6013" UUID="1f7ae87f-170a-45d5-b535-a6daebaa2249" TYPE="ext4" on /mnt/6013 type ext4 (rw,relatime,data=ordered)
/dev/sdc LABEL="6014" UUID="7a3747fb-58bb-46c3-8d3d-fe50d3265790" TYPE="ext4" on /mnt/6014 type ext4 (rw,relatime,data=ordered)
/dev/sdd LABEL="6005" UUID="0070afdf-6bb5-4714-973b-8dadc8411cc2" TYPE="ext4" on /mnt/6005 type ext4 (rw,relatime,data=ordered)
/dev/sde LABEL="8001" UUID="37357dd6-562c-489c-9314-f68dc223bc87" TYPE="ext4" on /mnt/8001 type ext4 (rw,relatime,data=ordered)
/dev/sdf LABEL="12001" UUID="386fc600-4c9d-42a8-ac8e-50f84f09caca" TYPE="ext4" on /mnt/12001 type ext4 (rw,relatime,data=ordered)
/dev/sdg LABEL="8004" UUID="f10af0a6-8b2a-4a4b-92a2-1f91739318cf" TYPE="ext4" on /mnt/8004 type ext4 (rw,relatime,data=ordered)
/dev/sdh LABEL="8003" UUID="f774fc06-46e7-42c3-a4c7-844e92a1c97b" TYPE="ext4" on /mnt/8003 type ext4 (rw,relatime,data=ordered)
/dev/sdi LABEL="6006" UUID="125328d4-ccad-4b45-ad92-3c41c756c878" TYPE="ext4" on /mnt/6006 type ext4 (rw,relatime,data=ordered)
/dev/sdj LABEL="6009" UUID="fbad107d-e9a9-4915-bb44-a0a354c036f3" TYPE="ext4" on /mnt/6009 type ext4 (rw,relatime,data=ordered)
/dev/sdk LABEL="6010" UUID="f03b4315-feba-4bca-931b-a49f2d1390bf" TYPE="ext4" on /mnt/6010 type ext4 (rw,relatime,data=ordered)
/dev/sdl LABEL="6011" UUID="6fdce28b-36ff-4e29-9609-eccb5de33471" TYPE="ext4" on /mnt/6011 type ext4 (rw,relatime,data=ordered)
/dev/sdm LABEL="6003" UUID="a4546de6-206b-4124-ae03-ec19cb19390c" TYPE="ext4" on /mnt/6003 type ext4 (rw,relatime,data=ordered)
/dev/sdn LABEL="6004" UUID="6e0bc74a-f372-43da-b167-f1d8dca33adc" TYPE="ext4" on /mnt/6004 type ext4 (rw,relatime,data=ordered)
/dev/sdo LABEL="4004" UUID="5a033727-7016-4a77-936a-aed60a0200a6" TYPE="ext4" on /mnt/4004 type ext4 (rw,relatime,data=ordered)
/dev/sdp LABEL="4003" UUID="1e684134-1cf7-474b-ad2d-4ad699248ca5" TYPE="ext4" on /mnt/4003 type ext4 (rw,relatime,data=ordered)
/dev/sdq LABEL="8006" UUID="d41a39a0-c6a6-4eee-b932-ef7baad604cd" TYPE="ext4" on /mnt/8006 type ext4 (rw,relatime,data=ordered)

Other Current Disks

Other Obsolete Disks

Tips

Naming a Disk

To (re)name a disk using Ubuntu, use:

          e2label /dev/sdx name
        

Also a reminder to setup /etc/fstab to auto mount the disk if required.

Finding the serial number of a disk

If the disk is mounted then (substitute disk mount point for /dev/sd?):

          smartctl -a /dev/sd? | grep Serial
        

Cleaning up lizard

To remove corrupted firles, use the command:

          lizardfs-admin list-defective-files localhost 9421 --unavailable >~/unavails.txt
        

Procedure for replacing disks on lizard

This assumes that the lizard file system is running, that one (or more) disks are showing signs of needing replacement, and that new replacement disks are to hand.

1. mark the disk needing replacement
2. when the disk is showing few chnunks remaining, it should be removed from the appropriate mfshdd configuration file mfshddY.cfg. Then systemctl reload lizardfs-chunkserverX.service, where X is the appropriate mfschunkserverX.cfg file containing mfshddY.cfg
3. Once reloaded, the faulty disk can be unmounted and removed
4. Install the new disk, and mkfsext4 /dev/sdZ, where Z is the disk drive number
5. Create a new mount point for the new disk drive mkdir /mnt/MP (where MP is an appropriate name), and then mount the disk mount /dev/sdZ /mnt/MP
6. Create a lizard data directory on this disk, and make it owned by the lizardfs file system. mkdir /mnt/MP/LIZDAT (where LIZDAT) is an appropriate name), and then add this directory to the appropriate mfshdd and lizardfs-chunkserver configuration files.
7. Reload the lizardfs-chunkserverX.service. The new disk should now appear in the lizard disk list on the lizard info web page, and it should start collecting chunks, as lizard utilises the new-found space to rebalance its chunk load.
8. At this stage, you can give the new disk a name: e2label /dev/sdZ diskname
9. You should also add the disk to the /etc/fstab to ensure that it is mounted on reboots.

Restoring lizard version 3.12.0

From time to time, the system may get upgraded without flagging the lizard client as exempt from upgrade. This causes lizard mounting to break, and needs to be repaired by reverting to the old version of the lizard client that is compatible with the version running on spencer, viz., 3.12.0. Here are the steps:

1. apt remove lizardfs-client
2. apt remove lizardfs-client3
3. sudo apt update
4. sudo apt dist-upgrade
5. sudo apt install ca-certificates gnupg lsb-release
6. sudo mkdir -p /root/.gnupg
7. sudo chmod -R u+rwX,go= /root/.gnupg
8. sudo mkdir -p /usr/share/keyrings
9. sudo gpg --no-default-keyring --keyring /usr/share/keyrings/lizardfs-archive-keyring.gpg --keyserver hkps://keyserver.ubuntu.com --receive-keys 0x87026F04A1B61746
10. sudo chmod 644 /usr/share/keyrings/lizardfs-archive-keyring.gpg
11. echo "deb [signed-by=/usr/share/keyrings/lizardfs-archive-keyring.gpg] https://dev.lizardfs.com/packages focal/" | sudo tee /etc/apt/sources.list.d/lizardfs.list > /dev/null
12. sudo apt update
13. sudo apt install lizardfs-client=3.12.0
14. mfsmount -H spencer /lizard # this will take a long time to complete!

Document History

This page is copyright, and maintained by John Hurst.		18 accesses all since 05 Apr 2022
Local servers: Localhost Newport Burnley Jeparit Reuilly Spencer (accessible only on local network.) Public Web Servers: ajhurst.org ajh.co ajh.id.au (not all may be active.) Dynamically generated at 20231203:1923 from an XML file modified on 20230717:1757, by index.py version 1.6.3.