Search code examples
centos7glusterfslvmxfs

Extend GlusterFS on top of LVM


I need to add more space to one of our gluster volumes. The volumes are replica 2 and sit on top of an LVM. The file system is XFS. The current size is 4TB and I want to resize to 6TB. The LVM has enough Free PEs on both replica servers.

  --- Physical volume ---
  PV Name               /dev/sdb
  VG Name               gluster
  PV Size               10,91 TiB / not usable 4,00 MiB
  Allocatable           yes
  PE Size               4,00 MiB
  Total PE              2861183
  Free PE               1633407
  Allocated PE          1227776
  PV UUID               F3CwNm-dceK-ezPY-7w12-OYT5-FLAH-U0a239

-

  --- Physical volume ---
  PV Name               /dev/sdb
  VG Name               gluster
  PV Size               10,91 TiB / not usable 4,00 MiB
  Allocatable           yes
  PE Size               4,00 MiB
  Total PE              2861183
  Free PE               1618047
  Allocated PE          1243136
  PV UUID               dWDEgF-0brq-9e6r-eqpO-jTeK-GJfb-c3MGbE

I've read somewhere, that it's enough to extend the LVM and to resize the FS on both hosts.

# lvextend -L +2T <lvm>
# xfs_growfs <lvm mountpoint>

I know that XFS has to be reseize while it's mounted. The LVM can also be resized during operations (although not recommended). And I've read somewhere that GlusterFS will automatically adapt to the new volume size as soon as both/all volumes have the new size.

Since the storage is used in an productive environment it's important to do this on the fly.

Has anyone any experience with this combination or can confirm that my approach is correct?

Thanks in advance.


Solution

  • To answer my own question:

    Eventually we had to increase Gluster storage without downtime.

    After extending the logical volume of all Gluster bricks to the same size and growing the xfs filesystem to the maximum size of the volume, the Gluster volume automatically adjusted the new size.

    I'm not sure if it's the recommended way, but it worked for us like a charm (both replica 2 and replica 3 volumes).