Integrating Hadoop with LVM and providing elasticity
✍ In this article I want to show how to use advantage of LVM for Hadoop
LVM(Logical Volume Manager)
💠 LVM is a very useful concept which helps to increase or decrease the storages on the fly . And today I want to implement and also use it for helping in big data (Hadoop) .
💠 While we are dealing with big data I mean Hadoop their may be a case where we want to increase the storage of a hard disk on the fly in that case it will be useful.
💠 Here first after checking the formation of cluster see the DFS remaining part carefully.
💠 Here I have attached two hard disks /dev/sdc and /dev/sdd with 4 and 6 GB respectively.
💠 And I have created two physical volumes (PV’s) with that two hard disks , u can take PV as like a format type.
💠 After that we have to create a volume group with these two PV’s and after creating a volume group.
💠 Create a logical volume in the volume group and mount it to the folder that u assigned for the data node in Hadoop.
💠 Now try to increase the storage without unmounting the storage and after increasing the storage we have to again format the added storage. After that we can also see the change in DFS used and DFS unused.
