Integrating LVM with Hadoop and providing Elasticity to DataNode Storage

In Hadoop cluster how to give Dynamic storage to the cluster so you can increase and decrease the size of cluster? 

1.Creating LVM :

pvcreate <disk name>
vgcreate <Enter the vg name> <pv name> <pv name>
lvcreate --size <Size in GB OR MB> --name <ENter the lv name> <VG name>
hadoop-daemon.sh start namenode
hadoop-daemon.sh start datanode
hadoop dfsadmin -report

👉 Now Main part is we our data node is full then how we can increase the size of hard disk without affect the data👈

lvextend --size <Size> <path of LV>
resize2fs <path of LV>

Conclusion:

--

--

--

Technology Enthusiast

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Creating Candlestick Charts Using Python Plotly

Python 3.9- What’s New?

Contract extraction and migration: should you do it in-house or outsource to specialists?

Playing with XinaBox Part 3

鬼滅之刃劇場版 無限列車篇~線上看小鴨完整高清电影[HD-2020]~BLURAY

Tuning the Kafka Connect Cassandra Source (part 2)

All About Google’s One-Tap Sign In

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Mihir Patel

Mihir Patel

Technology Enthusiast

More from Medium

CS373 Spring 2022: Nathan Gates Week 14

Features of ready-made templates projects-dashboard and projects-timeline from DOIT-BI

Hofstra welcomes Eyewitness News ABC7 Long Island Bureau in new partnership

CS 373 Spring 2022: Nisha Ramesh