From the course: Hadoop for Data Science Tips, Tricks, & Techniques
Join today to access over 22,700 courses taught by industry experts or purchase this course individually.
Move files in HDFS - Hadoop Tutorial
From the course: Hadoop for Data Science Tips, Tricks, & Techniques
Move files in HDFS
- [Instructor] Sometimes when you set up your taxonomy, which is the way you organize your files in Hadoop, you realize later that you need to change that or evolve it a bit, maybe the needs have changed or you have new types of data and you need to adjust things a little bit. Well in order to do that you need to move files around so that's what we're going to take a look at here in this tip is how to move files around in HDFS. Now I have the exercise file open which has all of the commands we're going to run and on the right side here I have my terminal window which is where we're going to execute those commands. So I'm going to start by creating a new directory for our data which'll be called raw. Think of this as a staging area where I would land all the new files coming in before I then either shuffle them out to another place or did some processing on them. So I'll type hadoop fs -mkdir /raw. Then from there I want to create a couple new directories under there. Hadoop fs -mkdir…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.