From the course: Hadoop for Data Science Tips, Tricks, & Techniques

Unlock the full course today

Join today to access over 22,700 courses taught by industry experts or purchase this course individually.

Organize files in HDFS

Organize files in HDFS - Hadoop Tutorial

From the course: Hadoop for Data Science Tips, Tricks, & Techniques

Start my 1-month free trial

Organize files in HDFS

“

- [Instructor] The first thing I want to cover is organizing files in HDFS and I know that when I first started working with Hadoop this really threw me for a couple loops that I couldn't really get past so I wanted to start off just by showing you some tips that I've learned over the years on how to work with these directories and work with the data in HDFS. I have here open the first script file from our exercise files that we downloaded and I'm going to open up a terminal window where we'll do most of our work. First I want to create a new folder for these exercise files and then I'm going to copy them over. So I'll type mkdir, or make directory, hadoop_for_ds. Now if I take a look I can see that that directory is there in my user's home directory and I'm just going to copy the stuff over from the exercise files into this so I no longer need to worry about accessing them remotely. So I'll do copy, just cp -rf, so recursive enforce, and the exercise files that I linked to in my…

Contents