Easy-to-follow video tutorials help you learn software, creative, and business skills.Become a member

xargs: Usage examples

From: Unix for Mac OS X Users

Video: xargs: Usage examples

Now that we have seen how xargs works, I want you to help you to see the power that it gives by demonstrating some of its uses. There's no limits what you can do with xargs, but these example should give you an idea of how other people typically use it and get you thinking about ways to make it work for you. The first example I want to show you is how to use xargs with what I call File Manifest. Notice that I am inside my user directory and inside UNIX files and in there, there is a file called file_manifest.txt. It's just simply a list of file names of files that are in the same current directory. The idea here is that I have selected the files that I care about and have arranged them in a certain order.

xargs: Usage examples

Now that we have seen how xargs works, I want you to help you to see the power that it gives by demonstrating some of its uses. There's no limits what you can do with xargs, but these example should give you an idea of how other people typically use it and get you thinking about ways to make it work for you. The first example I want to show you is how to use xargs with what I call File Manifest. Notice that I am inside my user directory and inside UNIX files and in there, there is a file called file_manifest.txt. It's just simply a list of file names of files that are in the same current directory. The idea here is that I have selected the files that I care about and have arranged them in a certain order.

Now I can use xargs to do something with those. Now what you do with them is up to you. You can open them, you might grep them, you might print them, or you might just want to concatenate their contents together. They might represent file templates that we want to copy over whenever we start a new project. For now, I'm just going to use cat just to show you the contents of them and then pipe it through less, so that we just don't get a huge stream of output. So there you go, you can see that that's exactly what it did. It took each of these files and put them together in the order I specified. Imagine that you had 20 different files that all belonged to one project and you wanted to assemble those together in a certain order for presentation or something.

You could use this file manifest technique to be able to manage them. It's not just file names that we put in a file that we can use. We could for example use our fruit file, fruit.txt. That's just going to be a simple list of fruit. Let's take that and let's pipe it through sort and unique. So we have the unique list of fruit. And then we will send that to xargs. And in xargs, we will use our placeholder specifier, make a directory, including the parent directories, and we will put it on our desktop, a folder called fruits and in that we will put a folder for each of these fruits.

There it is, we have fruits now that appeared on our desktop. I am going to open that folder up. I have got a folder for each one of my fruits. Imagine that we have got a class of 30 students and we need to create a folder to put each student's work in for all 30 students. We take the list of their first names and last names, pass it to xargs and boom, we have created 30 folders with just one single command. You can see how it can really speed up repetitive tasks that we normally would do in the Finder. Let me give you another example. Let's say that we have our process list and we want to pipe that through grep and we are going to look for some process, some set of processes that have gone bad somehow, we need to get rid of. There are bad processes we'll call them and if I just hit Return on that, you will see that it comes up and if finds the grep that I am doing for. bad process.

That's the only process that matches. So this is just a demo, and what we will do is we will pass that in to cut and we will grab, 11-15, which will represent this process ID here, and then we will take all of those process IDs that it finds, pass them in to xargs with kill -9. Boom, we just killed all of our bad processes. Now it came up and told me there were no such processes and that's because this process that if did find, grep bad processes, is gone by the time it gets over here to kill it. It started and it stopped before kill could ever get a hold of it.

But you see the concept and it shows you how you can use xargs in some unusual places. In general xargs works really well with grep. So for example, we had grep for apple inside all the files called fruit.txt and it gives us back all of those matches. Remember we used the -l option in front of it, dash lowercase L. Now it gives us just the file names themselves. So now these files are ready to be passed into xargs. We have found everything that had a match. Now we can do whatever we want with those files that have a match. We can take them and we can pipe them into xarg's word count.

We can find out the word counts of those. Or we can concatenate them altogether. It also works really well with find. So for example, we could find everything that's in my test directory and everything that's typed as a standard file, and pass that to xargs and change the permissions on that to be 755. Now remember, I told you that sometimes we need to use this -0 as an option to xargs. Well, dind is one of the places where we really want to use it and find even has a special option of its own called print0.

So print0 will make sure that the null character is used to separate them and then the -0 on xargs will make sure the xargs uses that null character. So it's a way for the two of them to communicate effectively. We can go ahead and hit Return on that. Let's try another example. Let's do find and we will look everything in the current directory whose name matches fruit. We will do that one again and we are going to use print zero, pipe it through xargs with -0, and then let's use our placeholder specifier and what we are going to do is copy each one of those arguments to Desktop and we are going to use that placeholder again, but also append.backup to the end.

So I hit Return and guess what? It went and found each one of those files that had a match, send it to xargs, and then copied it as a backup file to my desktop. Now, let's say that we want to remove all of those backup files. So we have Find and Desktop. Everything on the Desktop whose name has backup at the end and we will do the print0. Pipe it through xargs with -0 and then we can use rm. Now you might think well, let's use rm-i for interactive.

Actually xargs doesn't allow you to do interactive. If you want xargs to be interactive, you have to use the -p option for prompt. And this will work for any kind of Xarg's thing and basically it will prompt you before it actually does it. It gives you a chance to say yes or no. There is one other thing that I want to caution you about here, which is that when we are doing a find, especially if you are doing a find that is going to then do copy or remove or anything like that, it's a good idea to make sure that you are not searching too deeply in the folders. If I really just want to get rid of these things that are on my Desktop, then I need to specify the depth is going to be equal to one.

Just look in the current immediate folder, don't go any deeper, or if I want it to allow to go two folders deep, then you could specify depth 2. You want to make sure that you don't accidentally grep more files than you intend to. All right, let's hit Return on this. You will see xargs give you a prompt saying hey, do you want to remove all these files? First I'll start with saying n and then Return, so that's no. I am just going to make a change to it now. I am going to say -n1 as an option. So it will take each one of these as a separate argument. Now, it comes up and says, ah, do you want to remove this one? Y, boom, it's gone.

Y. We get a chance to approve each one of them before they disappear. The -n option makes sure that they are sent in, each one as its own argument. And I have shown you that xargs works well with grep and it works well with find and it works really well if we use both. Let me just paste in a fake example here. Imagine that I am finding everything in the current directory whose filename has invoice anywhere in it. Pass that to xargs and then tell grep, hey, look inside that subset of files and see if you find the word programming and tell me what those files names are. Of course, it is fake example. I don't have any files called invoice.

Imagine that we are a web developer and we are looking for all files in our website that have .html at the end, pass those off, and grep those to find a certain tag that we are looking for, like h3. Now again, this is just a demo example, but you get the idea. Now not only would I be able to use find and then pass it to xargs and grep it but what I am getting back is a list of file names because I used that -l option. So guess what? I can use xargs again on the file names that it returns from that. Let me show you a real example. Here is one where we say all right, find everything whose file has fruit.txt, grep it for mango inside the file and then pass that to xargs a second time, and this time we are going to copy it to our desktop. So there we go.

Boom, it searched for the file name, looked for the right file content, and then copied the file to our desktop. These examples are just a small sample of what you can do with xargs. I want you to think of using xargs, whenever you want to perform a command on many items in the list. That list can be recorded in a file, as we saw with the file manifest, or it can be dynamically generated by another command, as we did with grep and find. And if you learn to use xargs effectively, it will really speed up your workflow.

Show transcript

This video is part of

Image for Unix for Mac OS X Users
Unix for Mac OS X Users

82 video lessons · 26221 viewers

Kevin Skoglund
Author

 
Expand all | Collapse all
  1. 3m 57s
    1. Introduction
      1m 14s
    2. Using the exercise files
      2m 43s
  2. 32m 2s
    1. What is Unix?
      7m 27s
    2. The terminal application
      4m 23s
    3. Logging in and using the command prompt
      5m 19s
    4. Command structure
      5m 22s
    5. Kernel and shells
      5m 25s
    6. Unix manual pages
      4m 6s
  3. 15m 58s
    1. The working directory
      2m 49s
    2. Listing files and directories
      3m 59s
    3. Moving around the filesystem
      4m 58s
    4. Filesystem organization
      4m 12s
  4. 1h 4m
    1. Naming files
      5m 41s
    2. Creating files
      2m 19s
    3. Unix text editors
      6m 39s
    4. Reading files
      5m 35s
    5. Reading portions of files
      3m 27s
    6. Creating directories
      2m 40s
    7. Moving and renaming files and directories
      8m 32s
    8. Copying files and directories
      3m 7s
    9. Deleting files and directories
      3m 38s
    10. Finder aliases in Unix
      4m 10s
    11. Hard links
      5m 30s
    12. Symbolic links
      6m 36s
    13. Searching for files and directories
      6m 32s
  5. 34m 58s
    1. Who am I?
      4m 3s
    2. Unix groups
      1m 52s
    3. File and directory ownership
      6m 41s
    4. File and directory permissions
      4m 27s
    5. Setting permissions using alpha notation
      6m 49s
    6. Setting permissions using octal notation
      3m 49s
    7. The root user
      1m 57s
    8. sudo and sudoers
      5m 20s
  6. 52m 34s
    1. Command basics
      4m 4s
    2. The PATH variable
      4m 13s
    3. System information commands
      3m 40s
    4. Disk information commands
      6m 8s
    5. Viewing processes
      5m 0s
    6. Monitoring processes
      3m 36s
    7. Stopping processes
      3m 19s
    8. Text file helpers
      6m 50s
    9. Utility programs
      7m 28s
    10. Using the command history
      8m 16s
  7. 20m 39s
    1. Standard input and standard output
      1m 24s
    2. Directing output to a file
      4m 13s
    3. Appending to a file
      2m 44s
    4. Directing input from a file
      5m 28s
    5. Piping output to input
      4m 40s
    6. Suppressing output
      2m 10s
  8. 41m 28s
    1. Profile, login, and resource files
      9m 11s
    2. Setting command aliases
      6m 59s
    3. Setting and exporting environment variables
      4m 54s
    4. Setting the PATH variable
      6m 10s
    5. Configuring history with variables
      6m 17s
    6. Customizing the command prompt
      6m 5s
    7. Logout file
      1m 52s
  9. 1h 25m
    1. grep: Searching for matching expressions
      5m 21s
    2. grep: Multiple files, other input
      4m 28s
    3. grep: Coloring matched text
      2m 57s
    4. Introduction to regular expressions
      3m 22s
    5. Regular expressions: Basic syntax
      3m 19s
    6. Using regular expressions with grep
      5m 20s
    7. tr: Translating characters
      8m 17s
    8. tr: Deleting and squeezing characters
      5m 30s
    9. sed: Stream editor
      7m 45s
    10. sed: Regular expressions and back-references
      7m 8s
    11. cut: Cutting select text portions
      7m 42s
    12. diff: Comparing files
      4m 35s
    13. diff: Alternative formats
      4m 30s
    14. xargs: Passing argument lists to commands
      7m 25s
    15. xargs: Usage examples
      7m 59s
  10. 42m 25s
    1. Finder integration
      4m 45s
    2. Clipboard integration
      5m 5s
    3. Screen capture
      3m 42s
    4. Shut down, reboot, and sleep
      3m 34s
    5. Text to speech
      2m 36s
    6. Spotlight integration: Searching metadata
      3m 41s
    7. Spotlight integration: Metadata attributes
      4m 24s
    8. Using AppleScript
      5m 23s
    9. System configurations: Viewing and setting
      5m 51s
    10. System configurations: Examples
      3m 24s
  11. 1m 26s
    1. Conclusion
      1m 26s

Start learning today

Get unlimited access to all courses for just $25/month.

Become a member
Sometimes @lynda teaches me how to use a program and sometimes Lynda.com changes my life forever. @JosefShutter
@lynda lynda.com is an absolute life saver when it comes to learning todays software. Definitely recommend it! #higherlearning @Michael_Caraway
@lynda The best thing online! Your database of courses is great! To the mark and very helpful. Thanks! @ru22more
Got to create something yesterday I never thought I could do. #thanks @lynda @Ngventurella
I really do love @lynda as a learning platform. Never stop learning and developing, it’s probably our greatest gift as a species! @soundslikedavid
@lynda just subscribed to lynda.com all I can say its brilliant join now trust me @ButchSamurai
@lynda is an awesome resource. The membership is priceless if you take advantage of it. @diabetic_techie
One of the best decision I made this year. Buy a 1yr subscription to @lynda @cybercaptive
guys lynda.com (@lynda) is the best. So far I’ve learned Java, principles of OO programming, and now learning about MS project @lucasmitchell
Signed back up to @lynda dot com. I’ve missed it!! Proper geeking out right now! #timetolearn #geek @JayGodbold
Share a link to this course

What are exercise files?

Exercise files are the same files the author uses in the course. Save time by downloading the author's files instead of setting up your own files, and learn by following along with the instructor.

Can I take this course without the exercise files?

Yes! If you decide you would like the exercise files later, you can upgrade to a premium account any time.

Become a member Download sample files See plans and pricing

Please wait... please wait ...
Upgrade to get access to exercise files.

Exercise files video

How to use exercise files.

Learn by watching, listening, and doing, Exercise files are the same files the author uses in the course, so you can download them and follow along Premium memberships include access to all exercise files in the library.


Exercise files

Exercise files video

How to use exercise files.

For additional information on downloading and using exercise files, watch our instructional video or read the instructions in the FAQ.

This course includes free exercise files, so you can practice while you watch the course. To access all the exercise files in our library, become a Premium Member.

Join now "Already a member? Log in

Are you sure you want to mark all the videos in this course as unwatched?

This will not affect your course history, your reports, or your certificates of completion for this course.


Mark all as unwatched Cancel

Congratulations

You have completed Unix for Mac OS X Users.

Return to your organization's learning portal to continue training, or close this page.


OK
Become a member to add this course to a playlist

Join today and get unlimited access to the entire library of video courses—and create as many playlists as you like.

Get started

Already a member?

Become a member to like this course.

Join today and get unlimited access to the entire library of video courses.

Get started

Already a member?

Exercise files

Learn by watching, listening, and doing! Exercise files are the same files the author uses in the course, so you can download them and follow along. Exercise files are available with all Premium memberships. Learn more

Get started

Already a Premium member?

Exercise files video

How to use exercise files.

Ask a question

Thanks for contacting us.
You’ll hear from our Customer Service team within 24 hours.

Please enter the text shown below:

The classic layout automatically defaults to the latest Flash Player.

To choose a different player, hold the cursor over your name at the top right of any lynda.com page and choose Site preferencesfrom the dropdown menu.

Continue to classic layout Stay on new layout
Exercise files

Access exercise files from a button right under the course name.

Mark videos as unwatched

Remove icons showing you already watched videos if you want to start over.

Control your viewing experience

Make the video wide, narrow, full-screen, or pop the player out of the page into its own window.

Interactive transcripts

Click on text in the transcript to jump to that spot in the video. As the video plays, the relevant spot in the transcript will be highlighted.

Are you sure you want to delete this note?

No

Your file was successfully uploaded.

Thanks for signing up.

We’ll send you a confirmation email shortly.


Sign up and receive emails about lynda.com and our online training library:

Here’s our privacy policy with more details about how we handle your information.

Keep up with news, tips, and latest courses with emails from lynda.com.

Sign up and receive emails about lynda.com and our online training library:

Here’s our privacy policy with more details about how we handle your information.

   
submit Lightbox submit clicked
Terms and conditions of use

We've updated our terms and conditions (now called terms of service).Go
Review and accept our updated terms of service.