Easy-to-follow video tutorials help you learn software, creative, and business skills.Become a member

tr: Translating characters

From: Unix for Mac OS X Users

Video: tr: Translating characters

In this movie, we're going to take a look at another simple but powerful Unix tool called TR. TR is short for Translate and what it does is it copies from the input it receives to output, but with the substitution of selected characters, according to translation rules that we give it. So at its simplest we would have echo a, b, c, and we'll pipe that in to tr, and the first argument of tr is going to be the thing we want to search for. Our search string. So we're going to search for all of the commas, and the second argument will be the replacement string.

tr: Translating characters

In this movie, we're going to take a look at another simple but powerful Unix tool called TR. TR is short for Translate and what it does is it copies from the input it receives to output, but with the substitution of selected characters, according to translation rules that we give it. So at its simplest we would have echo a, b, c, and we'll pipe that in to tr, and the first argument of tr is going to be the thing we want to search for. Our search string. So we're going to search for all of the commas, and the second argument will be the replacement string.

So we'll replace it all with dashes. So as you might guess, it takes all the commas and it translates them into being dashes. Now this is a totally valid use. But translating one character to one character doesn't really reveal how TR works. So let's try another better example. Let's say we have echo and for this string let's use the numbers 1 to 6, so you can just peck away through your keyboard, just pick a random set of numbers, but not going any higher than 6. And then we're going to pipe that into tr, and this time we're going to say that our search string is the numbers in sequence 1 to 6.

1, 2, 3, 4, 5, 6, and the replacement string that we'll use for that, I am going to use the letters E, B, G, D, A, E. Those map to the tunings on a six string guitar. When we hit Return, now notice what it did. It took all of the 1s and it turned them into Es and it took all of the 2s and it turned them into Bs and all the 3s became Gs and so on. Everything that it found in the search string, not only did it find it, but then it said "Oh, what position are you in the search string? Let me map that to the replacement string and find the item that's in the same position there." It's a mapping, right? So the number 6 gets mapped to E, number 4 gets mapped to D, right? Do you see how that works? Notice also that if we had another number, let's put in a 9 or any other character really, it wouldn't get matched, right? It doesn't get translated, because it's not in our translation string.

Therefore it gets left alone. It's only those selected characters and those selected characters get translated based on their position in the search string and in the replacement string, so position does matter. This translation is a lot like the code breaking that you might have done as a kid. In order to find out a secret message, you'd have to swap all the As for another letter and all the Bs for another letter. When you were finally done, you would have decoded the message by doing this simple alphabetic translation. We can actually do this with TR. A simple version would be to encode a string using something called ROT-13.

ROT-13 is just rotating all the characters 13 places. So the A becomes N, B becomes O, C becomes P, and so on. Let's try it. echo 'This is ROT-13 encrypted.' A single quote and we'll pipe that into tr and now for tr's search string, we're actually going to use character sets. We could write out A, B, C, D, and all that, but we can shorthand that with A-Z, all the letters A to Z in that order, followed by the lowercase letters, a-z in that order, because it is case-sensitive.

Then in the replacement string, what we want to do is rotate all of those 13 positions. So N-Z would be take care of letters A through M, and then A-M capital M would be the second half of that. Same thing for the lowercase letters. n-z, a-m, and we translate it. Now what we get is something that is ROT -13 encoded. And we can just take that and we can decode it by just rotating it 13 places again. Since there are 26 letters in the alphabet we can do that, and now we can decode the message just as well.

So that's probably the simplest kind of encoding and encryption there is. It is just that simple rotation cipher. But hopefully now you start to see the idea of how translate does its thing. Just to make it really clear, let me show you what it's not for. If we have for example something like already daytime and we want to swap out tr 'day' for 'night', it doesn't replace the word day with the word night. That's not what it's doing. What it's doing is it translates the d into n and the a into I and the y into g, right? Do you see that? So already also got affected by that.

We're translating each of those characters that we find, not doing a Find & Replace like you might do with the word processor. Now we don't have to provide a simple one-to-one replacement. For example, let me just paste in an example here. I have a long string and then have as my search string bedf and then the numbers 5 through 9 in that order. I'm replacing them all with x, just by itself. See what it did? It found those specific items and replaced them all with x. To see what it's actually doing, a good way to do that is just let's put another character there. Let's say z. Now notice that the b got replaced with the x, but everything else got replaced by the z. That's because it's repeating the z.

It's the same thing as if I've done something like that, right. Whatever the last item is, it just gets repeated multiple times until we have enough characters to match our search string. So if the replacement set is smaller, then the last item repeats. If the replacement set were bigger than the search set, well then those items will just never get reached. There would be nothing that ever would map to those remaining characters. So now that you understand what it is and how it works, what are some real-world use cases where you would use this? Well, one example might be, if you remember we have a file here called people.txt.

I am in unix_files folder already. It just has names of people. Well, what if I wanted to make all of those lowercase? We could do that. Let's say tr and we'll do capital A-Z should be translated into a-z and we would not say people.txt, right? There are only two arguments allowed. Let's try that. You'll see that it comes up and says no, I only want two arguments. Redirecting our input from the file, and remember how we did that. So we're now taking the contents of the file and passing those in as input to tr and then it gives us the output.

It now made those all lowercase. You also can use those same regular expression classes that we just saw in the regular expression movie. upper and then here would be lower, right? Does the exact same thing. So we can use upper and lower because those are well ordered sets. Using some of those other classes like punctuation, they would work but the order might not be obvious to you, what order those characters come in.

Another example where it might be useful is let's imagine that we have something that's in a foreign language, right, and has lots of accented characters in it. We need to get all those accents out of there. For whatever reason, we aren't going to be able to print those accents so we need to just take all of the accented Es and turn them into regular Es. That will do it for us. It will strip them out and turn them into its equivalent. Another really useful case is let's imagine we have a file. I have a file here, a new file I've added. It's us_presidents.csv. CSV is for Comma Separated Values. If we take a look at the head of that file, us_presidents, you'll see that I've got values here that are separated by commas. so George Washington, 1789, and so on.

That's comma-separated Values. It might actually be a little easier to understand the data by looking at it in a table format. So I've essentially got the number of the President, their name, the year they started, and finished their term, their party, their state, and then where their Wikipedia entry is. So that's what I've got. I've just got all these values not in a table, but separated by comments, right, and then I could import them into things and that kind of thing. Well, in addition to comma-separated values, a very common format is to have tab- separated values, and you put tabs in between each of them. So using tr, that's a cinch, right? We just say tr, take all of the commas and let's replace those with tabs.

Tabs, the special character is this /t, and so we'll pipe in our us_presidents.csv and you can see the difference. Now you see those tabs and we can just take that same thing and let's output it now to us_presidents, and we'll do TSV for tab-separated values. So there we go. Now I have my comma-separated values and I have a tab-separated version with just one simple command. So it's the basics if I had to work with tr. There are a couple of options to give you some nice features. So let's look at those in the next movie.

Show transcript

This video is part of

Image for Unix for Mac OS X Users
Unix for Mac OS X Users

82 video lessons · 27866 viewers

Kevin Skoglund
Author

 
Expand all | Collapse all
  1. 3m 57s
    1. Introduction
      1m 14s
    2. Using the exercise files
      2m 43s
  2. 32m 2s
    1. What is Unix?
      7m 27s
    2. The terminal application
      4m 23s
    3. Logging in and using the command prompt
      5m 19s
    4. Command structure
      5m 22s
    5. Kernel and shells
      5m 25s
    6. Unix manual pages
      4m 6s
  3. 15m 58s
    1. The working directory
      2m 49s
    2. Listing files and directories
      3m 59s
    3. Moving around the filesystem
      4m 58s
    4. Filesystem organization
      4m 12s
  4. 1h 4m
    1. Naming files
      5m 41s
    2. Creating files
      2m 19s
    3. Unix text editors
      6m 39s
    4. Reading files
      5m 35s
    5. Reading portions of files
      3m 27s
    6. Creating directories
      2m 40s
    7. Moving and renaming files and directories
      8m 32s
    8. Copying files and directories
      3m 7s
    9. Deleting files and directories
      3m 38s
    10. Finder aliases in Unix
      4m 10s
    11. Hard links
      5m 30s
    12. Symbolic links
      6m 36s
    13. Searching for files and directories
      6m 32s
  5. 34m 58s
    1. Who am I?
      4m 3s
    2. Unix groups
      1m 52s
    3. File and directory ownership
      6m 41s
    4. File and directory permissions
      4m 27s
    5. Setting permissions using alpha notation
      6m 49s
    6. Setting permissions using octal notation
      3m 49s
    7. The root user
      1m 57s
    8. sudo and sudoers
      5m 20s
  6. 52m 34s
    1. Command basics
      4m 4s
    2. The PATH variable
      4m 13s
    3. System information commands
      3m 40s
    4. Disk information commands
      6m 8s
    5. Viewing processes
      5m 0s
    6. Monitoring processes
      3m 36s
    7. Stopping processes
      3m 19s
    8. Text file helpers
      6m 50s
    9. Utility programs
      7m 28s
    10. Using the command history
      8m 16s
  7. 20m 39s
    1. Standard input and standard output
      1m 24s
    2. Directing output to a file
      4m 13s
    3. Appending to a file
      2m 44s
    4. Directing input from a file
      5m 28s
    5. Piping output to input
      4m 40s
    6. Suppressing output
      2m 10s
  8. 41m 28s
    1. Profile, login, and resource files
      9m 11s
    2. Setting command aliases
      6m 59s
    3. Setting and exporting environment variables
      4m 54s
    4. Setting the PATH variable
      6m 10s
    5. Configuring history with variables
      6m 17s
    6. Customizing the command prompt
      6m 5s
    7. Logout file
      1m 52s
  9. 1h 25m
    1. grep: Searching for matching expressions
      5m 21s
    2. grep: Multiple files, other input
      4m 28s
    3. grep: Coloring matched text
      2m 57s
    4. Introduction to regular expressions
      3m 22s
    5. Regular expressions: Basic syntax
      3m 19s
    6. Using regular expressions with grep
      5m 20s
    7. tr: Translating characters
      8m 17s
    8. tr: Deleting and squeezing characters
      5m 30s
    9. sed: Stream editor
      7m 45s
    10. sed: Regular expressions and back-references
      7m 8s
    11. cut: Cutting select text portions
      7m 42s
    12. diff: Comparing files
      4m 35s
    13. diff: Alternative formats
      4m 30s
    14. xargs: Passing argument lists to commands
      7m 25s
    15. xargs: Usage examples
      7m 59s
  10. 42m 25s
    1. Finder integration
      4m 45s
    2. Clipboard integration
      5m 5s
    3. Screen capture
      3m 42s
    4. Shut down, reboot, and sleep
      3m 34s
    5. Text to speech
      2m 36s
    6. Spotlight integration: Searching metadata
      3m 41s
    7. Spotlight integration: Metadata attributes
      4m 24s
    8. Using AppleScript
      5m 23s
    9. System configurations: Viewing and setting
      5m 51s
    10. System configurations: Examples
      3m 24s
  11. 1m 26s
    1. Conclusion
      1m 26s

Start learning today

Get unlimited access to all courses for just $25/month.

Become a member
Sometimes @lynda teaches me how to use a program and sometimes Lynda.com changes my life forever. @JosefShutter
@lynda lynda.com is an absolute life saver when it comes to learning todays software. Definitely recommend it! #higherlearning @Michael_Caraway
@lynda The best thing online! Your database of courses is great! To the mark and very helpful. Thanks! @ru22more
Got to create something yesterday I never thought I could do. #thanks @lynda @Ngventurella
I really do love @lynda as a learning platform. Never stop learning and developing, it’s probably our greatest gift as a species! @soundslikedavid
@lynda just subscribed to lynda.com all I can say its brilliant join now trust me @ButchSamurai
@lynda is an awesome resource. The membership is priceless if you take advantage of it. @diabetic_techie
One of the best decision I made this year. Buy a 1yr subscription to @lynda @cybercaptive
guys lynda.com (@lynda) is the best. So far I’ve learned Java, principles of OO programming, and now learning about MS project @lucasmitchell
Signed back up to @lynda dot com. I’ve missed it!! Proper geeking out right now! #timetolearn #geek @JayGodbold
Share a link to this course

What are exercise files?

Exercise files are the same files the author uses in the course. Save time by downloading the author's files instead of setting up your own files, and learn by following along with the instructor.

Can I take this course without the exercise files?

Yes! If you decide you would like the exercise files later, you can upgrade to a premium account any time.

Become a member Download sample files See plans and pricing

Please wait... please wait ...
Upgrade to get access to exercise files.

Exercise files video

How to use exercise files.

Learn by watching, listening, and doing, Exercise files are the same files the author uses in the course, so you can download them and follow along Premium memberships include access to all exercise files in the library.


Exercise files

Exercise files video

How to use exercise files.

For additional information on downloading and using exercise files, watch our instructional video or read the instructions in the FAQ .

This course includes free exercise files, so you can practice while you watch the course. To access all the exercise files in our library, become a Premium Member.

Join now Already a member? Log in

Are you sure you want to mark all the videos in this course as unwatched?

This will not affect your course history, your reports, or your certificates of completion for this course.


Mark all as unwatched Cancel

Congratulations

You have completed Unix for Mac OS X Users.

Return to your organization's learning portal to continue training, or close this page.


OK
Become a member to add this course to a playlist

Join today and get unlimited access to the entire library of video courses—and create as many playlists as you like.

Get started

Already a member ?

Become a member to like this course.

Join today and get unlimited access to the entire library of video courses.

Get started

Already a member?

Exercise files

Learn by watching, listening, and doing! Exercise files are the same files the author uses in the course, so you can download them and follow along. Exercise files are available with all Premium memberships. Learn more

Get started

Already a Premium member?

Exercise files video

How to use exercise files.

Ask a question

Thanks for contacting us.
You’ll hear from our Customer Service team within 24 hours.

Please enter the text shown below:

The classic layout automatically defaults to the latest Flash Player.

To choose a different player, hold the cursor over your name at the top right of any lynda.com page and choose Site preferences from the dropdown menu.

Continue to classic layout Stay on new layout
Exercise files

Access exercise files from a button right under the course name.

Mark videos as unwatched

Remove icons showing you already watched videos if you want to start over.

Control your viewing experience

Make the video wide, narrow, full-screen, or pop the player out of the page into its own window.

Interactive transcripts

Click on text in the transcript to jump to that spot in the video. As the video plays, the relevant spot in the transcript will be highlighted.

Learn more, save more. Upgrade today!

Get our Annual Premium Membership at our best savings yet.

Upgrade to our Annual Premium Membership today and get even more value from your lynda.com subscription:

“In a way, I feel like you are rooting for me. Like you are really invested in my experience, and want me to get as much out of these courses as possible this is the best place to start on your journey to learning new material.”— Nadine H.

Thanks for signing up.

We’ll send you a confirmation email shortly.


Sign up and receive emails about lynda.com and our online training library:

Here’s our privacy policy with more details about how we handle your information.

Keep up with news, tips, and latest courses with emails from lynda.com.

Sign up and receive emails about lynda.com and our online training library:

Here’s our privacy policy with more details about how we handle your information.

   
submit Lightbox submit clicked
Terms and conditions of use

We've updated our terms and conditions (now called terms of service).Go
Review and accept our updated terms of service.