Learn about extracting unique lines from a text or stdin, with examples of most of the use cases with sort and uniq commands.
- [Instructor] Welcome to the eighth video of section two:…Sorting Unique and Duplicates.…In the previous video we have learned…about cryptography tools and hashes.…This video illustrates most of the use cases…with sort and unique commands.…Sorting is a common task…that we can encounter with text files.…The sort command helps us perform sort operations…over text files and standard in.…Most often it can be coupled with many other commands…to produce the required output.…
Unique is another command that is often used…along with a sort command.…It helps to extract unique or duplicate lines…from a text or standard in.…The sort command accepts input as file names as well…as standard in, standard input,…and outputs the result by writing standard out.…The same applies to the unique command.…Let's see how to do it.…We can easily sort a given set of files.…For example file one dot text,…and file two dot text as follows.…
For a numerical sort, we can use.…To sort in the reverse order, we can use.…For sorting by months in the order Jan, Feb, March, use.…
Released
7/17/2017Note: This course was created by Packt Publishing. We are pleased to host this training in our library.
- Printing in the terminal
- Performing math in the Linux shell
- Getting and setting dates
- Working with functions and arguments
- Reading output
- Making comparisons
- Concatenating text
- Finding, editing, generating, and deleting files
- Running parallel processes
- Using regular expressions
- Downloading webpages
- Parsing data from a website
- Finding broken links
- Backing up and archiving
- Transferring files and data through the network
- Monitoring your Linux system
- Gathering data for system administration
Skill Level Intermediate
Duration
Views
Related Courses
-
Learning Bash Scripting (2013)
with Scott Simpson1h 25m Beginner -
Linux: Bash Shell and Scripts
with Kevin Dankwardt2h 46m Intermediate
-
1. Shell Something Out
-
Printing in the terminal6m 4s
-
Math with the shell3m 5s
-
Visiting aliases2m 25s
-
Debugging the script2m 46s
-
Functions and arguments4m 31s
-
Comparisons and tests6m 22s
-
-
2. Have a Good Command
-
Concatenating with cat5m 30s
-
Finding files and file listing18m 46s
-
Playing with xargs11m 41s
-
Translating with tr6m 51s
-
Checksum and verification4m 46s
-
Splitting files and data4m 53s
-
Automating interactive input4m 10s
-
-
3. File In, File Out
-
Generating files of any size4m 24s
-
Making files immutable2m 13s
-
Using loopback files6m 15s
-
Printing the directory tree3m 18s
-
-
4. Texting and Driving
-
Using regular expressions9m 25s
-
-
5. Tangled Web? Not at All
-
Downloading from a web page5m 15s
-
A primer on cURL7m 11s
-
Image crawler and downloader3m 36s
-
Web photo album generator1m 54s
-
-
6. The Backup Plan
-
Archiving with tar10m 33s
-
Archiving with cpio2m 31s
-
Compressing data with gzip5m 27s
-
Faster archiving with pbzip23m 15s
-
Backup snapshots with rsync6m 55s
-
-
7. The Old-Boy Network
-
Let us ping4m 53s
-
Creating arbitrary sockets2m 45s
-
-
8. Put on the Monitor's Cap
-
Logging with syslogd2m 44s
-
Monitoring disk activity1m 41s
-
9. Administration Calls
-
Gathering system information1m 57s
-
Scheduling with cron7m 7s
-
User administration script5m 16s
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.
CancelTake notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.
Share this video
Embed this video
Video: Sorting unique and duplicates