Dates can be entered in many formats. In this video, learn how to tell Spark exactly how to handle different time and date formats.
- [Instructor] Working with dates can sometimes…be a little confusing if you're new to Spark.…The best way to get started is with an example.…So, let's head over to our notebook.…This time, we won't be using the reported crimes CSV file.…So, don't worry if you don't have it downloaded,…but you'll still need to set up your Spark environment.…When you create a simple data format object in Java…you specify a pattern string.…The contents of the pattern string…determines the format of the date and time.…
So, let's take a look at the simple date format.…You can see that we'll use different abbreviations…or letters based on what week, month, or day…we want to represent.…To make sure we understand this,…let's head back to our notebook…and let's convert Christmas Day 2019,…so that's the 25th of December 2019…at 1:30 in the afternoon using multiple date formats.…Now remember that all we'll be doing is…we're going to be using the format table…from the simple date format class from the Java docs.…
So, for example if we want to represent the year…
- Benefits of the Apache Spark ecosystem
- Working with the DataFrame API
- Working with columns and rows
- Leveraging built-in Spark functions
- Creating your own functions in Spark
- Working with Resilient Distributed Datasets (RDDs)
Skill Level Intermediate
1. Introduction to Apache Spark
2. Technical Setup
3. Working with the DataFrame API
5. Resilient Distributed Datasets (RDDs)
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.Cancel
Take notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.