Learn how to define the function and use cases for AWS Glue metadata crawlers and the Glue metadata repository.
- [Instructor] In this video,…we'll set up the data and metadata…that we'll need to build our first AWS Glue job.…The job that we'll build will move data from S3…to our MySQL RDS instance.…To start, let's head into S3.…In the demo primary bucket…I'm expecting states.csv to exist.…If you don't have this file, it's in chapter two…of the exercise files folder.…Make sure it's in the bucket and move on.…As for the RDS database, I'm expecting the database…with the employee schema from chapter three…of section four of this video series.…
If you don't have that, you can go back and create it…or you can just follow along.…Now that I know all the data is there,…I'm going into Glue.…And I'll start with Crawlers here on the left.…The first thing I'll do is click Add crawler.…What we're doing here is to set up a function…for AWS Glue to inspect the data in S3,…understand the schema of the files it finds there,…and store that schema as metadata in Glue.…We give the crawler a name.…I'm going to call it states_crawler.…This is going to be a very specific crawler…
Join AWS architect Brandon Rich and learn how to configure object storage solutions and lifecycle management in Simple Storage Service (S3), a web service offered by AWS, and migrate, back up, and replicate relational data in RDS. Find out how to leverage flexible network storage with Elastic File System (EFS), and use the new AWS Glue service to move and transform data. Plus, learn how Snowball can help you transfer truckloads of data in and out of the cloud.
- What is data management?
- AWS S3 basics
- S3 bucket creation
- S3 upload and logging
- S3 event notifications
- S3 data lifecycle configuration
- Working with Amazon Elastic Block Store volumes
- Creating and mounting an EFS
- Creating an AWS RDS instance
- RDS backup and recovery
- Moving data with AWS Database Migration Service
- Moving data with Data Pipeline and Glue
Skill Level Intermediate
Amazon Web Services: Data Serviceswith Lynn Langit4h 30m Intermediate
Amazon Web Services for Data Sciencewith Lynn Langit3h 56m Intermediate
Amazon Web Services: High Availabilitywith Sharif Nijim2h 17m Intermediate
2. Object Storage
3. File Systems
4. Database Services
6. Moving Data in AWS
5. Getting Data to AWS
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.Cancel
Take notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.