From the course: Amazon Web Services: Data Services
Unlock the full course today
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
Use AWS Glue for ETL - Amazon Web Services (AWS) Tutorial
From the course: Amazon Web Services: Data Services
Use AWS Glue for ETL
- [Instructor] Now in this second part of looking at Glue, we're going to look at the ETL section. So, we've got workflows, jobs, triggers, and dev endpoints with notebooks, which is new since the last time I took a look at this service. So workflows and orchestration, call it Demo and then we're going to add this workflow. Can't do that because I've already got one with Demo, so Demo Friday, and add a workflow. Okay, so then inside of here, then I can add a trigger, and I'll call this some new number, and I'll add it. And inside of here, this is a visual workflow designer so that you can design your extract transform and load jobs. So, you can see that you have start, trigger, job, crawler, and that's the crawler that we saw in the previous movie, so it's a parser basically. And then, once you're done with your graph, this becomes executable as a job, so the idea is a designer, a job designer. So speaking of jobs, let's go…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
-
-
-
-
-
(Locked)
Understand a data lake pattern with AWS Lake Formation4m 23s
-
(Locked)
Explore AWS Athena3m 11s
-
(Locked)
Explore AWS Glue Data Catalog and Crawlers4m 10s
-
(Locked)
Use AWS Glue for ETL5m 32s
-
(Locked)
Explore a data lake pattern with AWS Lake Formation7m 8s
-
(Locked)
Scenario: Build for the Internet of Things with Hadoop6m 20s
-
(Locked)
-