From the course: Data Ingestion with Python
Unlock the full course today
Join today to access over 22,600 courses taught by industry experts or purchase this course individually.
Challenge: ETL - Python Tutorial
From the course: Data Ingestion with Python
Challenge: ETL
(upbeat music) - [Instructor] In this exercise, you will write an ETL, extract, transform and load process, sometimes referred as a data pipeline. You will add data from a weather csv to an SQL3 database. Here is the SQL database schema, which you can find in your exercise files. We have a table called weather, with a day which is date, min and max temperature, which are floats and should be in Fahrenheit, and the snow in integer. And we also create an index on the days so we can query by day faster. You will need to do the following conversion. The date from string to a date time object in Python, and then to a date in the database. The temperatures, you need to convert them from tenth of a Celsius to Fahrenheit. And the snow, which is an integer, just leave it as is. Some of the rows have bad data and won't match the data. Ignore them, and forget the warning.
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.