From the course: Data Ingestion with Python

Unlock the full course today

Join today to access over 22,600 courses taught by industry experts or purchase this course individually.

Challenge: ETL

Challenge: ETL - Python Tutorial

From the course: Data Ingestion with Python

Start my 1-month free trial

Challenge: ETL

(upbeat music) - [Instructor] In this exercise, you will write an ETL, extract, transform and load process, sometimes referred as a data pipeline. You will add data from a weather csv to an SQL3 database. Here is the SQL database schema, which you can find in your exercise files. We have a table called weather, with a day which is date, min and max temperature, which are floats and should be in Fahrenheit, and the snow in integer. And we also create an index on the days so we can query by day faster. You will need to do the following conversion. The date from string to a date time object in Python, and then to a date in the database. The temperatures, you need to convert them from tenth of a Celsius to Fahrenheit. And the snow, which is an integer, just leave it as is. Some of the rows have bad data and won't match the data. Ignore them, and forget the warning.

Contents