From the course: Using Python for Automation

Unlock this course with a free trial

Join today to access over 22,600 courses taught by industry experts.

The value of web scraping

The value of web scraping - Python Tutorial

From the course: Using Python for Automation

The value of web scraping

- [Instructor] What is web scraping? Well, web scraping is a popular tool that many professionals use to gather data online, because it offers an inexpensive alternative to the traditional means of extracting information. With the bountiful amounts of data online, it's essential you learn the tools to compile your own data cheaply and efficiently for whatever purpose. This sounds great, but how does it work? Well, there's only three basic steps of web scraping. First, there's sending a get query to the website. This returns an HTML based document containing all of the website's information and thus setting us up for our next step, parsing. At this point, we parse the HTML document, making it more navigable and giving away for the final step, extracting the data we actually want. At this point we can isolate the data we actually need from the website and store it in whatever format we like. Don't worry if this process sounds confusing for now, as we'll cover each…

Contents