Join Barron Stone for an in-depth discussion in this video Accessing data from the website, part of Code Clinic: Python (2014).
…The third and final module in my Python solution to…the Lake Pend Oreille Code Clinic Challenge is called lpoWeb.…Its job is to access the Navy's website to…download and parse the weather data for requested dates.…The Navy's website stores data in text…files, which my Python program needs to parse.…Due to changes over time and how the data was stored,…this turns out to be trickier than I had initially anticipated.…Dates from 2001 to 2010 are stored in…large text files in the main weather data directory.…
Each one of these text files stores the…entire set of data collected for that year.…In addition to the data and time stamp columns, there are…11 different columns for the different types of recorded weather data.…If we look back in the main directory, you can also see that starting in…2006, the website began kind of login its…data with a different file structure and format.…There's a folder for each year from 2006 onward, and inside of those…folders is a collection of additional folders from each day within that year.…
Barron introduce challenges and provides an overview of his solutions in Python. Challenges include topics such as statistical analysis, searching directories for images, and accessing peripheral devices.
Visit other courses in the series to see how to solve the exact same challenges in languages like C#, C++, Java, PHP, and Ruby.
Skill Level Intermediate
Q: Why can't I access the Lake Pend Orielle site (http://lpo.dt.navy.mil)?
A: The Lake Pend Orielle site is not accessible in some geographical areas. We have contacted the owner of the server to try to resolve this issue.
Q: I am unable to access the Lake Pend Oreille data from outside the U.S.
A: A static copy of this data is provided here for lynda.com members outside of the U.S