Scraping Dynamic Web Pages with Python and Selenium

  • flag Pluralsight
  • student Expert
  • database Video
  • earth English
  • clock 1h 7m


In this course^ you will go all the way from saying hello to Selenium to then combining it with Python and Beautiful Soup to learn all about extracting information from a dynamic webpage.


They say data is the new oil^ and given what you can do with high quality data^ you d be hard-pressed to disagree. There are many ways to collect data^ one of which is extracting the oodles of data swimming around in the form of websites. That is exactly what this course^ Scraping Dynamic Web Pages with Python and Selenium^ aims to teach. First^ you are going to look at how to scrape data from dynamic websites. The main tool used is Selenium^ and the course starts off by exploring that. Next^ you will move onto the specifics of it^ starting with opening a webpage using a web driver. Then you will learn to identify and locate dynamic elements in a webpage and handing the page source over to beautiful soup. Finally^ to round off the course^ you will explore the common challenges you will face and methods to increase scraping efficiency. When you are finished with this course^ you will be able to combine Python^ Selenium^ and Beautiful Soup to extract data from any dynamic webpage.