Scraping Dynamic Web Pages with Python 3 and Selenium

Focused View

Pratheerth Padman

1:07:39

45 View

01 - Course Overview

01 - Course Overview.mp4

01:54

02 - Exploring Selenium with Python

02 - Module Introduction.mp4

02:46

03 - Overview of Scraping Dynamic Webpages.mp4

01:54

04 - What Is Selenium and Where Is It Used.mp4

03:13

05 - Selenium WebDriver.mp4

03:54

06 - Demo - Installing Libraries.mp4

02:37

07 - Demo - Opening a Webpage with WebDriver.mp4

03:15

08 - Summary.mp4

00:45

03 - Locating Elements & Navigating Dynamic Web Pages

09 - Module Introduction.mp4

00:55

10 - Introduction to Elements.mp4

01:08

11 - Methods to Locate Elements.mp4

06:29

12 - Demo - Locating Elements in a Webpage - Part 1.mp4

03:16

13 - Demo - Locating Elements in a Webpage - Part 2.mp4

04:32

14 - Demo - Navigating a Webpage with Selenium.mp4

05:33

15 - Summary.mp4

00:41

04 - Loading Selenium Page Source into BeautifulSoup

16 - Module Introduction.mp4

00:43

17 - Introduction to Beautiful Soup.mp4

03:11

18 - Transitioning from Selenium to Beautiful Soup.mp4

01:10

19 - Demo - Combining Tools to Scrape a Dynamic Webpage - Introduction.mp4

01:52

20 - Demo - Combining Tools to Scrape a Dynamic Webpage - Practical Implementation.mp4

04:54

21 - Summary.mp4

00:36

05 - Overcoming Challenges and Increasing Efficiency

22 - Module Introduction.mp4

00:41

23 - Challenges in Web Scraping.mp4

05:02

24 - Tips to Increase Efficiency & Best Practices.mp4

05:25

25 - Summary.mp4

01:13

Description

In this course, you will go all the way from saying hello to Selenium to then combining it with Python and Beautiful Soup to learn all about extracting information from a dynamic webpage.

What You'll Learn?

They say data is the new oil, and given what you can do with high quality data, you'd be hard-pressed to disagree. There are many ways to collect data, one of which is extracting the oodles of data swimming around in the form of websites. That is exactly what this course, Scraping Dynamic Web Pages with Python 3 and Selenium, aims to teach. First, you are going to look at how to scrape data from dynamic websites. The main tool used is Selenium, and the course starts off by exploring that. Next, you will move onto the specifics of it, starting with opening a webpage using a web driver. Then you will learn to identify and locate dynamic elements in a webpage and handing the page source over to beautiful soup. Finally, to round off the course, you will explore the common challenges you will face and methods to increase scraping efficiency. When you are finished with this course, you will be able to combine Python, Selenium, and Beautiful Soup to extract data from any dynamic webpage.

More details

User Reviews

Rating

average 0

Total votes0

Focused display

Python

Selenium Testing Framework

Selenium WebDriver

Pratheerth Padman

Instructor's Courses

Pratheerth is a Data Scientist who has entered the field after an eclectic mix of educational and work experiences. He has a Bachelor's in Engineering in Mechatronics from India, Masters in Engineering Management from Australia and then a couple of years of work experience as a Production Engineer in the Middle East. Then when the A.I bug bit him, he dropped everything to dedicate his life to the field. He is currently working on mentoring, course creation and freelancing as a Data Scientist.

Pluralsight

View courses Pluralsight

Pluralsight, LLC is an American privately held online education company that offers a variety of video training courses for software developers, IT administrators, and creative professionals through its website. Founded in 2004 by Aaron Skonnard, Keith Brown, Fritz Onion, and Bill Williams, the company has its headquarters in Farmington, Utah. As of July 2018, it uses more than 1,400 subject-matter experts as authors, and offers more than 7,000 courses in its catalog. Since first moving its courses online in 2007, the company has expanded, developing a full enterprise platform, and adding skills assessment modules.