Scraping Dynamic Web Pages with Python 3 and Selenium

Focused View

Pratheerth Padman

1:42:26

108 View

1. Course Overview

1. Course Overview.mp4

02:14

2. Mastering Dynamic Web Navigation

1. Course and Module Introduction.mp4

03:07

2. Static vs. Dynamic Web Pages.mp4

01:34

3. Unveiling Selenium - A Powerful Automation Tool.mp4

04:30

4. The Selenium WebDriver.mp4

03:22

5. Demo - Introduction to the Course Project - Real Estate Scraper.mp4

02:39

6. Demo - Setting up Your Environment.mp4

04:09

7. Demo - Opening a Web Page and Basic Navigation.mp4

06:26

8. Summary.mp4

01:01

3. Automating and Customizing User Interactions

1. Module Introduction.mp4

01:01

2. Introducing Selenium IDE.mp4

03:26

3. Demo - Installing and Setting up Selenium IDE.mp4

02:46

4. Demo - Recording Web User Activity.mp4

04:06

5. Demo - Recording and Replaying Recorded User Activity.mp4

05:36

6. Demo - Customizing the Script for Personalized User Sessions.mp4

04:37

7. Summary.mp4

00:48

4. Locating, Navigating, and Engaging Web Elements

1. Module Introduction.mp4

00:53

2. Introduction to Web Elements.mp4

02:07

3. How to Locate Elements on a Web Page.mp4

07:32

4. Wait Strategies in Selenium.mp4

03:38

5. Demo - Locating Elements on a Dynamic Web Page - Part 1.mp4

05:23

6. Demo - Locating Elements on a Dynamic Web Page - Part 2.mp4

04:54

7. Summary.mp4

01:17

5. Unleashing the Power of HTML Parsing and Scraping

1. Module Introduction.mp4

00:48

2. Introduction to Beautiful Soup.mp4

05:47

3. Integrating Beautiful Soup with Selenium.mp4

03:20

4. Demo - Combining Tools to Scrape a Dynamic Web Page - Part 1.mp4

07:02

5. Demo - Combining Tools to Scrape a Dynamic Web Page - Part 2.mp4

04:29

6. Best Practices for Scraping a Dynamically Rendered Web Page.mp4

02:21

7. Summary.mp4

01:33

Description

Go from saying hello to Selenium to combining it with Python and Beautiful Soup to extract information from a dynamic web page. Master WebDriver navigation, user activity recording, and more while creating a real estate web scraper in this course.

What You'll Learn?

There are many ways to collect data, one of which is extracting the tons of data swimming around in the form of websites. However, gathering and analyzing data from dynamic websites can be frustrating, especially when essential information is only available after interacting with web elements. In this course, Scraping Dynamic Web Pages with Python 3 and Selenium, you'll gain the ability to efficiently extract data from dynamically-rendered web pages. First, you'll explore how to understand and navigate dynamic web pages using Selenium WebDriver, as well as how to record, replay, and customize user activity sessions to interact with web elements effectively. Next, you'll discover how to manage wait times, locate elements, and navigate complex web pages with various types of selectors. Then, you'll dive into parsing HTML using Beautiful Soup and applying best practices for web scraping. Finally, you'll learn how to implement a real estate property scraper project, putting all the acquired skills into practice. When you're finished with this course, you'll have the skills and knowledge of web scraping with Python and Selenium needed to efficiently extract valuable data from dynamically-rendered web pages.

More details

User Reviews

Rating

average 0

Total votes0

Focused display

Python

Selenium Testing Framework

Selenium WebDriver

Pratheerth Padman

Instructor's Courses

Pratheerth is a Data Scientist who has entered the field after an eclectic mix of educational and work experiences. He has a Bachelor's in Engineering in Mechatronics from India, Masters in Engineering Management from Australia and then a couple of years of work experience as a Production Engineer in the Middle East. Then when the A.I bug bit him, he dropped everything to dedicate his life to the field. He is currently working on mentoring, course creation and freelancing as a Data Scientist.

Pluralsight

View courses Pluralsight

Pluralsight, LLC is an American privately held online education company that offers a variety of video training courses for software developers, IT administrators, and creative professionals through its website. Founded in 2004 by Aaron Skonnard, Keith Brown, Fritz Onion, and Bill Williams, the company has its headquarters in Farmington, Utah. As of July 2018, it uses more than 1,400 subject-matter experts as authors, and offers more than 7,000 courses in its catalog. Since first moving its courses online in 2007, the company has expanded, developing a full enterprise platform, and adding skills assessment modules.