Web Scraping Mastery with Python 2023

Focused View

Marco Capuano

3:57:53

129 View

1. Web Scraping Fundamentals

1.1 lecture1-webscraping-process.pptx

1. Web Scraping process.mp4

14:53

2. Using chrome dev tools to analyze websites.mp4

14:29

3. Choosing the appropriate scraping method.html

4.1 BeautifulSoup 4.0 Documentation.html

4.2 BeautifulSoup 4.0 python module for parsing html code.html

4.3 Download Python3.html

4.4 Download Visual Studio Code.html

4.5 html parsing advanced.zip

4.6 html parsing easy.zip

4.7 json parsing.zip

4.8 LXML Parser python module for BeautifulSoup 4.0.html

4. HTML & JSON parsing.mp4

27:12

5. Parsing practice quizz.html

2. Request based web scraping

1.1 HTTP Documentation.html

1. Web Request explained.mp4

06:59

2.1 Our target website.html

2.2 project-1.zip

2. [Project] Request based web scraping product listings.mp4

15:25

3.1 Our target website.html

3.2 Postman.html

3.3 project-2.zip

3. [Project] Advanced request based web scraping.mp4

27:59

4.1 the-4-layers-of-web-security.pptx

4. The 4 Layers of web security you will encounter.mp4

13:02

5.1 Fake Useragent python module.html

5.2 Our scraping target.html

5.3 project-3.zip

5. [Project] Trustpilot review scraping bypassing security layer 1 & 2.mp4

23:55

3. Emulation based web scraping & web automation

1.1 web-emulation-explained.pptx

1. Web emulation explained.mp4

07:01

2.1 Chromedriver download.html

2.2 project-4.zip

2.3 Selenium python module.html

2. First emulation with selenium & chromium.mp4

03:51

3.1 project-4.zip

3. [Project] Web automation with selenium @ google.com.mp4

18:15

4.1 Antibot test website.html

4.2 Detect Headless emulation website.html

4.3 driver.zip

4.4 Fake Useraagent module.html

4.5 PIL Pillow module python (Just for showing screenshot taken by selenium).html

4.6 Selenium stealth module.html

4.7 spoof.zip

4.8 Undetected chromedriver (optional module).html

4. Spoofing the emulation & creating a reuseable driver creation class.mp4

29:51

5.1 driver.zip

5.2 spoof.zip

5. [Project] Scraping Google places reviews (Emulation + API Reversal - Requests).mp4

35:01

4. Assignment

1. API & WEB Reversal.html

Description

Become an expert in web scraping, finding hidden api's, reversing them and bypassing web automation/bot detection.

What You'll Learn?

Learn about the web scraping fundamentals
Learn about the top 3 web scraping methods
Learn to analyze websites and choose the optimal web scraping method
Learn to find hidden API's and reverse them
Learn to perform request and emulation based web scraping
Learn to parse HTML & JSON
Learn to optimize your requests and create clean fingerprints
Learn to bypass many anti-bot detections with selenium emulation (Advanced & unique)
Learn web-automation with selenium
Learn to scrape e-commerce stores and review websites

Who is this for?

Anyone who wants to scrape data from any website

Skilled developers who want to obtain advanced knowledge in Web Scraping

Entrepreneurs who want to compete in the global Web Scraping & Web-automation market

Anyone who wants to stop spending hours manually copying data off a website, and wants to automate this task

Anyone who wants to scrape Google, Amazon etc.

What You Need to Know?

Basic knowledge in Python

Internet Access

Hardware with minimum of 4GB RAM

More details

Description
Web Scraping has become an art in todays online world, more and more websites learn to block automated traffic or generate their data dynamically. Common web scraping techniques are deprecated and tutorials outdated.
In addition, the first thing you will see when you google web scraping, are proxy or scraping service providers, which earn alot of money by providing scraping services. Those services use certain tricks to provide scraping services for important websites like amazon, google etc., but they wont share those tricks (I do in this course). They claim to use emulation or simmilar techniques to scrape their targets, but in reality they use much cheaper and more efficient ways of scraping the desired data.
In this course you will learn the web scraping fundamentals within an hour and then proceed with learning those secret tricks, big web scraping providers use.

What can you expect?
We will take a look at the web scraping fundamentals and exercise choosing the optimal scraping solution...
We will build projects to scrape review data of trustpilot, amazon, google places and so on...
We will solve real world practice exercises...
You will have advanced knowledge about anti-bot detections and security mechanisms of websites...
You will learn about advanced web automation...
You will learn about customizing your fingerprint and bypass automation detections...
You will learn to reverse complex API's and practice it with real world examples...
and so much more...

Who this course is for:
Anyone who wants to scrape data from any website
Skilled developers who want to obtain advanced knowledge in Web Scraping
Entrepreneurs who want to compete in the global Web Scraping & Web-automation market
Anyone who wants to stop spending hours manually copying data off a website, and wants to automate this task
Anyone who wants to scrape Google, Amazon etc.

User Reviews

Rating

average 0

Total votes0

Focused display

Who I am?I'm Marco Capuano, I'm a self-taught developer & an online teacher on Udemy. I've founded my company Starux GmbH in 2021, with the main goal to bring state of the art solutions and knowledge to everyone out there!In my courses, I'm gonna teach you advanced and unique knowledge about different hot topics, with great real world examples to get you started!I can't wait to see you enrolled in one of my courses, I'll make sure to be there for you on every step you make and answer any questions you have.

Udemy

View courses Udemy

Students take courses primarily to improve job-related skills.Some courses generate credit toward technical certification. Udemy has made a special effort to attract corporate trainers seeking to create coursework for employees of their company.