Web Scraping on Java 17 & HtmlUnit

Focused View

Aleksandr Azimut

2:01:12

7 View

01 - Introduction

001 IntelliJ IDEA Community Edition.mp4

00:48

002 Project structure.mp4

01:47

003 Deploying the project from Maven.mp4

03:29

004 Maven Dependency.mp4

06:07

005 Web site analyze.mp4

02:09

02 - Web site parsing

001 ParseService.mp4

13:03

002 ParseFactory - use design pattern to simplify code maintain.mp4

06:55

003 Fetch pattern by URL.mp4

16:35

004 Singleton approach.mp4

09:43

005 Scheduler run.mp4

03:52

006 More about XPath.mp4

04:13

007 Parse list of data.mp4

20:44

008 Build single jar.mp4

06:20

009 Save results to a JSON file.mp4

21:49

03 - More info

001 Parsing issues.mp4

03:38

Description

We use the capabilities of java 8+ (17) and htmlunit library to write our own web-parser.

What You'll Learn?

You will create a Java Project
Follow me material feed
Suitable for beginner programmers but better to be a slightly experienced
From scratch to release - will install the environment, write the code and build the jar - step by step.
Will make some tests, touch multithreading, apply design patterns and use java 8+ syntax

Who is this for?

For beginners and those who have already started Java developers.

What You Need to Know?

Computer skills. Software installation skills.

Some java programming experience and understanding of XML/JSON/HTML are preferred

More details

Description
This is a "Follow me" product development course.

In this project you will touch on:
Java 8+, lambda expressions, var
Maven - modification, assembly of the jar archive and its subsequent launch
XPath - and its syntax
Testing
Multithreading
Applications of Singleton and Factory patterns
working with regular expressions
working with Gson and saving a project

And we won't use Spring just out of spite)

The project begins with Intelliji IDEA Community installation, deploying the base project on Maven and till the jar build so that the program can work independently without an IDE (development environment). The parsing result will written as a json files to a hostnamed forlder.

If you understand at least some of the words and if you are interested in your own website parsing project, this course is for you.

I set the entry level for this course as an intermediate level and at the same time kept the entry level in mind. At the end, the boundaries between entry-level and intermediate levels are largely blurred, and a person considering his level to be average and with experience in a company can â€œskipâ€ some initial knowledge and vice versa.

In this course, I apply work experience training new developers,Â where we work through a task together, conveying not only an understanding of the design, but also the design approach and semantics.

Although the training is built on the principle of do as I'm, I still think it is important to explain what is happening on the screen. If it's not enough, I'll add it.

Let's get started.
Who this course is for:
For beginners and those who have already started Java developers.

User Reviews

Rating

average 0

Total votes0

Focused display

Team лид и full-stack разработчик с опытом работы 19+ лет. Еще до окончания университета (ИТМО) в 2006 начал работу в ИТ компании в качестве тимлида.Непрерывно нахожусь в профессии и проектах, прокачивая различные аспекты и подходы в программировании и управлении проектами.Не смотря на свой опыт и возможность перейти в ПМ (project manager) продолжаю активно разрабатывать проекты, работая с профессионалами у которых продолжаю учиться и чей опыт применять.Проделал путь:+ от бэкендера на PHP до Java разработчика + от недооценки документирования проекта до ощущения острой необходимости + от программирования на ActionScript2/3 и до прощания с AS и уверенностью в пользе любого опыта)

Udemy

View courses Udemy

Students take courses primarily to improve job-related skills.Some courses generate credit toward technical certification. Udemy has made a special effort to attract corporate trainers seeking to create coursework for employees of their company.