AWS devops: ElasticSearch at AWS with terraform and ansible

Focused View

Sergii Demianchuk

3:32:49

104 View

1 - Introduction

1 - Promo introduction video.mp4

03:31

2 - Course road map.mp4

06:03

2 - Initial terraform configuration aspects

3 - Attachments-Terraform-repository-code-structure-and-environment-configuration.pdf

3 - Terraform repository code structure and environment configuration.mp4

04:16

3 - aws-es-devops.zip

4 - Preinit terraform module.mp4

06:33

3 - AWS skeleton configuration

5 - Network architecture scheme.mp4

02:16

5 - aws-network-abstract-1.pdf

6 - Part 1 Network terraform module vpc subnets cidr.mp4

03:26

7 - Part 2 Network terraform module routing tables and security groups.mp4

05:12

8 - Part 3 Network terraform module implementation.mp4

05:27

9 - Terraform bastion module.mp4

10:28

4 - Deploying an Elasticsearch cluster using AWS Openseach

10 - Attachments-What-is-OpenSearch.pdf

10 - What is OpenSearch.mp4

04:28

11 - Attachments-Part-1-Terraform-OpenSearch-module-security-and-permissions.pdf

11 - Part 1 Terraform OpenSearch module security and permissions.mp4

03:19

12 - Part 2 Terraform OpenSearch module cluster configuration.mp4

05:05

12 - -Attachments-Part-2-Terraform-OpenSearch-module-cluster-configuration.pdf

13 - Attachments-Part-3-Terraform-OpenSearch-module-network-logs-storage.pdf

13 - Part 3 Terraform OpenSearch module network logs and storage.mp4

04:44

14 - Attachments-Part-4-Terraform-OpenSearch-module-cloudwatch-alarms-and-variables.pdf

14 - Part 4 Terraform OpenSearch module CW alarms variables.mp4

03:55

15 - Apply terraform OpenSearch module domain endpoint and opensearch dashboard.mp4

10:13

15 - -Attachments-Apply-terraform-OpenSearch-module-domain-endpoint-and-opensearch-dashboard.pdf

16 - OpenSearch monitoring.mp4

03:30

17 - Short summary and essential notices that appeared from real commercial practice.mp4

07:08

5 - Deploying an ES cluster using AWS ECS

18 - What is ECS and why not Fargate but EC2.mp4

02:11

19 - ECS base components and architecture scheme.mp4

03:07

19 - aws-network-ec2.pdf

20 - Attachments-ES-docker-image-and-AWS-ECR.pdf

20 - Elasticsearch Docker file and AWS ECR.mp4

09:50

21 - ECS IAM profile terraform module.mp4

05:57

22 - Attachments-ECS-EC2-terraform-module.pdf

22 - ECS EC2 terraform module.mp4

13:18

23 - ECS cluster terraform module.mp4

12:14

24 - Elasticsearch at AWS ECS short summary.mp4

03:10

6 - Deploying an ES cluster using AWS EC2 and docker swarm

25 - What is docker swarm and why it is not dead.mp4

02:08

26 - Docker swarm architecture.mp4

02:23

27 - EC2 terraform module.mp4

03:38

28 - Ansible inventory docker and docker swarm ansible roles.mp4

07:46

29 - Ansible Elasticsearch role.mp4

11:00

29 - Attachments-Attachments-Ansible-Elasticsearch.pdf

30 - Elasticsearch and docker swarm short summary.mp4

03:09

7 - Autoscaling and Elasticsearch

31 - Attachments-Autoscaling-and-Elasticsearch-1.pdf

31 - Autoscaling at Elasticsearch at AWS.mp4

12:12

8 - Course summary which deployment scenarios is better

32 - Course summary which deployment scenarios is better.mp4

05:50

9 - Elasticsearch theory

33 - ElasticSearch-at-production-attachments.docx

33 - Inside a cluster.mp4

04:49

34 - ElasticSearch shards and performance.mp4

13:14

34 - ElasticSearch-at-production-attachments-1.docx

35 - ElasticSearch-at-production-attachments-2.docx

35 - Indexing secretes.mp4

07:19

Description

AWS devops. How to deploy Elasticsearch cluster at AWS using Opensearch, ECS, EC2 with terrafrom and ansible

What You'll Learn?

How to deploy HA Elasticsearch cluster using AWS Opensearch
How to deploy HA Elasticsearch cluster using AWS ECS
How to deploy HA Elasticsearch cluster using AWS EC2
Elasticsearch autoscaling
Elasticsearch cluster conceptions and performance
AWS IAM, VPC, ECS, Opensearch, security groups
Docker and Docker swarm

Who is this for?

Software engineers, devops engineers

Everybody who likes ElasticSearch and want to get more knowledge around it

More details

Description
The course consists of 5 main modules.
Teh first one is about how to deploy ES as an AWS service, which is called OpenSearch. Here I will tell you about interesting OpenSearch pitfalls that I discovered during my commercial practice. And believe me - you will not find that information at AWS documentation. You will get a ready terraform module for deploying the Opensearch cluster and we will analyze it step by step together.
In the 2d part I will show how to deploy an ES cluster at ECS (Elastic Container Service). And again we will use the terraform modules for that. I will show you why you can't use Fargate in that case and how many problems should be resolved to deploy ES at ECS.
Next course section is about how to deploy ES at EC2 instances using docker swarm. I will prove to you that it is the easiest and at the same time the most cheap way to deploy ES at almost any cloud for most small and middle companies with a steady growth pattern. You will get ready terraform modules that will allow you to prepare AWS infrastructure and ansible modules for deploying HA ES cluster upon it.
The 4th part is devoted to autoscaling possibilities of ES cluster using different deployment approaches. We will talk about what we really can autoscale, when we can use it and what big limitations we have in case of working with ES.
5th module is devoted to the theory. If you are already familiar with ES cluster conceptions and everything that is related to shards and ES performance - then you can skip it. But if not - that is the place where you have to start from.

Who this course is for:
Software engineers, devops engineers
Everybody who likes ElasticSearch and want to get more knowledge around it

User Reviews

Rating

average 0

Total votes0

Focused display

My name is Sergii Demianchuk. I have over 15 year’s experience as a software engineer. At my work I am mostly using next technologies: PHP, Python, Java, Javascript, Symfony, Flask, Spring, Vue, Docker, AWS Cloud, ML, Ansible, Jenkins, MySQL, Redis, ElasticSeach. I started my IT carrier as Engineer at national telecommunication Ukrainian networks. Than I worked as web full stack developer and IT manager for 10 years. After relocation to Poland at 2012, I continued my carrier path at Clicktrans company which represents one of the biggest transport marketplaces in Europe. Currently I am taking the position of CTO&System Architect at Clicktrans. My work is concentrated around architecture for complex systems, using ML for solving transport problems, big data sets analysis, search & recommendations systems. I am also deeply involved at devops and security world. My favorite slogan: "There is nothing impossible. The main question is how to do complicated system in the most efficient way having right people on a board with keeping it safe and simple at support :)"

Udemy

View courses Udemy

Students take courses primarily to improve job-related skills.Some courses generate credit toward technical certification. Udemy has made a special effort to attract corporate trainers seeking to create coursework for employees of their company.