In this blog, we will use Amazon Web Services to build an end-to-end Log Analytic Solution that collects, ingests, processes, and loads both batch data and real time data. Introduction Real time Data Streaming Ability to process and analyze data in real-time is essential to do things such as continuously monitor your applications to ensure high service uptime and […]
This blog will help you to setup a docker and docker-compose on AWS EC2 Instance Install Docker on AWS sudo yum update -y sudo yum install -y docker sudo service docker start sudo usermod -a -G docker ec2-user Docker version 17.09.1-ce, build Docker installed successfully. Install Docker-Compose. Get the latest one from here https://github.com/docker/compose/releases curl -L […]
Prerequisite for this: Launch an EC2 Linux Instance on AWS. For more details click here Connect to an instance using Putty. Install Docker on the EC2 Instance Update the installed packages and package cache on your instance by running the below command: sudo yum update -y ( On linux instance apt-get doesn’t work , so you have to […]
In this blog, we will do the Ansible Setup on AWS EC2 Instance with windows Nodes Prerequisite of Ansible Setup Python 2. SSH Three servers Ansible control Server ( Install ansible using epel repository)- On AWS you have to enable this file WebServer DBServer How to connect between these servers ? To ping these servers(webserver and dbserver) from ansible […]
For Ansible to work,python and SSH should be configured on all the servers Prerequistie Python SSH On AWS EC2 Linux Free Tier Instance, python and ssh both are already installed Python Version — 2.7.13 Three servers Ansible control Server ( Install ansible using epel repository)- On AWS you have to enable this file WebServer DBServer How to connect […]
CLoudFormation is a declarative way of creating your infrastructure on AWS For example — A sample cloudformation template 1. Need EC2 instance 2. Associate security group to these EC2 instance 3. Create ELB (Load Balancer) in front of EC2 Instances So for these above tasks, we can create a template in json/yaml that will automatically create this […]
Configure AWS CLI You need to provide the AWS access credential to do any kind of automation You can find the security credentials of any IAM user as shown below You need python-pip on that machine to install awscli yum install https://dl.fedoraproject.org/pub/epel/epel-release-latest-7.noarch.rpm sudo yum install python-pip sudo pip install awscli –upgrade pip Run the below […]
This blog will help you to setup a CI/CD pipeline using Jenkins and Docker. It includes automation using Jenkins Pipeline/Groovy scripting language, it uses sonar for code quality and artifactory for artifactory management Tools: Jenkins- CI/CD Git/GitHub — Source Control Management Docker — Container JaCOCO — Code Coverage Tool Gradle — Build tool Ansible — Configuration Management Ansible/Github/Docker/Cucumber/ Continuous Integration Pipeline Configuration Management with Ansible […]
This blog will help you with the basic terraform commands and will give you an idea of how to user variables,map, attributes. Some useful terraform commands Terraform plan — this command shows you what applying do by checking the template, state file, and actual state of the resource. It is recommended to use this before running apply […]
This blog will help you to Analyze VPC Flow logusing Elastic Search Tools/Task: Create Flow Log in VPC IAM Role for VPC Flow Log Cloudwatch Log Group ElasticSearch IAM Lambda role Create Flow Log on VPC Open VPC Click on Create Flow Log 3. For Role — Click on Set up Permissions, it will create a role […]