Devops/cloud Engineer Gcp/aws Resume
St Louis, MO
SUMMARY
- Having overall 7+ years of IT experience which includes proven 4 years of experience in Hadoop Administration on Cloudera (CDH), Hortonworks (HDP) Distributions, Vanilla Hadoop, MapR and strong experience in AWS, Kafka, Elastic Search, DevOps and Linux Administration. Hands on experience in installation, configuration, supporting and managing Hadoop Clusters
- Experience in running web scale services on Amazon Web Services (AWS).
- Create multiple groups and set permission polices for various groups in AWS, AZURE.
- Experience in creating life cycle policies in AWS S3 for backups to Glaciers.
- Experience in configuring the auto scaling groups in AWS and AZURE environment.
- Hands on experience in installing and administrating CI tools like Hudson/Jenkins, Sonar, Sub Version, Team foundation server, and Nexus, antifactory.
- In - depth knowledge of Hadoop Eco system - HDFS, Yarn, MapReduce, Hive, Hue, Sqoop, Flume, Kafka, Spark, Oozie, NiFi and Cassandra
- Highly motivated and committed DevOps Engineer experienced in Automating, configuring, and deploying instances on AWS, Microsoft Azure and Rackspace cloud environments and Data centers.
- Created and deployed VMs on the Microsoft cloud service Azure, managed the virtual networks, Azure AD and SQL.
- Excellent understanding of SDLC Methodologies like Agile, Waterfall, and other processes.
- Experience in Migration & deployment of Applications with upgrade version of Application&Hardware, MSbuild, batch script, IIS and Jenkins.
- Worked on creating the cloud formation scripts, setting up the VPC (public and private subnets) and IAM modules.
- Extensive experience in developing and maintaining build, deployment scripts for test, Staging and Production environments using ANT, Maven, Shellscript.
- Experience in working with continuous integration using Jenkins, setting up the build pipeline and security to Jenkins environment.
- Experience in Administration/Maintenance of source control management systems, such as Subversion (SVN), Perforce and GIT.
- Exposure to the automation on both Windows and Linux environments.
- Experience in Managing/Tracking the defects status by using JIRA tool and Planning & resolving the issues as per SLA.
- Experience in maintaining the application Servers like Tomcat, WebLogic, WebSphere and JBoss, IIS.
- Good understanding of the principles and best practices of Software Configuration Management (SCM) in Agile, Scrum, and Waterfall methodologies.
- Worked in SCM tool Ansible for Deployment on Multiple platforms.
- Experience in writing complex cookbooks, recipes and configure them by applying nodeJS convergence on various production nodes.
- Ability in managing all aspects of the software configuration management process including code compilation, packaging, deployment, release methodology and application configurations.
- Release Management Experience writing Shell and Perl scripts to automate the deployments.
- Designed, planned, delivered and maintained monitoring APM methodologies and software solutions to support Software Development Life Cycle among operations.
- Excellent experience in working with Agile and waterfall implementation methodologies.
- Extensive experience in developing and maintaining build, deployment scripts for test, Staging and Production environments using ANT, Maven, Shell.
- Experience in working with continuous integration using Jenkins, setting up the build pipeline and security to Jenkins environment.
- Created fully automated CIbuild, deployment infrastructure and processes for multiple projects.
- Experience in developing scripts for build, deployment and maintenance related tasks using Jenkins, Maven, Python and Bash.
- RESTAPI Development using AWS Gateway and AWSLambda (Python).
- Automated resource cleanup using AWSLambda as part of cost saving effort.
TECHNICAL SKILLS
Languages: Shell, Java script, Python, XML, SQL, Bash& shell scripting, Perl
SCM Tools: Subversion (SVN), GIT, Team Foundation Server (TFS)
Build Tools: Ant, Maven, Jenkins
Web/App Server: IBM WebSphere Application Server, Apache Tomcat, Pivotal Cloud
Bug Reporting/ Lifecycle Management: JIRA, HP-ALM, RLM
AWS Services: EC2, ELB, VPC, RDS, IAM, Cloud Formation, S3, Cloud Watch, CloudTrail, EBS, SNS
Azure: VM, VPN, Load Balancer, Function APPS, Logic Apps, AKS, Intunes, IAM, ADFS, ARM, Azure Monitor, Application Insights, Cosmos DB, Azure PowerShell Modules, Azure Redis Cache, Azure Key Vault
DevOps: Jenkins, Maven, ANT, SVN, GIT, Docker, Azure DevOps
Release deploy: ServiceNow
PROFESSIONAL EXPERIENCE
Confidential, ST. Louis, MO
DevOps/Cloud Engineer GCP/AWS
Responsibilities:
- Worked on google cloud platform (GCP) services like compute engine, cloud load balancing, cloud storage, cloud SQL, stack driver monitoring and cloud deployment manager.
- Setup GCP Firewall rules to allow or deny traffic to and from the VM's instances based on specified configuration and used GCP cloud CDN (content delivery network) to deliver content from GCP cache locations drastically improving user experience and latency.
- Worked on GKE Topology Diagram including masters, slave, RBAC, helm, kubectl, ingress controllers GKE Diagram including masters, slave, RBAC, helm, kubectl, ingress controllers
- Created projects, VPC's, Subnetwork's, GKE Clusters for environments QA3, QA9 and prod using Terraform Created projects, VPC's, Subnetwork's, GKE Clusters for environments.
- Worked on Jenkins file with multiple stages like checkout a branch, building the application, testing, pushing the image into GCR, Deploying to QA3, Deploying to QA9, Acceptance testing and finally Deploying to Prod
- Setting up and configuring Kafka Environment in Windows from the scratch and monitoring it.
- Responsible for Setup and build AWS infrastructure using resources VPC, EC2, S3, RDS, Dynamo DB, IAM, EBS, Route53, SNS, SES, SQS, CloudWatch, CloudTrail, Security Group, Autoscaling and RDS using CloudFormation templates.
- Deployed and monitored scalable infrastructure on Amazon web services (AWS) and configuration management instances and Managed servers on the Amazon Web Services (AWS) platform using Chef configuration management tools and Created instances in AWS as well as migrated data to AWS from data Center.
- Involved in design and deployment of a multitude of Cloud services on AWS stack such as EC2, Route53, S3, RDS, Dynamo DB, SNS, SQS, IAM, while focusing on high-availability, fault tolerance, and auto-scaling in AWS CloudFormation
- Developed strategy for cloud migration and implementation of best practices using AWS services like database migration service, AWS server migration service from On-Premises to cloud.
- Implemented and maintained the monitoring and alerting of production and corporate servers/storage using AWS CloudWatch / Splunk and assigned AWS elastic IP addresses to work around host or availability zone failures by quickly re-mapping the address to another running instance
- Provisioned the highly available EC2 Instances using Terraform and cloud formation and wrote new python scripts to support new functionality in Terraform.
- Efficiently Worked with all of the following tools/Instances but not limited to including: Kafka, Zookeeper, Console Producer, Console Consumer, Kafka Tool, File Beat, Metric Beat, Elastic Search, Logstash, Kibana, Spring Tool Suite, Apache Tomcat Server etc.
- Managed AWS infrastructure as code (IaaS) using Terraform. Expertise in writing new python scripts in order to support new functionality in Terraform. Provisioned the highly available EC2 Instances using Terraform and cloud formation and Setting up the build and deployment automation for Terraform scripts using Jenkins
- Designed AWS Cloud Formation templates to create custom sized VPC, to set up IAM policies for users, subnets, NAT to ensure successful deployment of Web applications, database templates and Security groups
- Managed Docker orchestration and Docker containerization using Kubernetes. Used Kubernetes to orchestrate the deployment, scaling, and management of Docker Containers
- Created and deployed Kubernetes pod definitions, tags, labels, multi-pod container replication. Managed multiple Kubernetes pod containers scaling, and auto-scaling.
- Implemented new tools such as Kubernetes with Docker to assist with auto-scaling and continuous integration (CI) and Upload a Docker image to the registry so the service is deployable through Kubernetes. Use the Kubernetes dashboard to monitor and manage the services.
- Worked on installing, configuring and managing Docker Containers, Docker Images for Web Servers and Applications and Implemented Docker -maven-plugin in and maven pom to build Docker images for all microservices and later used Docker file to build the Docker images from the java jar files
- Created Docker images using a docker file, worked on Docker container snapshots, removing images and managing Docker volumes and also virtualized servers in Docker as per QA and Dev-environment requirements and configured automation using Docker containers
- Configured different artifacts to make an image and deploy Docker image to install the application on an instance, maintain and troubleshoot for any user issues or network problems
- Worked on Docker-Compose, Docker-Machine to create Docker containers for testing applications in the QA environment and automated the deployments, scaling and management of containerized applications
- Installed and Implemented Ansible configuration management system. Used Ansible to manage Web applications, Environments configuration Files, Users, Mount points, and Packages also Worked with automation/configuration management using Ansible and created playbooks in YAML to automate the development processes.
- Implemented Infrastructure automation through Ansible for auto-provisioning, code deployments, software installation and configuration updates.
- Added required images to Vagrant and create servers out of Images for testing and Automated infrastructure build-out and systems provisioning using Ansible and Ansible Tower
- Designed fully automated server build management, monitoring, and deployment by using Ansible playbooks using Ansible role created an ELK cluster for non-log purposes to search and analytics of product and pricing data
- Creating a backup for all the instances in Kafka Environment.
- Developed build and deployment scripts using MAVEN as build tools in Jenkins to move from one environment to other environments and Supporting Maven multi-module builds and store artifacts in a remote repository in artifacts
- Worked with the development team to generate deployment profiles (jar, war, rar) using ANT Scripts and Jenkins
- Worked on writing Jenkins build a pipeline with Gradle script and Groovy DSL (Domain Specific Language) and integrating ANT/MAVEN build scripts with Gradle for the sole purpose of continuous build.
- Built and maintained ELK stack to centrally collect logs that are used to monitor applications also Installed, monitored and configured Applications in Nginx and Apache Tomcat Server and establish connectivity to databases and troubleshoot issues on the fly.
- Created Pre-commit hooks in Perl/shell/bash for authentication with JIRA-Pattern Id while committing codes in SVN, limiting file size code and file type and restricting development team to check-in while code commit
- Hands-on experience in standing up and administrating on-premise Kafka platform
- Deployed and configured JIRA, both hosted and local instances for issue tracking, workflow collaboration, and tool-chain automation
- Used monitoring tools like Nagios and Splunk to improve application performance, helps to get the visibility & business context to meet business demands and implemented SPARK communication tool chat BOT for triggering alerts.
- Working Knowledge of databases like MySQL, RDS, DynamoDB, and MongoDB
- Good understanding of the principles and best practices of software configuration management (SCM) in agile, scrum and waterfall methodologies.
- Worked on writing multiple Python, Ruby, and Shell scripts for various companywide tasks
- Well versed with Software development (SDLC), Test life cycle (STLC), and Bug life cycle and worked with testing methodologies like a waterfall and the agile methodology (SCRUM) with an in-depth understanding of the principles and best practices of Software Configuration Management (SCM).
Environment: AWS, EC2, RDS, ELB (Elastic Load Balancing), S3, Cloud watch, Cloud Formation, Route53, Lambda, MAVEN, Nexus, Chef, Terraform, Jenkins CI/CD, Nagios, Jira, SHELL, Python, VPC, Autoscaling, Apache, JBoss, Nginx, Tomcat, GIT, Docker, Kubernetes, GCP, Service now, Cassandra, Kafka, Blue/green deployment.
Confidential, NYC, NY
DevOps/Build and release Engineer
Responsibilities:
- Responsible for building the projects and deploying in DIT, SIT and UATs
- Worked in CI tool (Jenkins) to create jobs and do continuous integration for auto builds and creation of pipeline
- Responsible for build and maintenance of scripts for the projects using Maven and shell scripts
- Worked on automating the process of build and deployment (for example, RLM-Release Lifecycle Management where the automated process of deploying in servers, creating CRs in Service now etc once the build is triggered through Jenkins)
- Created a data pipeline through Kafka Connecting two different clients Applications namely SEQUENTRA and LEASE ACCELERATOR
- Assisted in migrating applications from customer on-premises datacentre to the cloud (AWS).
- Well versed in managing source code repositories like Git, GitHub, bit bucket.
- Working for DevOps Platform team responsible for specialization areas related to Chef for Cloud Automation.
- Used Ansible to manage Web applications, Environments configuration Files, Users, Mount points and Packages.
- Successfully Generated consumer group lags from kafka using their API Kafka- Used for building real-time data pipelines between clusters.
- Configure and administer Git source code repositories.
- Integrated Apache Kafka for data ingestion.
- Develop and implement an automated Linux infrastructure using Ansible.
- Worked on vagrant for configure lightweight, reproducible, and portable development environments.
- Implemented Chef Recipes for Deployment on build on internal Data Centre Servers. Also re-used and modified same Chef Recipes to create a Deployment directly into Amazon EC2 instances.
- Worked on AWS AIM, which included managing application in the cloud and creating EC2 instances
- Expertise in Azure infrastructure management (Azure Web Roles, Worker Roles, SQL Azure, Azure Storage, Azure AD Licenses, Office365) Worked on Cloud automation using AWS Cloud Formation templates.
- Experience managing Kafka clusters both on Windows and Linux environment.
- Experienced in Azure IaaS, Provisioning VM's, Virtual Hard disks, Virtual Networks, Deploying Web Apps and Creating Web-Jobs, Azure Windows server Microsoft SQL Server, Microsoft Visual Studio, Windows PowerShell, Cloud infrastructure.
- Used Jenkins, Code Deploy for CI/CD pipelines
- Used chef for server provisioning and infrastructure automation in a SAAS environment.
- Worked on various Docker/Kubernetes components like Docker Engine, Hub, Machine, Compose and Docker Registry.
- Maintained high availability clustered and standalone server environments and refined automation components with scripting and configuration management (Ansible).
- Communication with team members for both Ansible Core and Ansible Tower teams to clarify requirements and overcome obstacles.
- Worked with different Tools like Rally, Jira, Bugzilla, Bit Bucket and Remedy.
- Developed pom.xml files for Maven build scripts.
- Knowledge in cloud computing services like IaaS, PaaS, and SaaS and coming trends in the Cloud space.
- Involved Release management planning activities for the complete project
- Worked in Agile methodology / Scrum team
- Worked in PCF (Pivotal Cloud Foundary) and created org and spaces for deployments.
- Cloud watch, IAM &Roles, SNS subscription service.
- Experience using Identity and Access Management (IAM) to design policies, create roles and manage users and groups.
- SCM: Managed Git, Bitbucket, RTC and ClearCase
- Utilized Java, Eclipse/ J2EE, tested programing code & Applications, collaborated with team and management.
- Sonar implementation and Junit continuous testing with Vulnerability assessment testing
- Basic knowledge in java development, spring boot using STS and J2EE application
- Basic knowledge in creating Microservices
- Worked as a deployment engineer for the Production, FUT and UAT deployments for the code developed
- Solid experience in ServiceNow for CRs, INCs and REQs for changes in application
- Have experience in using version control Tools IBM Rational ClearCase.
- Sole responsible ClearCase merging activities and acted as ClearCase admin in experience.
- Sole responsible in Product Integration team in RTC merging activities between multiple branches of dev code and acted as RTC administrator
Environment: Subversion (SVN), Bitbucket, Chef, Apache ANT, Maven, Web Sphere Application Server, Tomcat, Perl Scripts, Shell scripts, Jenkins, AWS, Nexus.
Confidential
Build and Release Engineer
Responsibilities:
- Responsible for scheduling release promotions to Test, Training, Validation, Production and DR environments and preparing release Notes.
- Used Jenkins innovatively to automate most of the build related tasks. Improved throughput and efficiency of build system by providing EO/managers rights to trigger required build .
- Administered servers and Jenkins which includes install, upgrade, backup, adding users, creating plans, installing local/remote agent, adding capabilities, performance tuning, troubleshooting issues and maintenance.
- Initiated responsibility for administering the SVN and GIT servers which included install, upgrade, backup, adding users, creating repository/branches, merging, Writing hooks scripts, performance tuning, troubleshooting issues and maintenance.
- Installed Kafka manager for consumer lags and for monitoring Kafka Metrics also this has been used for adding topics, Partitions etc.
- Maintenance of source-code repository through SVN and Deployment code through GIT repository.
- Designed and scripting using ANT & MAVEN for (J2EE, Web Services, Reusable JARS, Web Client and Open Source) in creating MasterBuild.xml, Build . Properties &Pom.xml files and provided technical support to development team for compilation problems.
- Used MAVEN as a build tools on Java projects for the development of build artifacts on the source code.
- Used ANT Scripts and Shell scripts to automate deployment process.
- Worked extensively in PowerShell and UNIX for workflow automation across various teams from DEV to UAT to Production.
- Successfully Generated consumer group lags from Kafka using their API.
- Installed and configured Kafka Cluster.
- Installed and Configured Hortonworks Data Platform (HDP) and Apache Ambari.
- Proficient in deploying and support applications on WebSphere, Tomcat, WebLogic application servers Used Shell/Perl scripts to automate the deployment process.
Environment: GIT, SVN, Jenkins, Ant, Maven, Java, PowerShell, UNIX, WebSphere, Tomcat, WebLogic, Shell scripts.