Aws Engineer Resume
New York City, NY
SUMMARY
- Over 8+ years of result - oriented IT experience in Development, Automation Testing, Release Management and AWS.
- Experienced in working as AWS Developer, writing microservice programs and working with code pipelines.
- Experienced in working on DevOps/Agile operations and tools area (Build & Release Automation, Environment Service).
- Experienced in AWS lambda, AWS Glue, mostly using python as primary programming language, with python libraries like NumPy Pyspark and Pandas.
- Experienced in Cloud automation using AWS Cloud Formation templates. Experience in Amazon Web Services EC2, ELB, S3, Route 53, EBS, VPC, AMI, SNS, RDS, Auto Scaling, etc.
- Experienced in writing SQL queries for creating reports.
- Experience in using Configuration management software's like Chef, Puppet and Ansible for Automation.
- Assist in designing, automating, implementing and sustainment of Amazon machine images (AMI) across the AWS Cloud environment
- Ability to identify and gather requirements to define a solution to be built and operated on AWS.Understanding of service-oriented architecture (REST APIs, micro-services, etc.) and developed code to make API calls.
- Implemented a'server less'architecture usingAPI Gateway, Lambda, and Dynamo DBand deployedAWS Lambda codefrom Amazon S3 buckets. Created a Lambda Deployment function and configured it to receive events from your S3 bucket.
- Rich experience in using Jenkins, Deploy, Octopus Deploy, Bamboo as Continuous Deployment tools to setup automated and scheduled deployments.
- Experienced with Bug tracking tool like JIRA, Bugzilla, and Remedy.
- Implementing new projects builds framework using Jenkins & maven as build framework.
- Implementing a Continuous Delivery framework using Jenkins, Chef, and Maven & Nexus in Linux environment.
- Have done Requirements gathering, Design, Development, Implementation, Migration, testing for various ETL implementations using Informatica. Worked extensively and designed ETL solutions using sources like Oracle, SQL, JD Edwards, Siebel ERP, SQL, and AWS S3.
- Designed the Mapping Template in the Microsoft Visio by using MAV (Mapping architect for Visio) plug-in in order to generate Informatica Stencils in Visio.
- Design dimensional model, data lake architecture, data vault 2.0 on Snowflake and used Snowflake logical data warehouse for compute.
- Experience with Snowflake Multi-Cluster Warehouses.
- Experience with Snowflake Virtual Warehouses.
- Configured Git with Jenkins and schedule jobs using POLL SCM option
- Experimented with Docker, by using Docker-compose.
- Worked on infrastructure with Docker containerization.
- Hands on experience in container-based technologies Kubernetes, Docker and ECS.
- Developed microservice on boarding tools leveraging Python and Jenkins allowing for easy creation and maintenance of build jobs and Kubernetes deploy and services.
- Experience with CI/CD in containerized micro services environment.
- Write terraform scripts from scratch for building Dev, Staging, and Prod and DR environments.
- Worked with Terraform key features such as Infrastructure as a code, Execution plans, Resource Graphs and Change Automation.
- Experience in Converting existing AWS Infrastructure to Server less architecture (AWS Lambda, Kinesis), deploying via Terraform and AWS Cloud Formation templates.
- Defined AWS Lambda functions for making changes to Amazon S3 buckets and updating Amazon DynamoDB table.
- Created functions and assigned roles in AWS Lambda to run python scripts, and AWS Lambda using java to perform event driven processing. Created Lambda jobs and configured Roles using AWS CLI.
- Experience in using Jenkins as continuous integration tool to creating new jobs, managing required plugins, configuring the jobs selecting required source code management tool, build trigger, build system, and post build actions, scheduled automatic builds, notifying the build report.
- Good experience in developing web applications implementing Model View Control architecture using Django, Flask, Pyramid and Zope Python web application frameworks.
- Good Experience with Django, a high - level Python Web framework.
- Experienced in LAMP (Linux, Apache, MySQL, and Python/PHP) Architecture.
- Experience in object-oriented programming (OOP) concepts using Python, C++, Java, and Django.
- Proficient with container systems like Docker and container orchestration like EC2 Container Service, Kubernetes, worked with Terraform.
- Managed Docker orchestration and Docker containerization using Kubernetes.
- Used Kubernetes to orchestrate the deployment, scaling, and management of Docker Containers.
- Utilized Kubernetes for the runtime environment of the CI/CD system to build, test deploy.
- Setting up OpsCenter for the Monitoring. Monitoring review and enhancement for system, application, Docker, and Cassandra.
- Experience working on Azure Fabric, Micro services & Docker containers in Azure.
- Hands on experience in the design, implementation and support of automated Containerized Infrastructure using Kubernetes.
- Solid experience in deploying applications to Kubernetes using Helm Charts, created reproducible builds of the Kubernetes applications, managed Kubernetes manifest files and managed releases of Helm Packages.
- Experience on Cloud Automation using AWS Cloud Formation Templates, Terraform, Chef and Puppet.
- Implemented Terraform modules for deployment of applications across multiple cloud providers.
- Experience in Converting existing AWS infrastructure to Server less architecture (AWS Lambda, Kinesis), deploying via Terraform and AWS Cloud Formation.
- Experienced with event-driven and scheduled AWS Lambda functions to trigger various AWS resources and worked on Lambda for triggering events with cloud watch using Lambda functions.
- Extensively worked on Spark using Scala on cluster for computational (analytics), installed it on top of Hadoop performed advanced analytical application by making use of Spark with Hive and SQL/Oracle.
- Hands on experience in developing SPARK applications using Spark tools like RDD transformations, Spark core, Spark MLlib, Spark Streaming and Spark SQL.
- Strong experience and knowledge of real time data analytics using Spark Streaming, Kafka, and Flume.
- Experience managing Kafka clusters both on Windows and Linux environment. Knowledge of Kafka API.
- Setting up and configuring Kafka Environment in Windows from the scratch and monitoring it.
- Created a data pipeline through Kafka Connecting two different clients Applications namely SEQUENTRA and LEASE ACCELERATOR.
- Configured Inbound/Outbound in AWS Security groups according to the requirements.
- Experienced in Bash, Python, Ruby scripting on Linux.
- Experienced in Branching, Merging, Tagging, and maintaining the version across the environments using SCM tools like GIT and Subversion (SVN) on RHEL and Ubuntu platforms.
- Integration, deployment, and automation of application service
- Created Cloud Formation templates and deployed AWS resources using it.
- Dockized applications by creating Docker images from Docker file.
- Expertise in utilizing almost the entire AWS stack (including EC2, ECS, ELB, Route53, S3, RDS, SNS, SQS and IAM) focusing on high-availability, fault tolerance, and auto scaling.
- Monitoring the instances using the CloudWatch Alarms
- Expertise using the Lambda for the AWS services automation.
- Extensively worked on CI/CD pipeline for code deployment by engaging different tools (Git, Jenkins)
- Hot and cold Backup and recovery of oracle 10/11g database using RMAN.
- Scheduling of oracle database backup using RMAN.
- Managed database using command line as well as 11g OEM.
- Excellent working knowledge with database monitoring tools such as TOAD, OEM, etc.,
- Experience with V model and Agile Scrum methodology.
TECHNICAL SKILLS
Operating Systems: CentOS 5.x 6.x 7.x, RHEL 5.x, 6.x, Sun Solaris 8,9,10, Windows 98/XP/NT/ 2000/2003/2008 , NT 4.0, 2000 Servers, Workstation, Mac, various flavors of UNIX and LINUX
AWS Cloud Services: EC2, Lambda, S3, Glacier, RDS, DynamoDB, Elasitcache, Redshift, VPC, CloudFront, Direct Connect, Route53, Code Commit, Code Deploy, CloudWatch, CloudTrail, IAM, Manager, Data-Pipeline, EMR, SQS, SNS etc.
Programming and Scripting Languages: C, C++, Core Java, SQL, HTML, Java/J2EE, Shell, PowerShell, Bash, Ruby, Perl and Python scripting.
CI/CD Tools: Hudson, Jenkins, Bamboo, Puppet, Chef, Hiera, AnthillPro, Ansible, Vagrant, Build Forge, Deploy, Octopus Deploy.
Database: Oracle 8.x/9.0, 11g, 12C, MS SQL Server 2000, MS Access, MySQL, NoSQL, MongoDB, Cassandra.
Networking: Load balancers, TCP/IP, HTTP/HTTPS, SNMP, NFS, FTP, SFTP, Telnet, SSH, SSL.
Cloud: AWS EC2, VPC, EBS, AMI, SNS, RDS, ECS, EBS, CloudWatch, CloudFormation AWS Config, S3, Cloud Trail, IAM, Azure, OpenStack, VMWare.
Development and Build Tools: Make, JBOSS, Apache Maven, Apache Ant to write Pom.xml and Build.xml.JIRA, Junit, Rally, Fisheye, Remedy, Crucible, IBM Clear Quest, Bugzilla.
PROFESSIONAL EXPERIENCE
AWS Engineer
Confidential, New York City, NY
Responsibilities:
- Worked with IAM service creating new IAM users & groups, defining roles and policies and Identity providers.
- Configure AWS IAM and Security Group in Public and Private Subnets in VPC.
- Experience in implementing, administering, and monitoring toolsSplunk,Nagios, Console, Netcool, Graphiteandbuilding, deployingJava and SOA applicationsand troubleshooting the build and deploy.
- Create plan and deployNagios and Netcoolmonitoring server environment
- Developed standalone java component viz., Smart COMM which is a xml file generator by taking input data described in a flat file and generate an xml file in a format defined by a prescribed xsd document.
- Experience in setting up thegateway proxy (squid) in the production environment.
- Design of Streaming Data solutions using AWS IoT Platform, Amazon Kinesis, S3, Aurora, Lambda, API Gateway
- REST API Design using Swagger and API Management AWS API Gateway
- Built micro services using API gateway.
- Performance tuning of the Informatica mappings using various components like Parameter files, Variables and Dynamic Cache.
- By using Informatica BDM refined the data with the scope of delta processing and for the cleansing the data from S3 Raw to S3 Refine.
- Involved in designing and deploying multitude applications utilizing almost all the AWS stack (Including EC2, Route53, S3, RDS, Dynamo DB, SNS, SQS, IAM) focusing on high-availability, fault tolerance, and auto-scaling in AWS Cloud Formation.
- Worked with the Spark for improving performance and optimization of the existing algorithms in Hadoop using Spark Context, Spark-SQL, Spark MLlib, Data Frame, Pair RDD's, Spark YARN.
- Used Spark Streaming APIs to perform transformations and actions on the fly for building common learner data model which gets the data from Kafka in near real time and persist it to Cassandra.
- Used Kafka functionalities like distribution, partition, replicated commit log service for messaging systems by maintaining feeds.
- Used Apache Kafka to aggregate web log data from multiple servers and make them available in downstream systems for Data analysis and engineering type of roles.
- Successfully Generated consumer group lags from Kafka using their API Kafka- Used for building real-time data pipelines between clusters.
- Developed data warehouse model in snowflake for over 100 datasets using whereScape.
- Heavily involved in testing Snowflake to understand best possible way to use the cloud resources.
- Used NiFi to ping snowflake to keep Client Session alive.
- Build servers using AWS, importing volumes, launching EC2, RDS, creating security groups, auto-scaling, load balancers (ELBs) in the defined virtual private connection.
- Created AWS Route53 to route traffic between different regions.
- Leveraged AWS cloud services such as EC2, auto-scaling, and VPC to build secure, highly scalable, and flexible systems that handled expected and unexpected load bursts.
- Used AWS Beanstalk for deploying and scaling web applications and services developed with Java, PHP, Node.js, Python, Ruby, and Docker on familiar servers such as Apache, and IIS.
- Understanding of secure cloud configuration, (Cloud Trail, AWS Configuration), cloud-security Technologies (VPC, Security Groups, etc.) and cloud-permission systems (IAM).
- Created alarms and trigger points in Cloud Watch based on thresholds and monitored logs via metric filters.
- Utilized AWS cloud watch to monitor the performance environment instances for operational and performance metrics during load testing.
- Designed AWS Cloud Formation templates to create custom sized VPC, subnets, NAT to ensure successful deployment of Web applications and database templates.
- Implemented automated local user provisioning instances created in AWS cloud.
- Setup and build AWS infrastructure various resources, VPC EC2, S3, IAM, EBS, Security Group, Auto Scaling, and RDS in Cloud Formation JSON templates.
- Maintained the user accounts (IAM), RDS, Route 53, VPC, RDB, Dynamo DB, SES, SQS and SNS services in AWS cloud.
- Manage AWS EC2 instances utilizing Auto Scaling, Elastic Load Balancing and Glacier for our QA and UAT environments as well as infrastructure servers for GIT and Chef.
- Created customized AMIs based on already existing AWS EC2 instances by using create image functionality, hence using this snapshot for disaster recovery.
- Created AWS Laun5ch configurations based on customized AMI and use this launch configuration to configure auto-scaling groups and Implemented AWS solutions using EC2, S3, RDS, Dynamo DB, Route53, EBS, Elastic Load Balancer, Auto-scaling groups.
Environment: AWS (EC2, S3, VPC, Route53, EBS, RDS, ELB, Kafka, Spark, Terraform, CloudWatch, CloudFormation, AWS CLI, AWS Auto Scaling), Chef, Unix/Linux, Python, Ruby, Shell scripting.
AWS Engineer
Confidential, Buffalo, NY
Responsibilities:
- Involved in designing and deploying multiple applications using the almost all the AWS cloud infrastructure focusing on high availability, fault tolerance and auto-scaling of the instances
- Configured Elastic Load Balancers with EC2 Auto Scaling groups based on memory, CPU to adapt to unforeseen spikes without having an outage or needing manual intervention, Architect and design AWS Private Cloud Subnets, Security Groups, Network Access Controls, configure Load Balancing for application high availability as well as performance.
- Created Amazon Virtual Private Cloud in the scalable environment which provides advanced security features such as security groups and network access control lists to enable inbound and outbound filtering at the instance level and subnet level.
- Written Cloud Formation Templates (CFT) in JSON and YAML format to build the AWS services with the paradigm of Infrastructure as a Code.
- Develop CI/CD Pipelines for automated prod deployments in AWS by integrating with other systems like Bamboo, Chef and HP Service Manager using REST APIs
- Rolled out Chef to all servers and used the Chef Node database to drive host configuration, DNS zones, monitoring, and backups.
- Designed and Developed Bamboo Build deployments on Docker containers.Installed Docker Registry for local upload and download of Docker images and even from Docker hub. Virtualized the servers using the Docker for the test environments and dev-environment needs.
- Implemented rapid-provisioning and life-cycle management for Ubuntu Linux using Amazon EC2, Chef, and custom Ruby/Bash scripts.
- Converted the SVN repository to a local Git repository and shared the repository with the developers via Bitbucketand migrated the development efforts from SVN to Git.
- Configured network and server monitoring using Grafana, ELK Stack with Log spout & Nagios for notifications and Using ELK (Elastic Search Log Stash Kibana) stack for log management and Creating Kibana visualizations to analyze the logs.
Environment: AWS (EC2, S3, VPC, ELB, RDS, EBS, Cloud Formation, Cloud watch, AMI), Docker, Chef, ANT, Maven, Git, SVN, Jira, Bash, Shell, Python, Ruby, Tomcat, WebLogic, Auto- Scaling, Route53, DNS.
AWS Admin/Developer
Confidential, Owings Mills, MD
Responsibilities:
- Responsible for Architecting Multi-Availability Zone Components in AWS like EC2, IAM, VPC, RDS with Replication, S3 for Object and Static Web pages, Auto Scaling of Services like ECS, ELB with SSL Cert and worked on AWS Route53 for registering domain names and to route internet traffic for domains and monitor the health checks of the resources.
- Designed AWS CloudFormation templates using JSON to create customized VPC Subnets, NAT to ensure successful deployment of Web applications and databases. Also creating cross-account IAM roles and giving access to users.
- Knowledge about setting up Python REST API Framework using Django.
- Experience in working with Python ORM Libraries including Django ORM.
- Build servers using AWS, importing volumes, launching EC2, RDS, creating security groups, auto-scaling, load balancers (ELBs) in the defined virtual private connection.
- Created AWS S3 Bucket-Policies for restricted user access and allow AES-256 encryption only uploads. And Monitoring Live Traffic, logs, Memory utilization, Disk utilization and various other factors like deployment and configuring S3 bucket.
- Implemented AWS high availability of web applications using Elastic Load Balancer (ELB), which performed balance across instances in multiple availability zones. Used CloudFront to deliver content from AWS edge locations to users, allowing for further reduction of load on front-end servers.
- Used AWS Lambda to Automate log handling process for blacklisting bad IPs in AWS Web Application Firewall (WAF)
- Performed POC on migration of data from AWS to GCP using Data Migration Service, Server Migration Service and developed an VPN IPSec tunnel for smooth migration between different clouds.
- Set up a GCP Firewall rules to allow or deny traffic to and from the VM's instances based on specified configuration and used GCP CDN (content delivery network) to deliver content from GCPcache locations drastically improving user experience and latency.
- Designed and implemented JSON templates (used python and schema) and deployed through deployment manager, which provisions infrastructure with a code in GCP.
- Authored Terraform template and deployed it in cloud deployment manager to spin up resources like cloud virtual network, compute engines in public subnets and private subnets using Auto-Scaler & ordering of new firewall rule for cloud service.
- Experience with working on rolling updates using the deployments feature in Kubernetes and implemented BLUE GREEN deployment to maintain zero downtime.
- Created Kubernetes cluster with cloud formation templates and deploy them in AWS environment and monitoring the health of pods using Helm Charts.
- Maintained several pods and services using Master and Minion architecture of Kubernetes and worked on manifest files to set properties for the Kubernetes cluster.
- Used Docker to virtualize deployment containers, pushed the code to EC2 and built additional Docker Slave nodes for Jenkins using custom-built Docker images and instances and created Docker images using a Docker file, worked on Docker container snapshots, removing images and managing Docker volumes.
- Worked on several Docker components like Docker Engine, Hub, Machine, Compose and Docker Registry. Created multiple Containers with Specific Run Times and Proxying using NGINX for Virtual Hosting of Multiple Containers in Single Docker Host.
- Created and troubleshoot Ansible scripts and Kubernetes YAML files to deploy SCM/CI/CD applications automatically and Idempotently to reduce time costs.
- Worked on Ansibleto manage all existingserversand automate thebuild/configurationof newservers and writing various custom Ansible Playbooks for deployment orchestration.
- Installed and configured Chef Server Bootstrapped Nodes, Created Run lists, Generated Custom Cookbooks using Resources, used Test Kitchen Vagrant/Docker and Knife utility to automate Cloud-Config Management Tasks.
- Creating and Implementing branching and merging strategy with multiple branches. Used Git as source code management repository to keep track of version changes. Coordinate/assist developers with establishing and applying appropriate branching, labeling/naming conventions using GIT, Bitbucket source control.
- Managed Jenkins plugins for Tests, Reports, Notification, Users Authorization & Deployment and implemented several CI / CD plugins like build pipeline, Git, JUnit and pipeline plugin.
- Collaboration in the automation of AWS infrastructure via terraform, Ansible, and Jenkins - software and services configuration via chef cookbooks and written wrapper scripts to automate the deployment of Chef cookbooks on nodes and running the chef-client on them in a Chef-Solo environment.
- Integrated SonarQube with Jenkins for continuous inspection of code quality and analysis with SonarQube scanner for Maven.
- Deployed and configuredElasticsearch,LogstashandKibana (ELK)for log analytics, full text search, application monitoring in integration withAWSLambdaandCloudWatch. Then store that logs and metrics into S3 bucket using Lambda function.
- Used ELK stack with extensive knowledge on Logstash with its integration to Splunk. Used Elastic for maintaining stateful data.
- Developed the automated build and deployment using Maven and Jenkins using Apache, Tomcat as the application server.
- Written various Automation Scripts to automate manual tasks, deploy applications, application build scripts/versioning etc. using many popular open-source libraries with different languages like Shell and Python-based scripting.
- Used Bug tracking tool like JIRA for ticketing, Integrating into Splunk Enterprise and Bug Reporting for products through JIRA.
Environment: AWS, AWS CLI, GCP, Kubernetes, Docker, Jenkins, JIRA, VPC, NAT, S3, EC2, CloudWatch, Web Servers, Apache Tomcat, NGINX, ELB, CloudFront, EC2, Shell Scripts, Terraform, Cloud Formation, Docker, Ansible, GIT, MAVEN, Jenkins, Bit-bucket, SonarQube, Nexus, Python, Elastic Search, Groovy, Kibana, JSON.
AWS Admin/Developer
Confidential, Raleigh, NC
Responsibilities:
- Involved in implementation of migration strategy from existing data center to AWS in addition involved in migration of user profiles to AWS roles.
- Designed and implemented user data migration to EC2 instances.
- Involved in creating necessary user role creation.
- Implemented AWS solutions using S3, RDS, EBS, Elastic Load Balancer, and Auto scaling groups.
- Configured S3 versioning and lifecycle policies to and backup files and archive files in Glacier.
- Configured Elastic Load Balancers (ELB) and Auto scaling groups.
- Created monitors, alarms, and notifications for EC2 hosts using Cloud Watch.
- Scripting in multiple languages on UNIX, LINUX using Python, Shell script
- Used Python AWS SDK for dynamic creation of EC2 instances.
- Troubleshoot the build issue during the Jenkins build process.
- Resolved system issues and inconsistencies in coordination with quality assurance and engineering teams.
- Source version control using Git.
- Automate Datadog Dashboards with the stack through Terraform Scripts.
- Worked with Python, MYSQL, CSS, JavaScript, AJAX, and XHTML to build a fully Web 20 compliant.
- Developed applications using the Django framework using Jinja templating system.
- Performed documentation and user .
- Wrote multi-thread scripts to obtain optimal performance.
Environment: PYTHON, MySQL, CSS, JavaScript, AJAX, HTML/XHTML, Terraform, XML, Django framework, Git, AWS EC2, AWS S3, AWS RDS, AWS EBS, Python, Jenkins, Apache, Linux
Aws Admin
Confidential, Atlanta, GA
Responsibilities:
- Implemented and maintained monitoring and alerting of production and corporate servers such as EC2 and storage such as S3 buckets using AWS Cloud Watch.
- Experience in automated deployment of EC2 instances in data centers and availability zones.
- Used security groups to develop a logical firewall to ensure high security for control applications.
- Used Amazon IAM to grant fine access of AWS resources to users. Also managed roles and permissions of users to AWS account through IAM.
- Used Cloud Front to deliver content from AWS edge locations to users, allowing for further reduction of load on front-end servers.
- Set up Auto Scaling Groups based on memory and CPU to adapt to unforeseen spikes without having an outage or needing manual intervention.
- Set up Elastic Load Balancers for different applications to ensure high availability of applications.
- Used Amazon S3 to backup database instances periodically to save snapshots of data.
- Used Amazon Route53 to manage DNS zones and give public DNS names to elastic load balancers Ip’s.
- Used Cloud Watch logs to move application logs to S3 and create alarms raised by applications.
- Configured an AWS Virtual Private Cloud (VPC) and Data Base subnet group for isolation of resources within AWS RDS.
- Used Amazon RDS Multi-AZ for automatic failover and high availability at the database tier for MYSQL workloads.
- Configured S3 Versioning and Life Cycle Policies to backup files and archive files in Glacier.
- To design high availability applications on AWS across Availability Zones and availability regions.
- Trained a group of employees about infrastructure management using AWS Management Console.
- Developed and supported the Red Hat Enterprise Linux based infrastructure in the cloud environment.
- Hands on experience with Chef in AWS Cloud environment
- Designed continuous delivery tools/ configuration management tools like Puppet.
- Installed, configured, and managed Puppet Master and Agent.
- Written CHEF cookbooks for various configurations to modularize and optimize product configuration.
- Installed workstation, bootstrapped nodes, wrote recipes, cookbooks, roles, and environments and uploaded them to chef server.
- Maintaining the required cookbooks and recipes by downloading the latest versions from SUPERMARKET.
- Configured and administered Jenkins for continuous integration and deployment into Tomcat Application Server and to improve reusability for building pipelines.
Environment: AWS (EC2, VPC, ELB, S3, RDS, Cloud Formation, Cloud Watch, Cloud Trial, Route 53), Linux, Chef, Jenkins, Puppet, Shell Scripting.
