Devops/ Data Engineer Resume
NJ
SUMMARY
- Overall, 10 Years of Experience in IT industry as Linux System administration, DevOps Engineer, Build Automation, Continuous Integration, AWS, and DevOps.
- Automate the activities using Power Shell scripting.
- Maintaining GIT repositories, handling releases, scanning and branching activities for GIT, VSTS, Azure DevOps, Jenkins.
- Having experience in creating branching and tagging activities in Version control like GIT.
- Experience in Ansible to cloud provisioning, Configuration Management, application deployment in DevOps and IT environment.
- Experience In Azure services like Active Directory, Virtual Machine, Virtual Network, Key Vault, Site Recovery, Backup, File Sync, Traffic Manager, Load Balancer, Auto Scaling, NSG, Blob Storage, Azure Storage, Azure DNS, CDN, Azure insights.
- Experience in kernel scheduling to determine the threads should be executed by CPU.
- Involved in memory management like RAM and virtual memory allocating hierarchies, page tables, memory mapping.
- Used data persistence for various storage databases like file systems, cloud storage devices and in - memory caches.
- Proficient in Power shell to create resources like Web apps, storage accounts, virtual machines.
- Collaborated with AWS/ Azure, tools and assisted in building the infrastructure or various web applications documentation and security assessment.
- Experience in containerization and orchestration tools like Docker, Kubernetes
- Mentored deployment patterns for the application using canary deployment using the new version of performance, stability, and metrics like performance indicators and response time, error rates.
- Involved in creating specifications for ETL processes, finalized requirements, and prepared specification documents.
- Educating the development team about the usage of Azure in creating resources, accessing VM, storage account, web app which helps in leveraging the usage of entire tools.
- Handling all the releases such as Maintenance Release and Launch of New Projects.
- Experience in AWS services like EC2, S3, Cloud Watch, SNS, SQS, SES, Lambda, Cloud Formation, Load Balancer, EFS, EBS, Security Groups.
- Proven experience on continuous build and deployments to multiple environments like Dev, QA, UAT.
- Used Azure DevOps CI/CD pipelines to build and release ETL and database objects.
- Experience in Windows/ Linux system Admin (Red Hat Enterprise Linux)
- Familiar with TCP/ IP networking firewall, WAN, Switching and routing.
- Experience in Cloud provisioning and management using Terraform, ARM Templates, Cloud Formation Templates.
- Experience in security scanning tools like sonar cloud/ Sonar Qube.
- Creation of S3 events to allow alerting on object actions in S3.
- Enabling VPC flow logs and providing them with permissions to create log streams and ingest events.
- Creating rules in AWS config and implementing remediation using Lambda functions.
- Including custom rules as a part of SAST scanning to check for business flow logic and ensure easy debugging.
- Extensively worked on Jenkins for continuous integration and End-to-End automation for all builds and deployments.
- Used Kubernetes to deploy scale, load balance, scale and manage docker containers with multiple namespace versions.
- Implement CI/ CD tools upgrade, Plugin management, Backup, Restore, LDAP and SSL setup.
- Development of automation of Kubernetes clusters via playbook in ansible.
TECHNICAL SKILLS
Languages: JSON, YAML, Groovy, Terraform, Shell, Bash & Python
Operating Systems: RedHat Linux 4/5/6/7, CentOS 5/6/7, Windows Servers 2003, 2008, 2008 R2, 2012, 2012 R2, Windows 2000, XP, 7, Cloud Services
Build Tools: Maven, Ant, Docker
Versioning Tools: GIT, GitHub, Gitlab, Bitbucket
Amazon Web Services: EC2, S3, VPC, AWS SFTP, SNS, SES, Route53, Cloud Watch, Cloud Trail, IAM, SQS, Lambda, ECS, EKS, RDS, AWS CLI, Cloud Front.
Monitoring Tools: Cloud Watch, Nagios, Grafana, Prometheus, AppDynamics Splunk, New Relic
Cloud Services: Amazon Web Services
Application Servers: Apache, Tomcat, JBoss
CI/CD Tools: Gitlab, Git, Bamboo, SonarQube, White Source, Chef, Docker, Kubernetes, Ansible, Nexus, Jfrog, Veracode
Other Tools: Network Protocols WinSCP, SSH, VPN
Virtualization: VMware Client, Virtual Box, Vagrant
Database Technologies: Oracle, MySQL, NoSQL, MongoDB, Cassandra, DynamoDB
PROFESSIONAL EXPERIENCE
Confidential, NJ
DevOps/ Data Engineer
Responsibilities:
- Defining and implementing IAM roles, generating tokens, assigning roles to Dev, QA team.
- Clean and organized source repository, upgrade version for compatibility, application requirements.
- Integrated confluence document, JIRA, Bitbucket, Jenkins for build, test and release environment.
- Supervised Build & Release process which includes Code Compilation, Packaging, Security Scanning and code quality scanning, Deployment methodology and application configurations.
- Built an ETL monitoring framework for managing pipeline executions, diagnosing issues, and alerting the support team.
- Based on the observations and metrics collected during the canary deployment we can decide for roll-back deployment.
- Migrate the ETL logic, which was currently running in SSIS and MS Access, by Azure Pipeline in the Azure data factory without any change in business logic.
- Experience worked on SSIS parallelism and multithreading features to increase performance and decrease ETL duration.
- Created custom SSIS ETL Framework for loading Data Warehouse with restart ability logic and using DQS and MDM utilities for applying business rules.
- Performed ETL operation using Data Factory and Data Bricks and loaded the data into Azure SQL DW.
- Referred to the high-level design from monolithic applications to microservices applications for Software Architecture.
- Communicated with well-defined API’s using lightweight protocols such as HTTP or messaging systems in Software Architecture.
- Define Release process & policy for projects in SDLC and responsible for source code build, analysis and deploy configuration.
- Worked closely with Development, Operations team, and project management to create build and deploy jobs across multiple environments.
- Created a data pipeline which ingests route data, mentor data and by creating a glue workflow and leveraging Azure pipelines.
- Setup Kubernetes clusters for running microservices and pushed microservices into production with Kubernetes backed infrastructure.
- Assisted in the integration of Dev SecOps pipeline components to include, using a code repository, an artifact repository, security assessment platform and orchestration integration and delivery platform to enable automated applications for building, testing, security, and deployment.
- Supervised built-in load balancing, service discovery and rolling updates in Docker Swarm.
- Designed and integrated the capabilities to establish a Dev SecOps pipeline, utilizing lab and cloud resources to design, build, test and evaluate functional components and technologies.
- Facilitated Twist Lock, Sonar Qube in scanning container images.
- As a part of reverse engineering discussed issues/ complex code to be resolved and translated them into Informatica Logic and prepared ETL design documents.
- Selected the appropriate security controls needed for the information systems in Dev SecOps.
- Performed dynamic analysis for web server using Niko to scan for files/ programs, weak configurations.
- Utilized SSL to analyze the SSL configurations of web applications to check for vulnerabilities such as weak cipher suites, insecure negotiation.
- Scanning OWASP top 10 web applications using Burp suite.
Confidential, TN
Dev SecOps Engineer
Responsibilities:
- Worked as an active team member for both product development and operations team to provide the best DevOps practices and supported their applications with feasible approaches.
- Implemented docker to provision slaves dynamically as needed. Created and maintained docker files in source code repository build images and ran container for applications and testing purposes.
- Worked on Ansible modules to deploy Docker services on the Docker Swarm cluster for entire microservices stack.
- Designed application networking for microservice architecture like service-service communication, synchronous service discovery, load balancing API gateway, network segmentation and security.
- Focused on containerization and immutable infrastructure.
- Experience in Docker hub along with Kubernetes, using docker swarm deployed java spring boot applications.
- Installed docker registry for upload and download of docker images even from docker hub.
- Managed docker orchestration using Docker swarm.
- Developed a unified interface and set of tools for deploying, scaling, and managing applications in a data center environment.
- Templates using AWS serverless application model and deploy RESTFUL API’s using API gateway and triggering lambda functions.
Confidential, TX
DevOps Engineer
Responsibilities:
- Experience in setting up the notification hub with other services in Azure Cloud. Created route tables in V-net to divert the traffic to machines.
- Experience in provisioning SAAS, PAAS, & IAAS through power shell, python in Azure.
- Created and worked on Azure pipelines in YAML for CI/ CD automation process and scheduled the pipelines to run.
- Deploying applications with Istio for intelligent routing and traffic management, service resilience, distributed tracing and multi-cluster, hybrid deployments.
- Experience working on Azure Kubernetes Service (AKS) and Azure Container Registry (ACR) implemented monitoring on all the pods and nodes using Grafana.
- Using the Helm package for complex packages.
- Integration of SAST and DAST tools with Jenkins in Agile Development Process.
- Setup Kubernetes cluster for running microservices and pushed into production with Kubernetes backed infrastructure, development of automation of Kubernetes clusters via playbooks in Ansible.
- Experience in Azure services like V-net, Subnets, Active Directory, Storage accounts, Azure Service bus, Azure web app.
- Used docker images in Jenkins for database and Windows Automation instead of physical slaves.
- Experience in working with Azure Logic App and automated to build report. Provided security for the application ID’s storing them in key vault.
- Gained good experience of troubleshooting issues related to DNS/ Custom Domains/ SSL certificates. Well versed with Azure VM architecture, Storage accounts, DNS, Azure AD.
- Good experience on V-nets, subnets, and route tables in Azure.
- Used Azure Kubernetes Service to create nodes and auto scaled the Kubernetes cluster for no downtime.
- Extensive experience in Windows Azure (IAAS) migrating like creating Azure VMs, storage accounts, Storage pools, migrating on premise servers to Azure and creating availability sets in Azure.
- Configured alerting rules and setup pager duty alerts and different micro services in Grafana.
- Deployed Prometheus with Grafana to monitor the Kubernetes cluster and configured alerts when different conditions met.
- Performed installation and managed Grafana to visualize the metrics collected by Prometheus.
- Experience in running the applications and workloads in Compute like CPU, Memory, and disk usage in Compute unit.
Confidential, CA
DevOps Engineer
Responsibilities:
- Handled the complexities of database administration, scalability, and availability.
- Provided backup features like automated backups, replication, high availability, and scaling capabilities for databases.
- Retrieved unstructured data like files, images, and videos for storage.
- Accessible across multiple instances for collaborations and applications for designing long-term data retention at a lower cost.
- Created isolated network environments and defined subnets, IP ranges and routing rules.
- Distributed incoming traffic across multiple instances to improve scalability and fault-tolerance.
- Designed security cloud architecture like IAM, Secure network configuration, secure data management, application security, regular auditing, and compliance.
- Developed Policy based scanning and automated remediation to scan for container images like immutable infrastructure and version control.
- Securing information like API keys, Passwords, Environment variables, configuration files, Key management services, Least Privilege Access as a Secrets Management.
Confidential
Linux Administrator
Responsibilities:
- Systems Administrator responsible for centralized Administration / Maintenance of Linux Servers.
- Installation and administration of RHEL 4.x and SUSE 10.x.
- Configured kick-start server and updating/applying patches to the servers using Red Hat Satellite server.
- Remote system administration using tools like SSH, Telnet and Rlogin.
- Installation, configuring, administration and hardening of Apache web servers.
- Working on Volume management, Disk Management, software RAID solutions using VERITAS Volume manager & Solaris Volume Manager.
- Installed, maintained, and upgraded REDHAT Linux Server using kick start-based network installation.
- User account management and administration. Troubleshooting User's login and home directory related issues, reset password and unlock user accounts.
- Performed Automation of jobs through crontab and Autosys.
- Provided support for both physical and virtual environments and Troubleshooting WebLogic Application Server connection pools.
- Monitored system activities and fine-tuned system parameters and configurations to optimize performance and ensure security of systems.
- Performed Troubleshooting NFS, NIS, Samba, DNS, DHCP, LDAP, MySQL, and network problems.
- Written bash, shell-scripts to automate routine activities.
- Coordinating with 24 x 7 on-call support personnel in debugging.