Sr. Big Data Engineer/devops Architect/assoc Director, Software Development Resume
SUMMARY
- An extremely dedicated and proficient individual with 10+ years in developing tools, Automation Build, Release and Software Configuration Management in accordance with client needs.
- Hands on Lead Architect/ Developing Distributed Systems, Fault tolerant, Highly available big data systems
- Expertise in Cloud, Mesos, Docker, Kafka, Scala, AKKA, Golang, Jenkins, Ansible, Linux, Consul, Docker Networking, Kubernetes, Calico
- Developed micro services which process millions of recodes per request running in Docker
- Architect Distributed micro services.
- Architect/Developed a fully automated process to spin up environments in AWS using Terraform and Ansible
- Architect/Developed CICD pipelines end to end
- Architect Mesos environment with fully automated service discovery/Monitoring using consul, Docker networking for overlay network (container to container communication)
- Developed Service Discovery library to form a AKKA cluster automatically
- Setup ETL processes to ingest the data, Some cases it was GPG encrypted data
- Automate deployment and release distribution process
- Excellent knowledge on Industry Standard Software Development Life Cycle (SDLC), Software testing life cycle (STLC)
- Good Knowledge of inter process communication (IPC), Semaphores, Shared memory, Message Queues, Multithreading, Socket programming (TCP, UDP packets).
TECHNICAL SKILLS
Languages: Golang, Scala, C/C++, Java, PHP, Perl, Shell Script, HTML, JavaScript, Oracle PL/SQL, Awk, Sed, Node.js, Python
O/S: UNIX, Linux, VxWorks, Windows Platforms
Databases: Oracle, Mongo, SQL, Cassandra
SCM/Build Tools: CVS, SVN,GIT, Maven, ANT,SBT, GOCD, Bamboo, JIRA, SOAP APIs, REST, Crowd, Fisheye, Tomcat, Nexus, MAKE, Eclipse, Mercury TestDirector Security Systems (LDAP, TAM) UNIX Make
Web: HTML, XML, WebLogic, Tomcat, Apache, J2EE
PROFESSIONAL EXPERIENCE
Confidential
Sr. Big Data Engineer/DevOps Architect/Assoc Director, Software Development
Responsibilities:
- Architect/Develop Distributed applications (Akka, Scala, Finagle, Thrift)
- Developed Distributed cache, which is used in production, Confidential might Opensource in the future. (Akka, Scala, Finagle, Thrift)
- Developed a micro service which process millions of records per request and convert records to Avro before exposing the Kafka topic to Clients. (Akka, Scala, Finagle, Thrift, Docker)
- Implemented Thrift support for all the applications
- Developed Service Discovery library to form a Akka cluster automatically in docker containers. Scala
- Developed persistence ID management library for Akka cluster, We might opensource this in future since Akka does not have that out of the box yet. (Scala)
- Developed zero down time deployment process for production applications.
- CICD for all the applications running in production (Jenkins, Groovy, Pipelines, Docker)
- Developed CICD Pipelines for Jenkins in Groovy.
- Built DCOS cluster for production (Ansible)
- Using Prometheus / Grafana for monitoring
- Developed custom exported for Prometheus called firewatcher (Golang)
- Architected infrastructure.
- Provisioned/maintained servers for all the environment (QA, STAGE and PROD)
- Automate provisioning process for the server (Ansible)
- Built Kafka and Cassandra servers for our eco system.
- Evaluated Heptio Kubernetes cluster.
- Built Kubernetes cluster on premise.
Confidential
Sr. Lead DevOps/Principal Engineer
Responsibilities:
- Responsible for provisioning/maintaining servers for all environments in AWS using Terraform (QA, STAGE and PROD). Responsible for architecting Infrastructure.
- Architected/developed Back - end REST APIs (Node.js, Python).
- Managed team of 5+ Developers (Back-end REST APIs).
- Worked with clients to integrate systems.
- Provisioned members on our IDP using feed process (PING, Python).
- Decision Maker to select proper tools for the team.
- Setup CICD for the project.
Confidential
Sr. DevOps, Build/Automation Engineering Sr. Software Engineer
Responsibilities:
- Managed/maintained GitHub Repositories.
- Fixed Developers issues having with GIT. E.g. Merge, revert etc.
- Created/automated Workflows for the projects in Anthill Pro.
- Maintained/monitored Infrastructure.
- Created Ansible plays to install/manage software and configurations.
- Migrate Datacenter.
- Configured new machines in OpenStack using Nova, Terraform.
- Provisioned Infrastructure using Ansible.
- Managed tools and configurations like Consul, Icinga 2, NRPE, Cassandra, Elasticsearch, Docker, Mesos Cluster, Jenkins, Marathon, etc.
- Created dynamic Build, Test and Deployment Infrastructure on Mesos using Jenkins and Docker.
- Service discovery using Consul and Consult template.
- Integrated Vault with Consul in order to protect username, passwords.
- Implemented monitoring using Consul and Consul template. Implemented Python library to process the data coming from 3rd Party as feed.
- Configured/secured NiFi Server in order to do SFTP + process feed.
- Implemented generic REST API to push data to multi Endpoints using Node.js or Flask.
Confidential
Configuration, Build, Release, DevOps and Automation Engineering
Responsibilities:
- Started/maintained SVN,GIT Repository structure.
- Used CVS and SVN for Tagging, Branching, and Merging strategies.
- Performed Clean Builds according to the schedule published for a given Data strategies release.
- Produced documentation of CM plans and other project related Artifacts.
- Merged the versions from Integration Branch to Release Branch and Rebasing.
- Developed/enhanced the Automated Build System.
- Used ANT and Maven for building the projects and developing Build scripts.
- Maintained/enhanced current Build procedures for all Software Development projects.
- Developed/enhanced the Automated Configuration Management system.
- Configurations, setup and building of interfaces and modifying the flow to give the opportunity for re-use Scalability and Functionality.
- Created Perl and Shell scripts to automate creating branches, creating and cleanup branches/tags, moving, and releasing tags.
- Implemented Shell/Perl scripts for Release/Build Automation.
- Manipulated/automated scripts to suit the requirement. Managed software configurations, including tagging, branching/merging, and promoting versioned files.
- Worked with Development Team Leads and testing team to establish a Build Schedule, execute Builds and troubleshoot Build Failures, if any.
- Automated Deployment/Release Distribution process with PHP, Shell, and Perl.
- Developed applications to reduce tickets for our team by using SOAP, REST APIs, PHP, and SQL.
- Developed a process and tools for self-service which saved us bunch of time to improve other stuff.
Environment: SVN, GIT, PHP, JS, AJAX, SQL, PHP, GOCD, Jenkins, Maven, Bamboo, JIRA, XML, Nexus, Perl Script, Shell scripting, Java, Linux, UNIX
Confidential
Configuration, Build and Release Engineer
Responsibilities:
- Used CVS and SVN for Tagging, Branching, and Merging strategies
- Performed Clean Builds according to the schedule published for a given Data strategies release.
- Merged the versions from Integration Branch to Release Branch and Rebasing.
- Developed/enhanced Automated Build System.
- Used ANT and Maven for building the projects and developing the Build scripts.
- Maintained/enhanced current Build Procedures for all Software Development projects.
- Developed/enhanced the automated Configuration Management system.
- Configurations, setup and building of interfaces and modifying the flow to give the opportunity for re-use Scalability and Functionality.
- Created Perl/Shell scripts to automate creating branches, creating and cleanup branches/tags, moving and releasing tags.
- Implemented Shell/Perl scripts for Release/Build Automation.
- Manipulated/automated scripts to suit the requirement.
- Managed software configurations, including tagging, branching/merging and promoting versioned files.
- Worked with Development Team Leads and testing team to establish a build schedule, execute the builds and troubleshoot build failures, if any.
Environment: SVN, CVS, Maven, Perl script, Shell scripting, Java, JS, Windows, UNIX, Linux
Confidential
Software Engineer
Responsibilities:
- Developed Multithread application using Inter Process Communication (IPC), Semaphores, and Mutex, Shared Memory, Message Queues, Socket Programming (TCP, UDP Packets) in C,C++.
- Debugging.
- Created/ran MAKE files to build the Code using Tornado.
- Started/maintained CVS Repository structure.
- Control branching and merging of Codebase.
- Trained Developers on CVS checkout, adding, editing, committing files, and CM practices.
- Created projects, distributed files, and ran scripts in CVS.
- Automated Integration Builds and Releases.
- Merged versions from Integration Branch to Release Branch and Rebasing.
- Facilitated Continuous 'Build Manager's Role for all Software Development projects.
Environment: C, C++, CVS, Apache ANT, XML, Perl/Korn Shell scripting, Java, Make, UNIX, Linux, VxWorks, Tornado