SUMMARY

• Around 7+ years of experience spread across Python, Big Data, Apache Spark, Scala, Java, SQL technologies.
• Have a hands - on experience on fetching the live stream data from DB2 to HDFS using Spark Streaming and Apache Kafka.
• Experience in real time data from various data sources through Kafka data pipelines and applied various transformations to normalize the data stored in HDFS Data Lake.
• Expertise with different tools in Hadoop Environment including Pig, Hive, HDFS, MapReduce, Sqoop, Spark, Kafka, Yarn, Oozie, and Zookeeper.
• Extensive work in ETL process consisting of data transformation, data sourcing, mapping, conversion and loading using Informatica.
• Expertise in developing data driven applications using Python 2.7, Python 3.0 on PyCharm and Anaconda Spyder IDE's.
• Hands on experience in configuring and working with Flume to load the data from multiple sources
• Proficient in designing and querying the NoSQL databases like HBase, Cassandra, MongoDB, Impala.9
• Experience with Web Development, Amazon Web Services, Python and the Django framework.
• Experienced in using MVC architecture using RESTful, Soap Web services and SoapUI and high-level Python Web frameworks like Django and Flask.
• Experience object-oriented programming (OOP) concepts using Python, Django, and Linux.
• Experienced in WAMP (Windows, Apache, MYSQL, and PHP) and LAMP (Linux, Apache, MySQL, and PHP) Architecture.
• Experienced in MVW frameworks like Django, Angularjs, Java Script, backbone.js, jQuery and Node.js.
• Have experience on Kubernetes and Docker for runtime environment of system to build, test & deploy
• Good experience in working with Amazon Web Services like EC2, Virtual private clouds (VPCs), Storage models (EBS, S3, instance storage), Elastic Load Balancers (ELBs)
• Familiar with JSON based REST Web services and Amazon Web services.
• Deeply involved in writing complex Spark-Scala scripts, Spark context, Cassandra SQL context, used multiple
• API's, methods which support data frames, RDD's, Cassandra table joins and finally write/save the data frames/RDD's to Cassandra database.
• Knowledge on integrating different eco-systems like Kafka - Spark - HDFS.
• Good Knowledge in Apache Spark and Spark SQL.
• Experience in running Spark streaming applications in cluster mode and Spark log debugging.
• Skilled on migrating the data from different databases to Hadoop HDFS and Hive using SQOOP.
• Good Experience in the core concepts of MapReduce Framework and Hadoop ecosystem.
• Experience in optimizing volumes, EC2 instances and created multiple VPC instances and created alarms and notifications for EC2 instances using Cloud Watch
• Extensive knowledge of creating manages tables and external tables in Hive Eco system.
• Worked extensively in design and development of business process using SQOOP, PIG, HIVE, HBASE
• Expertise in Working on Data Encryption (Client-Side and Server-Side) and securing data at rest and in transit for data in S3, EBS, RDS, EMR, Red Shift using Key Management Service (KMS).

TECHNICAL SKILLS

Languages: Python, SQL, MATLAB, C++

Python Libraries: NumPy, Pandas, Matplotlib, SciPy, Scikit-Learn, OpenCV

Frameworks: PyTest, PyUnit

Machine Learning/AI: SVM, KNN, k-means, CNN, LSTM, Trees etc.

Web Technologies: HTML5, XML, JavaScript

Cloud Computing: AWS S3, EC2

Version Controls: GitHub, Git, SVN

Methodologies & Tools: Agile, Scrum, Waterfall, JIRA

IDEs: PyCharm, Jupiter Notebook, Visual Studio Code, Sublime Text

PROFESSIONAL EXPERIENCE

Confidential

Python Developer

Responsibilities:

• Worked closely with Lead Engineer in identifying requirements to develop frameworks
• Experience working with databases using SQL and SQL Alchemy
• Responsible for preparing solution documents and high-level design documents.
• Responsible for writing effective, scalable code in python
• Develop back-end components to improve responsiveness and overall performance
• Integrate user-facing elements into applications
• Improve functionality of existing systems
• Assess and prioritize feature requests
• Facilitate Python testing in QA and PROD regions
• Coordinate with internal teams to understand user requirements and provide technical solutions
• Responsible for testing and debugging programs
• Good knowledge of using version control systems like GIT and SVN.
• Responsible for branch management, reviewing pull requests, and merging in GIT
• Used python scripts to update content in the database and manipulate files.
• Involved in Python OOP code for quality, logging, monitoring, and debugging code optimization.
• Performed efficient delivery of code based on principles of Test-Driven Development (TDD) and continuous integration to keep in line with Agile Software Methodology principles.
• Used JIRA to manage the issues/project workflow.

Environment: Python, NumPy, Pandas, Matplotlib, SciPy, Scikit, Pytest, PyUnit, SQL, SQL Alchemy, SVN, GIT, Jira, Agile, Windows

Confidential

Python Developer

Responsibilities:

• Designed the Web Application Using Python on Django Web Framework pattern to make it extensible and Flexible
• Developed web pages and Graphical user interfaces by front end layouts on the web by using HTML, DHTML, CSS, Bootstrap, XML, jQuery, and AngularJS
• Refactored and extended large existing Django/Python codebase by maintaining PEP-8 code standards and fix the bugs.
• Creating and maintaining Infrastructure for Applications in AWS using Terraform. Building & Automating CICD pipelines for different applications.
• Worked on several standard Python packages like NumPy, Matplotlib, SciPy, Pandas, PyTables etc.
• Implemented and enhanced CRUD operations for the applications using the MVC architecture of Django framework and conducted code reviews
• Used jQuery for all client-side data manipulation. Embedded AJAX in UI to update small portions of the web page avoiding the need to reload the entire page.
• Created builds and release pipelines in VSTS and done deployments using SPN (secure endpoint connection) for implementing CI/CD.
• Worked with Agile methodology in XL Deploy and XL Release, CI/CD automation from scratch, Docker, Open shift)
• Used Python Library Beautiful Soup for web scrapping to extract data for building graphs.
• Wrote Sub Queries, Stored Procedures, Triggers, Cursors, and Functions on MySQL and PostgreSQL database.
• Wrote Python routines to log into the websites and fetch data for selected options.
• Used collections in Python for manipulating and looping through different user-defined objects.
• Added the navigations and paginations and filtering columns and adding and removing the desired columns for views
• Experience in setting up CICD pipeline integrating various tools with Jenkins to build and run Terraform jobs to create infrastructure in AWS
• Used python scripts to update content in the database and manipulate files.
• Responsible to set up REST API framework using Django, Flask.
• Developed Python-based API (RESTful Web Services) to track the events and perform analysis using Django
• Developed REST APIs using Python to ensure that banking patrons and admin-users could do CRUD events
• Implemented a CI/ CD pipeline with Docker, Jenkins, and GitHub by virtualizing the servers using Docker for the Dev and Test environments
• Orchestrated Docker containers for the deployment, scaling and management of Python run applications using Kubernetes.
• Used SVN and GIT as the primary tools to control the version of the code
• Created Python scripts to automate AWS services which include web servers, ELB, Cloud Front distribution, databases, security groups, and application configuration

Environment: HTML5, CSS3, Bootstrap, XML, jQuery, Angular, Django, Matplotlib, SciPy, Pandas, PyTables, CRUD, Django, AJAX, UI, Beautiful Soup, PL/SQL, Triggers

Confidential

Full Stack Python Developer

Responsibilities:

• Worked closely with the business users acting as liaison between the business and technology to identify the requirements for the new workflows.
• Worked on design, modification and implementation of Python code, SQL stored procedures and database schema on backend.
• Worked on object-oriented programming concepts of Python, Flask, Linux and Bash.
• Documented company restful APIs using swagger for internal and third part use and also worked on Unit testing and Integration testing.
• Suggested and implemented changes to the existing processes and applications to improve the availability of the applications to the business.
• Designed and developed data management system using MySQL. Involved in Agile Methodologies and SCRUM Process.
• Developed tools using Python, Shell scripting, XML to automate tasks.
• Developed a Front-End GUI as stand-alone Python application.
• Used Flask framework for API creation and application development.
• Responsible for gathering requirements, system analysis, design, development, testing and deployment.
• Designed and developed data management system using MYSQL.
• Integration of data storage solutions for MYSQL and Oracle.
• Wrote Stored Procedures in SQL and Scripts in Python for data loading.
• Designed and developed a workflow to automate the staging of data from API-JSON to MYSQL.
• Created unit test/regression test framework for working/new code.
• Used Unit Test and Magic Mock Python library for testing many programs on python.
• Tested the workflow for data leakages using sniffers and patched them with necessary measures.
• Design, build and manage the ELK (Elasticsearch, Logstash, graphite, Kibana) cluster for centralized logging and search functionalities for the App.
• Create, administer, and maintain an ELK cluster for the App's centralized logging and search functionality.
• Debug application deployments on multiple levels.
• Provided extended support for production releases and assisted in validating the releases.

Environment: Python, GraphQL, AWS S3, EC2, Agile, Git, Docker, Kubernetes, Jenkins, macOS, Windows.

Confidential

Python Developer

Responsibilities:

• Responsible for preparing solution documents and high-level design documents.
• Used Pythonlibraries like Matplotlib, Pandas for visualization and statistical analysis of data.
• Experience in Python advanced packages and modules like PIL, logging, Requests, Multithreading, Pandas, NumPy, Matplotlib, OpenCV etc.
• Familiar with using AWS S3, EC2
• Experience creating Terraform contents for EC2 and S3 containers
• Experience with Jenkins, Docker, and Kubernetes for managing and developing CI/CD tasks
• Responsible for the application of concepts like hashing etc., on image data
• Responsible for testing programs, reviewing PRs and code, and such tasks
• Responsible for gathering requirements, system analysis, design, development, testing, and deployment.
• Involved in Python OOP code for quality, logging, monitoring, and debugging code optimization.
• Used version control system Git.

Environment: Python, GraphQL, AWS S3, EC2, Agile, Git, Docker, Kubernetes, Jenkins, macOS, Windows.