SUMMARY

• Engineering professional with around 6 years of experience in Software development including several python packages like NumPy, SciPy, PyTables etc. and proficient in Hadoop Big Data processing.
• Experience with object - oriented programming (OOP) concepts using Python, Django, and Linux. Familiar with REST and AWS (Amazon Web services) in Redshift, EMR for improved efficiency of Storage and Proficient in SQL databases MS SQL, MySQL, Oracle and NoSQL databases MongoDB, Cassandra, Oracle. Expertise in SQL stored queries.
• Expertise in Analysis, Design, Development, Testing, and Implementation of various internet-based applications. Proficient in a variety of platforms, languages like Python, Java using various frameworks like Django, Flask, Spring, Hibernate.
• Experienced with Test Driven Development (TDD), Agile, Scrum and Waterfall methodologies. Used ticketing systems like JIRA, Bugzilla, and other proprietary tools.
• Experienced in WAMP (Windows, Apache, MYSQL, and PHP) and LAMP (Linux, Apache, MySQL, and PHP) Architecture.
• Good experience in developing web applications and implementing Model View Control (MVC) architecture.
• Experienced in real time data from various data sources through Kafka data pipelines and applied various transformations to normalize the data stored in HDFS Data Lake.
• Hands-on experience in MVC architecture and Java EE frameworks like Struts2, Spring MVC, and Hibernate.
• Worked in agile and waterfall methodologies with high quality deliverables delivered on-time.
• Experienced in running Spark streaming applications in cluster mode and Spark log debugging.
• Skilled on migrating the data from different databases to Hadoop HDFS and Hive using SQOOP.
• Proficient Experience in the core concepts of MapReduce Framework and Hadoop ecosystem.
• Hands-on experience in configuring and working with Flume to load the data from multiple sources
• Experienced in using MVC architecture using RESTful, Soap Web services and SoapUI and high-level Python Web frameworks like Django and Flask. Experience object-oriented programming (OOP) concepts using Python, Django, and Linux.
• Proficient in designing and querying the NoSQL databases like HBase, Cassandra, MongoDB, Impala.
• Experienced with Web Development, Amazon Web Services, Python and the Django framework.
• Familiar with JSON based REST Web services and Amazon Web services.
• Experienced in WAMP (Windows, Apache, MYSQL, and Python) and LAMP (Linux, Apache, MySQL, and Python) Architecture and Wrote Automation test cases using Selenium Web Driver, JUnit, Maven, and spring.
• Having a Complete Understanding on Lambda architectures
• Proficient experience in working with Amazon Web Services like EC2, Virtual private clouds (VPCs), Storage models (EBS, S3, instance storage), Elastic Load Balancers (ELBs)
• Worked extensively in design and development of business process using SQOOP, PIG, HIVE, HBASE.
• Expertise in Working on Data Encryption (Client-Side and Server-Side) and securing data at rest and in transit for data in S3, EBS, RDS, EMR, Red Shift using Key Management Service (KMS).
• Proficient knowledge in Software Development Life Cycle (SDLC) and Software Testing Life Cycle (STLC).
• Experienced in optimizing volumes, EC2 instances and created multiple VPC instances and created alarms and notifications for EC2 instances using Cloud Watch.
• Beneficial Knowledge in Amazon AWS concepts like EMR and EC2 web services which provides fast and efficient processing of Big Data.
• Experienced in MVW frameworks like Django, Angular.js, Java Script, backbone.js, jQuery and Node.js.
• Experienced in developing Web Services with Python programming language and Good working experience in processing large datasets with Spark using Scala and PySpark.
• Knowledge on Scala Programming Language. Good experience with Talend open studio for designing ETL Jobs for Processing of data.
• Have experience on Kubernetes and Docker for runtime environment of system to build, test & deploy.

PROFESSIONAL EXPERIENCE

Senior Python Developer

Confidential

Responsibilities:

• Utilized Python libraries such as NumPy and Pandas for processing tabular format data.
• Involved in the development of the applications using Python, HTML5, CSS3, AJAX, JSON and jQuery.
• Managed and reviewed Hadoop log file and worked in analysing SQL scripts and designed the solution for the process using PySpark..
• Implemented and designed AWS virtual servers by Ansible roles to ensure deployment of web applications. Worked with multiple development teams to troubleshot and resolve issues.
• Implemented AWS solutions using E2C, S3, RDS, EBS, Elastic Load Balancer, Auto scaling groups, Optimized volumes and EC2 instances.
• Developed applications using RESTful architecture using Node.js and Python as backend languages and Used NumPy for Numerical analysis.
• Used jQuery and AJAX calls for transmitting JSON data objects between front end and controllers and Utilized continuous integration and automated deployments with Jenkins, Ansible and Docker.
• Utilizing MEAN stack (MongoDB/AngularJS) and JSON for data transfer and technologies related to server-side scripting.
• Designed and developed middleware, using RESTful web services based on a centralized schema Wrote Python scripts to parse JSON documents and load the data in database.
• Involved in MVC frameworks like Django, Angular.js, React.JS, JavaScript, and Node.js and had analysed the SQL scripts and designed the solution to implement using PySpark.
• Worked on AWS data pipeline for Data Extraction, Transformation and Loading from the homogeneous or heterogeneous data sources.
• Responsible for creating efficient design and development of responsive UI using with HTML5, CSS3, JavaScript, MEAN stack (MongoDB, Express, Angular, and Node JS) and React JS.
• Designing, implementing, and maintaining solutions for using Docker, Jenkins, Git, and Puppet for microservices and continuous deployment.
• Successfully migrated the Django database from SQLite to MySQL to PostgreSQL and Designed, developed and deployed CSV Parsing using the big data approach on AWS EC2.
• Developing an enterprise MEAN Stack application by writing server-side code with Node.js and Express framework, a database to store and retrieve data with MongoDB and front-end web pages designing with ReactJS
• Designed and developed the application using Agile Methodology and followed TDD and Scrum.
• Used Pandas API to put the data as time series and tabular format for data manipulation and retrieval.
• Developed API to Integrate with Confidential EC2 cloud-based architecture in AWS, including creating machine Images.
• Knowledge of the Software Development Life Cycle (SDLC), Agile and Waterfall Methodologies and Familiar with concepts and devices such routers, switches and TCP/IP protocols and OSI layer.

Python Developer

Confidential

Responsibilities:

• Developed a Python Script to load the CSV files into the S3 buckets and created AWS S3buckets, performed folder management in each bucket, managed logs and objects within each bucket.
• Implemented RESTful Web-services for sending and receiving the data between multiple systems.
• Developed SQOOP scripts to migrate data from Oracle to Big data Environment.
• Extensively worked with Avro and Parquet files and converted the data from either format Parsed Semi Structured JSON data and converted to Parquet using Data Frames in PySpark.
• Rewrite existing Python/Flask module to deliver certain format of data.
• Designed and Developed DB2 SQL Procedures and UNIX Shell Scripts for Data Import/Export and Conversions.
• Developed an application in Linux environment and dealt with all its commands.
• Administrate Continuous Integration services (Jenkins, Nexus Artifactory and Repository).
• Performed dynamic UI designing with HTML5, CSS3, less, Bootstrap JS, JavaScript, jQuery, JSON and AJAX.
• Loading, analysing, and extracting data to and from Elastic Search with Python.
• Worked with various HDFS file formats like Avro, Sequence File and various compression formats like Snappy, bzip2.
• Created data partitions on large data sets in S3 and DDL on partitioned data. Created Hive DDL on Parquet and Avro data files residing in both HDFS and S3 bucket
• Worked with Amazon Web Services (AWS) using EC2 for hosting and Elastic map reduce (EMR) for data processing with S3 as storage mechanism.
• Converted all Hadoop jobs to run in EMR by configuring the cluster according to the data size.
• Extensively used Stash Git-Bucket for Code Control
• Worked with SQOOP jobs to import the data from RDBMS and used various optimization techniques to optimize Hive, Pigand SQOOP. Monitored and Troubleshooted Hadoop jobs using Yarn Resource Manager and EMR job logs using Genie and Kibana.
• Developed analytical component using Scala and KAFKA.
• Designed Forms, Modules, Views and Templates using Django and Python.
• Consumed the data from Kafka using Apache spark.
• Involved in application development for Cloud platforms using technologies like Java/J2EE, Spring Boot, Spring Cloud, Micro Services, REST.

Software Developer

Confidential

Responsibilities:

• Worked on Python to place data into JSON files for testing Django Websites. Created scripts for data modelling and data import and export.
• Extensive Experience in deploying, managing, and developing Oracle SQL developer clusters.
• Involved in building database Model, APIs and Views utilizing Python, to build an interactive web-based solution.
• Made use of advanced python packages like NumPy, SciPy for various sophisticated numerical and scientific calculations.
• Experience in working with configuration management tools like PUPPET and ANSIBLE jQuery and AJAX call used for more interactive web pages. Ensured quality versioning with GIT.
• Experience with continuous integration and automation using JENKINS & Used JIRA for tracking and Updating Project issue.
• Excellent understanding and knowledge of Hadoop Distributed file system data modelling, architecture and design principles and Developed Python Mapper and Reducer scripts and implemented them using Hadoop streaming.
• Responsible for Configuring Kafka Consumer and Producer metrics to visualize the Kafka System performance and monitoring.
• Involved in writing application level code to interact with APIs, Web Services using JSON and involved in AJAX driven application by invoking web services/API and parsing the JSON response.
• Developed a fully automated continuous integration system using Git, Jenkins, MySQL, and custom tools developed in Python and Bash.
• Implemented the MVC architecture using Apache Struts Framework & Experience in Python open stack API's.
• Worked with Rational ClearCase to provide sophisticated version control, workspace management and parallel development support. Build and maintained a Selenium Regression test suite.
• Expertise in configuration management automation tools such as Chef, Puppet and Salt, HTML, SASS, Bootstrap, CSS, and JavaScript used to create UI for the website.
• Implementation of new post login navigation system and new Branding experience using Microservices and JSON logic.
• Implemented Docker containers to create images of the applications and dynamically provision slaves to Jenkins CI/CD pipelines.
• Knowledge or experience of agile development (e.g. XP, SCRUM, Kanban) and continuing integration.
• Built various graphs using Matplotlib package which helped in taking business decisions
• Created Restful API's to integrate and enhance functionalities of the application. Also Utilized Restful API in communicating with third parties.
• Strong understanding of Messaging Middleware concepts, usage and application Experience in TCP/IP networking.