SUMMARY

• Over 6 years of IT Experience in designing, developing, testing and implementing of various stand - alone and client-server architecture-based enterprise application software in Python on different domains.
• Skilled experience in Python with proven expertise in using new tools and technical developments (libraries used: matplotlib, numpy, Beautiful Soup, Jasy,, Scipy, Pickle, PySide, python- Confidential, Pandas dataframe, networkx, urllib2, MySQL dB for database connectivity) to drive improvements throughout entire software development lifecycle.
• Good experience using various python libraries to speed up development (libraries used: Beautiful Soup, SciPy, Matplotlib, python - Confidential, Pandas data frame, network, urllib2, MySQL, NOSQL, dB for database connectivity, JSON libraries)
• Experience working with Redis, RabbitMQ for task queues and Celery to manage Asynchronous tasks.
• Experience in writing SQL/ PL SQL scripts including stored procedures, functions, packages, query tuning and optimization, indexes. Written bulk export SQL scripts
• Strong experience in Data Analyst, Data mining with large data sets of Structured and Unstructured data, Data Acquisition, Data Validation, Predictive modeling, Statistical modeling, Data modeling, Data Visualization, Web Crawling, Web Scraping. Adept in statistical programming languages like R and Python, SAS, Apache Spark, MATLAB including Big Data technologies like Hadoop, Hive, Pig.
• Excellent knowledge of Machine Learning, Mathematical Modeling and Operations Research. Comfortable with R, Python, SAS and Weka, MATLAB, Relational databases. Deep understanding & exposure of Big Data Eco - system.
• Experienced on data architecture including data ingestion pipeline design, Hadoop information architecture, data modeling and data mining, machine learning and advanced data processing.
• Deep analytics and understanding of Big Data and algorithms using Hadoop, MapReduce, NoSQL and distributed computing tools.
• Experienced in monitoring, developing and transforming data using SQL Server Integration Service (SSIS) and SQL Server Analysis Service (SSAS).
• Experienced with databases using ORMs/DOMs for integrating with MySQL, Postgres, Neo4J, MongoDB, and Cassandra SQLite. Also, experienced with writing custom queries through database connectors.
• Experienced in working with various Python Integrated Development Environments like NetBeans, PyCharm, PyScripter, Spyder, PyStudio, PyDev and Sublime Text.
• Expertise in establishing database connections for Python by configuring packages like MySQL-Python.
• Strong Expertise in MySQL, PostgreSQL and NO-SQL databases like Mongo DB and Couch DB.
• Configure backup, alerts, repairs and monitoring of Cassandra clusters, in conjunction with Nagios/OpsCenter and custom scripts.
• Extensive experience in deploying, managing and developing MongoDB clusters.
• Experience in working with Python ORM Libraries including Django ORM, SQL Alchemy.
• Expertise in working with GUI frameworks - PyJamas, Jython.
• Good idea about testing tools like Bugzilla and JIRA.
• Experienced in working with various Python Integrated Development Environments like NetBeans, PyCharm, PyScripter, Spyder, PyStudio, PyDev and Sublime Text.
• Experience of Build & Deployment phase and usage of Continuous Integration (CI/CD) tools, build configuration, change history for releases, Maintenance of build system, automation & smoke test processes, managing, configuring, and maintaining source control management systems.
• Good experience in Shell Scripting, SQL Server, UNIX and Linux, Open stock and Expertise python scripting with focus on DevOps tools, CI/CD and AWS Cloud Architecture.
• Deployed production site using Apache 2.0 with mod python.
• Experienced in Agile Methodologies, Scrum stories and sprints experience in a Python based environment, along with data analytics, data wrangling and Excel data extracts.
• Experienced in working with various Python IDEs using PyCharm, Spyder, NetBeans, PyStudio, PyScripter, Eric, Wing IDE and PyDev.
• Able to analyze a requirement and act accordingly by managing the resources efficiently.
• Have flexibility and ability to learn and use new technologies and to work in team environment as wells as independently to get things done.
• Experience in writing Sub Queries, Stored Procedures, Triggers, Cursors, and Functions on MySQL and PostgreSQL database.
• Hands on experience in using NOSQL libraries like MongoDB, Cassandra, Redis and relational databases like Oracle, SQLite, PostgreSQL and MYSQL databases.
• Worked on UNIX shell scripts for business process and loading data from different interfaces to HDFS.
• Working knowledge of errors and exceptions handling debugging using PDB, Eclipse and PyCharm
• Experience with Docker, deployment of application inside software containers.
• Experience in implementing python alongside using various libraries such as mat plotlib for charts and graphs, MySQL dB for database connectivity, python- Confidential, PySide, Pickle, Pandas data frame, network, urllib2 .
• Extensively worked on Sqoop, Hadoop, Hive, Spark, Cassandra to build ETL and Data Processing systems having various data sources, data targets and data formats
• Strong experience and knowledge in Data Visualization with Tableau creating: Line and scatter plots, Bar Charts, Histograms, Pie chart, Dot charts, Box plots, Time series, Error Bars, Multiple Charts types, Multiple Axes, subplots etc.
• Experience in using various packages in Rand python like ggplot2, caret, dplyr, Rweka, gmodels, RCurl, tm, C50, Confidential, NLP, Reshape2, rjson, plyr, pandas, numpy, seaborn, scipy, matplotlib, scikit-learn, Beautiful Soup, Rpy2.
• Amazon IAM service enabled to grant permissions and resources to users. Managed roles and permissions of users with the help of AWS IAM .
• Worked on AWS Oracle databases for App migration into private cloud.
• Worked on AWS Database Migration Services for migrating data from Oracle to RDS.
• D esigning and implementing fully automated server build management, monitoring and deployment by using Technologies like Puppet.
• Deployed Puppet, Puppet dashboard for configuration management to existing infrastructure.
• Initiating alarms in CloudWatch service for monitoring the server's performance, CPU Utilization, disk usage etc. to take recommended actions for better performance.
• Configured AWS Multi Factor Authentication in IAM to implement 2 step authentication of user's access using Google Authenticator and AWS Virtual MFA .
• Included security groups, network ACLs, Internet Gateways, and Elastic IP's to ensure a safe area for organization in AWS public cloud.
• Worked on migrating Oracle databases to AWS RDS using utility AWS Database Migration Service (DMS).
• Utilized Amazon Route53 to manage DNS zones and also assign public DNS names to elastic load balancers IP's .
• Writing UNIX shell scripts to automate the jobs and scheduling cron jobs for job automation using commands with Crontab.
• Excellent Architectural, analytical and problem-solving skills. Trained in Agile/Scrum methodology to complete the task and project

PROFESSIONAL EXPERIENCE

Senior Python Developer

Confidential, CA

Responsibilities:

• Managed datasets using Panda data frames and MySQL, queried MYSQL database queries from Python using Python-MySQL connector My SQL db package to retrieve information.
• Design, build and manage the ELK (Elasticsearch, Logstash, graphite, Kibana) cluster for centralized logging and search functionalities for the App.
• Golang, Infrastructure Teams and Engineering Productivity utilizing Kubernetes, Docker, influx dB Ansible, Spinnaker.
• Trained extensively in agile methodologies and implemented by participating in scrum stand ups, Kanban mode, discussing and implementing requirements with clients.
• Was leading an effort to build a real time click stream analytics platform for processing the beacons from web and mobile devices using Spark, Kafka, elastic and building dashboard using Kibana and Grafana.
• Deployed mircoservices2, including provisioning AWS environments using Ansible Playbooks.
• Used Ansible playbooks to setup Continuous Delivery pipeline. This primarily consists of a Jenkins and Sonar server, the infrastructure to run these packages and various supporting software components such as Maven, etc.
• Automated various infrastructure activities like Continuous Deployment, Application Server setup, Stack Monitoring using Ansible playbooks and has integrated Ansible with Run deck and Jenkins.
• Help with the creation of dev standards for Puppet module development including best practices for version control ( git ).
• Developed test automation framework scripts using Python Selenium WebDriver and Implemented Page Object Model framework with Python and Selenium.
• Tested compatibility of application for dynamic and static content in cross browsers such as Chrome, IE, Edge, Firefox and Safari as well as Setup Selenium GRID to run automation scripts on different browsers.
• Utilized Apache Spark with Python to develop and execute Big Data Analytics and Machine learning applications, executed machine Learning use cases under Spark ML and Mllib.
• Identified areas of improvement in existing business by unearthing insights by analyzing vast amount of data using machine learning techniques.
• Interpret problems and provides solutions to business problems using data analysis, data mining, optimization tools, and machine learning techniques and statistics.
• Refined time-series data and validated mathematical models using analytical tools like R and SPSS to reduce forecasting errors.
• Worked on data pre-processing and cleaning the data to perform feature engineering and performed data imputation techniques for the missing values in the dataset using Python.
• Created Data Quality Scripts using SQL and Hive to validate successful das ta load and quality of the data. Created various types of data visualizations using Python and Tableau.
• Generating Data Models using Erwin9.6 and developed relational database system and involved in Logical modeling using the Dimensional Modeling techniques such as Star Schema and Snow Flake Schema.
• Guide the full lifecycle of a Hadoop solution, including requirements analysis, platform selection, technical architecture design, application design and development, testing, and deployment
• Consult on broad areas including data science, spatial econometrics, machine learning, information technology and systems and economic policy with R
• Performed Data mapping between source systems to Target systems, logical data modeling, created class diagrams and ER diagrams and used SQL queries to filter data
• Enabled speedy reviews and first mover advantages by using Oozie to automate data loading into the Hadoop Distributed File System and PIG to pre-process the data.
• Created Python tools to increase efficiency of retail management application system and operations; data conversion scripts, AMQP/RabbitMQ, REST, JSON, and CRUD scripts for API Integration.
• Used Test driven approach for developing the application and Implemented the unit tests using Python Unit test framework and Development of Isomorphic React.JS and Redux driven API client applications.
• Developed Python scripts to monitor health of Mongo databases and perform ad-hoc backups using Mongo dump and Mongo restore.
• Managed and reviewed Hadoop log file and worked in analyzing SQL scripts and designed the solution for the process using Pyspark.
• Clean data and processed third party spending data into maneuverable deliverables within specific format with Excel macros and python libraries such as NumPy, SQL Alchemy and matplotlib.
• Perform troubleshooting, fixed and deployed many Python bug fixes of the two main applications that were a main source of data for both customers and internal customer service team.
• Developed entire frontend and backend modules using Python on Django including Tastypie Web Framework using Git.
• Write Python scripts to parse JSON documents and load the data in database.
• Worked in using React JS components, Forms, Events, Keys, Router, Animations and Flux concept.

Python Developer

Confidential, NY

Responsibilities:

• Developed a fully automated continuous integration system using Git, Gerrit, Jenkins, MySQL and custom tools developed in Python and Bash.
• Implemented a review process in integration automation using Review Board and Gerrit that eliminated the need for a 5 hour per week daily approval meeting
• Developed a web tool that monitors and drives the automated continuous integration system allowing release managers to track changes
• Played a key role in a department wide transition from Subversion to Git, which resulted in an increase in efficiency for the development community
• Developed a Coverity mail script that extracts code defects data per component for a daily report to drive reducing defects in the codebase
• Consolidation and refactoring the legacy program modules of the mission-critical external web app that significantly improved code maintainability and decreased deployment time by 85%
• Developing, design and implementation of the new API endpoints as a part of high-volume external web app, that provided critical connectivity channel for distributed functionality and increase system cohesion keeping manageable code complexity.
• Handling full stack programming tasks for the development of the high-volume online service (Flask, Pandas and PL/SQL), resulting in consistent deployment of 10 major products updates.
• Improving product aesthetic and UX of the high-volume external web app, resulting in 83% increase in users retention.
• Migration of the existing DEV/USR/PRD environments to the cloud for the critical external web app that helped to achieve 20% decrease in infrastructure operating costs.
• Optimizing legacy data storages and search queries for the critical external web app using PL/SQL improving system's response time by 65%
• Performing unit & load testing for the mission-critical external web app eliminating system's failure rate by 75%
• Developed Spark/Scala, Python for regular expression (regex) project in the Hadoop/Hive environment with Linux/Windows for big data resources.
• Data sources are extracted, transformed and loaded to generate CSV data files with Python programming and SQL queries.
• Stored and retrieved data from data-warehouses using Amazon Redshift.
• Worked on TeradataSQL queries, Teradata Indexes, Utilities such as Mload, Tpump, Fast load and FastExport.
• Used Data Warehousing Concepts like Ralph Kimball Methodology, Bill Inmon Methodology, OLAP, OLTP, Star Schema, Snow Flake Schema, Fact Table and Dimension Table.
• Performed efficient delivery of code based on principles of Test Driven Development (TDD) and continuous Integration to keep in line with Agile Software Methodology principles
• Developed views and templates with Python and Django's view controller and templating language to created user-friendly website interface.
• Performed efficient delivery of code based on principles of Test Driven Development (TDD) and continuous Integration to keep in line with Agile Software Methodology principles.
• Managed and reviewed Hadoop log file and worked in analyzing SQL scripts and designed the solution for the process using PySpark.
• Developed SAS code for data analysis and report generation using Macro Processing, Proc Report to generate Excel spreadsheets.
• Develop python code to automate the ingestion of common formats such as JSON, CSV by using Logstash from elastic search to Kibana dashboard to be viewed by clients.
• Responsible for designing and deploying new ELK clusters (Elasticsearch, Logstash, Graphite Kibana, beats, Kafka, zookeeper etc.
• Responsible for the Automation of the deployment of the Conductor application on AWS lambda using high-end AWS architectural components
• Fixed issues related to OpenStack components such as Nova, Glance, Neutron, Key-stone, MySQL/Percona DB, RabbitMQ, Cech, Repose, HAP Roxy and Horizon.
• Experienced in developing API services Python/Tornado while leveraging AMQP and RabbitMQ for distributed architectures.
• Designed and developed web crawler in python using Scrappy framework and using RabbitMQ as a messaging server between the micro services.
• Experience with Kibana to check logs and other time-stamped data sets stored in Elastic Search.
• Written and Maintained Automated Salt scripts for Elasticsearch, Logstash, Kibana, and Beats.
• Developed full stack Python web framework with an emphasis on simplicity, flexibility, and extensibility. It is built atop excellent components and reinvents zero wheels. WSGI, routing, templating, forms, data, plugins, config, events, SQL Alchemy, Storm, CouchDB, OpenID, App Engine, jQuery, etc.
• Validated BI Support events, transformed and batched events which are sent to HNM and Kafka by triggering these events using Kafka, Mesos.
• Used micro service architecture, with Spring Boot-based services interacting of REST and Kafka.
• Developed Kafka producer and consumers, HBase clients, Spark, shark, Streams and Hadoop MapReduce jobs along with components on HDFS, Hive.
• Creating restful web services for Catalog and Pricing with Django MVT, Jersey, MySQL, and MongoDB.
• Ingested large CSV XML JSON data from computers around the world utilizing Python with pandas, csv, xml and NumPy. Formatted the raw data and built dynamic statistic pages for engineers.
• Used Jenkins pipelines to drive all micro services builds out to the Docker registry and then deployed to Kubernetes, Created Pods and managed using Kubernetes
• Involved in multi-tiered J2EE design utilizing MVC architecture Spring, Struts, Hibernate and EJB deployed on WebSphere Application Server connecting to an Oracle database
• Used Docker to implement a high-level API to provide lightweight containers that run processes isolation and worked on creation of customized Docker container images, tagged and pushed the images to the Docker repository.
• Participated in development of a well responsive single page application using AngularJS framework, Java Script, and jQuery in conjunction with HTML5, CSS3 standards, with front-end UI team.
• Automated various infrastructure activities like Continuous Deployment, Application Server setup, Stack monitoring using Ansible playbooks and has Integrated Ansible with Run deck and Jenkins.
• Wrote Ansible Playbooks with Python SSH as the Wrapper to Manage Configurations of AWS nodes and Tested Playbooks on AWS instances using Python. Run Ansible Scripts to Provide Dev Servers.

Software Developer

Confidential

Responsibilities:

• Conducting educational sessions for new team members as a subject matter expert (SME) for the mission-critical internal web application that helped to reduce onboarding time by 57%.
• Handling full stack programming tasks for the development of the high-profile external web app applying knowledge of ER Diagrams and Capistrano, resulting in consistent deployment of 8 major products updates.
• Identification and implementation of the crucial code improvements for the high-profile online service resulting in application performance tunning and code quality improvements
• Integrating with third-party services and external APIs as a part of implementation of the high-profile online service standardizing the way of user accounts management amongst different projects and mitigating code duplicity
• Maintaining newly developed and legacy systems high-profile external web app applying knowledge of Django and Gin.
• Creating mature, unambiguous coding standards team of 3 devs that improved consistency and maintainability across different code repositories.
• Documenting solution architecture for the high-profile external web app standardizing the way of development amongst different projects and mitigating code duplicity
• Identification of the optimal tech stack as a part of RND activities for the high-profile customers-facing portal that helped to boost project development efficiency.
• Optimizing existing data storages and reporting queries for the high-volume iOS application applying knowledge of GraphDB, MariaDB and MS SQL Server resulted in minimization of the average response time by 64%
• Revamping UI, UX and overall design aesthetic of the high-profile customers-facing portal, resulting in 56% increase in sales and product revenue.
• Reverse-Engineering legacy modules related to high-profile iOS application, resulting in uncovering and validation undocumented functional and un-functional requirements.
• Extensively used Python / Django Framework for developing backend applications.
• Strong Expertise in working with server-side technologies including databases, Restful API and MVC design patterns.
• Actively involved in Initial software development life cycle (SDLC) of requirement gathering and in suggesting system configuration specifications during client interaction.
• Developed/supported application on LAMP stack (PHP, MYSQL and Apache)
• Created Python and Bash tools to increase efficiency of call center application system and operations; data conversion scripts, AMQP/Rabbit MQ, REST, JSON, and CRUD scripts for API Integration.
• Used Celery with Rabbit MQ, MySQL, Elasticsearch, and Flask to create a distributed worker framework.
• Recording of Scripts (Web, Web Services HTML) using Vugen and Soap UI and script validation through co correlations, parameterizations and other methods. Scripting- web and web services.
• Experience on configuring auto scalable and highly available microservices set with monitoring and logging using AWS, Docker, Jenkins and Splunk.
• Build the Silent Circle Management System (SCMC) in Elasticsearch, Python, and Node.JS while integrating with infrastructure services.
• Involved in developing java microservices which are interconnected in the AWS cloud also involved in consuming and building web services both and SOAP and RESTful.
• Developed Restful Microservices using Flask and Django and deployed on AWS servers using EBS and EC2.
• Consumed REST based Microservices with Rest template based on RESTful APIs and designed, developed and tested HTML, CSS, jQuery and React.js that meets accessibility and web browser standards for car dealerships websites.
• Develop Python microservices with Django/Flask framework for Confidential & Confidential internal Web Applications.
• Used REST based microservices with REST format considering RESTful APIs and outlined, built up the UI for the customer sites by utilizing HTML, CSS, jQuery and React.js.
• Used Vagrant to implement environment for microservices deployments and testing in Docker images.
• Designed, created, executed, and kept up answers for utilizing Docker, Jenkins, Git, and Puppet for microservices and ceaseless arrangement.
• Contribute to the client's development standard practices of Microservice architecture by developing reusable product extensions and writing knowledge articles based on experience.
• Experience on creating Microservices with Spring Cloud, Eureka Service Discovery, Ribbon, Spring Boot, Apache Camel and REST web services
• Utilizing MEAN stack (MongoDB/AngularJS) and JSON for data transfer and technologies related to server-side scripting.
• Responsible for creating efficient design and development of responsive UI using with HTML5, CSS3, JavaScript, MEAN stack (MongoDB, Express, Angular, and Node JS) and React JS.
• Created a Python/Elasticsearch based web application using Python scripting for data processing, MySQL for the database, and HTML/CSS/Ruby and High Charts for data visualization of the served pages.
• Strong Socket programming experience in Python. Implemented complex networking operations like race route, SMTP mail server and web server.
• Managed, developed, and designed a dashboard control panel for customers and Administrators using Elasticsearch, HTML, CSS, Ruby, Bootstrap, Ruby and RESTAPI calls.
• Automated RabbitMQ cluster installations and configuration using Python/Bash.
• Fetched Confidential feeds for certain important keyword using python- Confidential library.
• Used Python Library Beautiful Soup for web scrapping to extract data for building graphs.