Sr. Python Developer Resume
SUMMARY
- 9+years of experience in Web/Application Development as a senior Python Developer in analytical programming using python with skills in analysis, design, development, testing and deploying software applications.
- Over 7 years of experience in migration ETL, data architecture, manipulation and analysis in a BI/DW context.
- Good experience using various python libraries to speed up development (libraries used: Beautiful Soup, SciPy, Matplotlib, python - twitter, Pandas data frame, network, urllib2, MySQL, NOSQL, dB for database connectivity, JSON libraries)
- Involved in Developing a Restful service using python Flask framework.
- Made Django web-based apps for Insurance premium calculations.
- Developed entire frontend and back-end modules using python on Django Web Framework with GIT
- Successfully Migrated the Django database from SQLite to MySQL to PostgreSQL with complete data integrity.
- Experience in writing Sub Queries, Stored Procedures, Triggers, Cursors, and Functions on SQL-Server Cassandra, HBase (Phoenix SQL), Hive and PostgreSQL databases.
- Familiar with the AWS cloud services like EC2, Elastic Container Service (ECS), Simple Storage Service (S3) and Elastic MapReduce (EMR).
- Experience on ETL and ELT Tools like SQL Server Integration Services (SSIS), also have knowledge in Data Migrator.
- Experience in AWS platform and its features including IAM, EC2, EBS, VPC, RDS, Cloud Watch, Cloud Trail, Cloud Formation AWS Configuration, Autoscaling, Cloud Front, S3, SQS, SNS, Lambda and Route53 .
- Expertise in developing templates for AWS infrastructure as a code using Terraform to build staging and production environments.
- Experienced in developing web-based applications using SaaS, Python, Django, kafka, RPC, CSS, HTML, JavaScript and JQuery based in Ansible automation script, Angular.JS
- Extensively worked on Python 3.5/2.7 (Numpy, Pandas, Matplotlib, NLTK and Scikit-learn)
- Built Restful web API with Spring, Spring Boot, and testing APIs using Postman.
- Experienced in working Stretch Database feature of SQL Server 2016 for the cold data residing on on-premises SQL Server Databases can be migrated transparently and securely to Microsoft AzureCloud.
- Hands on Experience in Data mining and Data warehousing using ETL Tools and Proficient in Building reports and dashboards in Tableau (BI Tool).
- Proficient in using Confidential Web Services AWS. Extensive experience focusing on services like EC2, VPC, Cloud Watch, Cloud Front, Cloud Formation, IAM, S3, Confidential RDS, Elastic Cache, SNS, SQS.
- Configured AWS Identity and Access Management (IAM) Groups and Users for improved login authentication.
- Hands on experience in design and development of Unix Shell Scripting as a part of the ETL Process to automate the process of loading.
- Strong programming skills in designing and implementation of multi-tier applications using web-based technologies like Spring Boot.
- Automate different workflows, which are initiated manually with Python scripts and Unix shell scripting.
- Experience in Creation and managing user accounts, security, rights, disk space and process monitoring in Solaris and Red hat Linux.
- Written Templates for AWS infrastructure as a code using Terraform and CloudFormation to build staging and production environments.
- Proficient in using Confidential Web Services AWS. Extensive experience focusing on services like EC2, VPC, Cloud Watch, Cloud Front, Cloud Formation, IAM, S3, Confidential RDS, Elastic Cache, SNS, SQS.
- Worked in agile and waterfall methodologies with high quality deliverables delivered on-time.
- Extensive experience in system analysis, design, development and implementation of web based and client/server application using HTML, Angular JS, Bootstrap, underscore JS, Node JS, CSS, JavaScript, AJAX, JSP, JDBC, XML, XSLT, Python, Django, PHP
- Developed Java/J2ee applications using Hibernate, XML, Android, XSLT, and Basic ASP.net applications including using Core Java concepts like OOPS, Multithreading, Garbage Collections, and Collection etc
- Experience in Implementation of MVC/ MVW architecture using Servlet, Django, and RESTful, SOAP web service and
- Excellent Experience of Databases such as MySQL, Oracle 8g/9g/10g, Microsoft SQL Server, PostgreSQL, SQL/PLSQL concepts
- Experience with continuous integration and automation using Jenkins.
- Expertise in Service Oriented Architecture (SOA) and its related technologies like Web Services, BPEL, WSDLs, SOAP1.1, XML, XSD, XSLT etc.
- Developed ColdFusion Components, custom tags and modified CF Objects
- Experience with Unit testing/ Test driven Development (TDD), Load Testing in JIRA, JENKIN
- Wrote AJAX framework to transform Datasets and Data tables into HTTP-serializable JSON strings.
TECHNICAL SKILLS
Languages: Python, Java, C/C++, Perl, Ruby, Objective C, and PL/SQL, PHP, C#
Technologies: JavaScript, XML, HTML, CSS, Angular JS, JQuery, Node.js, SAAS Angular Js, Ext JS, Bootstrap, MVC, SOA, SOAP and HTML, Vue JS, React JS, Redax, SageMaker
Application/Web Servers: Apache Tomcat 5.5, 6.0, IBM Web Sphere 5.1, 6.0, 4.0, BEA Web Logic 12, 9.2, 10x, Red Hat JBoss. IBM Rational Application Developer 6.0, 7, IntelliJ 14, and Net Beans, Nginix
Messaging Systems: Twilio, Redis, Rabbit MQ, Celery, ELK
Deployment Tools: Heroku, Amazon EC2, AON Pathwise
Web Service Protocols: UDDI, SOAP, WSDL and UDDI
Testing Tools: Bugzilla, Crucible and JIRA, Pytest, Pyunit, Selenium, Unit testing
Version Control Tools: CVS, Clear Case, Tortoise SVN, Smart SVN, GIT, GITHUB, GITLAB, Bitbucket
Operating Systems: Windows 7/XP, DOS, UNIX, and Linux, OSX, RHEL, Centos, Ubuntu
Database: Oracle 9i/10g, SQL Server 2008 R2, MySQL, Mongo DB,Postgre SQL, MarkLogic, Cassandra, No SQL databases
PROFESSIONAL EXPERIENCE
Confidential
Sr. Python Developer
Responsibilities:
- Container-as-service (CAAS) Lead to set the Hybrid Cloud Framework of whole SAAS DevOps of Dollar Shave Club, Pioneering and finalizing Results.
- Involved in software development life cycle (SDLC) of tracking the requirements, gathering, analysis, detailed design, development, system testing and user acceptance testing.
- Architected and designed the data flow for the collapse of 4 legacy data warehouses into an AWS Data Lake
- Developed entire frontend and backend modules using Python on Django Web Framework and Involved in designing user interactive web pages as the front end part of the web application using various web technologies like HTML5, JavaScript, Angular JS, JQuery, AJAX and implemented CSS for better appearance and feel.
- Knowledge of cross-browser and cross-platform development of HTML and CSS based websites in Windows like IE 6, IE 7, IE 8 and FF and Worked on Migrating their operating system from OpenVMS to Linux and Knowledge on DCL language and have experience in conversion of DCL Scripts to Python3.5.
- Design and maintain databases using Python and developed Python based API (RESTful Web Service) using Flask, SQL Alchemy and PostgreSQL.
- Experience in working with Jenkins in a Docker container with EC2 slaves in Amazon AWS cloud environment and familiar with surrounding technologies such as Mesos (Mesosphere) and Kubernetes.
- Experienced with event-driven and scheduled AWS Lambda functions to trigger various AWS resources.
- Created Python ETL pipelines for teardown and “trickle” data migration from different backends to Snowflake, SQLServer, and Vertica.
- SAS programming Multivariate Statistics MapReduce
- Maintained and developed Docker images for a tech stack including Cassandra, Kafka, Apache, and several in house written Java services running in Google Cloud Platform(GCP) on Kubernetes.
- Developed Java application code contained in JAR files and deployed it to SAS to enable SAS to connect to Hadoop
- Used ScalaTest for writing test cases and coordinated with QA team on end to end testing.
- Implemented a 'server less' architecture using API Gateway, Lambda, and Dynamo DB and deployed AWS Lambda code from Amazon S3 buckets. Created a Lambda Deployment function, and configured it to receive events from your S3 bucket
- Data Lake Design & Implementation on AWS
- Utilized Apache Spark with Python to develop and execute Big Data Analytics and Machine learning applications, executed machine Learning use cases under Spark ML and Mllib.
- Set up Containerized SAAS, Docker Incentive Pusher for Benchmark among hypervisor-less Docker, and hypervisors with KVM, Xen, ESXI & Hyper-V.
- Built demand forecasting models to predict the trend and future volumes of import/export products utilizing Time Series ARIMA programming in SAS
- Have experience on Kubernetes and Docker for runtime environment of system to build, test & deploy
- Involved in converting Hive/SQL queries into Spark transformations using Spark RDDs and Scala.
- Integrated data from multiple applications using ETL and ELT tools like SSIS.
- Worked on Terraform for managing the infrastructure through the terminal sessions and executed the scripts and created alarms and notifications for EC2 instances using Cloud Watch.
- Received several client appreciations for proactive analysis & swift resolutions. Involved in report designing using Actuate 7.1 e-Report Design and integrated with application using Actuate C++ API using JNI, SOAP technology linked with active portal.
- Determining the viability of a business problem for a Big Data solution with Pyspark.
- Supported development of Web portals, completed Database Modelling in PostgreSQL, front end support in HTML/CSS, JQuery.
- DevOps role converting existing AWS infrastructure to Server-less architecture (AWS Lambda, Kinesis) deployed via CloudFormation.
- Developed REST APIs using Scala and Play framework to retrieve processed data from Cassandra database.
- Designed and maintained databases using Python and developed Python based API (RESTful Web Service) using FlaskSQL Alchemy and PostgreSQL.
- Used CART, CHAID, decision trees, and Data Mining Techniques in SAS to develop classification models
- Developing UDFs in java for hive and pig and worked on reading multiple data formats on HDFS using Scala.
- Develop framework for converting existing PowerCenter mappings and to PySpark(Python and Spark) Jobs.
- Create Pyspark frame to bring data from DB2 to Amazon S3.
- Implemented MVC architecture in developing the web application with the help of Django framework.
- Used Django template system for front end UI along with OpenStack dashboard and Worked on Python OpenStack APIs and used Numpy for Numerical analysis.
- Provide guidance to development team working on PySpark as ETL platform
- Creation, Update, and implementation of stored procedures and triggers for the C&C++ applications targeting the Sybase DB. Developed, tested and implemented stored procedures, triggers and shell scripts (Perl & Korn) for automated procedures to replace old coded implementations in the Oracle and Informix Databases.
- Develop and test UNIX Shell Scripts (Korn) & Perl. New scripts were also required to automate and drive the procedural execution of applications for efficiency and troubleshooting purposes.
- Working on various applications and deploying them in AWS using Terraform.
- Worked on data cleaning and ensured data quality, consistency, integrity using Pandas, Numpy
- Worked on outliers identification with box-plot, studentized, K-means clustering using Pandas, Numpy
- As part of AWS Glue/Kinesis training created end-to-end ETL workflow for Netezza-to-Redshift data migration POC.
- Used Ansible to manage systems configuration to facilitate interoperability between existing infrastructure and new infrastructure in alternate physical data centers or cloud (AWS)..
- Designed and managed API system deployment using fast http server and Amazon AWS architecture.
- SSIS packages will dump flat files in shared location called outbox, from where our package would pick up the files, place in Inbox folder from where each validation package would load corresponding file in the staging database.
- Implemented monitoring and established best practices around using elastic search and Install and configuring monitoring scripts for AWS EC2 instances.
- Designed SSIS Packages to transfer data between servers, load data into database; Scheduled the jobs to do these tasks periodically.
- Designed and developed test automation framework using Python and Pytest - Unitest framework to the Confidential .
- Automated delivery pipeline using integration and infrastructure tools GIT, Jenkins and Ansible.
- Working under UNIX environment in development of application using Python and familiar with all of its commands.
- Developed remote integration with third party platforms by using RESTful web services and Successful implementation of Apache Spark and Spark Streaming applications for large scale data.
- Creating data pipelines using Apache Spark, a big-data processing and computing framework and Updated and maintained Jenkins for automatic building jobs and deployment.
- Analyze, design, develop document and lead to set the Multi-tenant, Hybrid Cloud Framework of whole SAAS DevOps of CA leveraging Utmost CAAS.
- Experience in migrating data from DB2 to Netezza using NZload and ELT mappings (Datastage) in Data Integration layer
- Developed Spark/Scala, Python for regular expression (regex) project in the Hadoop/Hive environment with Linux/Windows for big data resources.
- Microservice architecture development using Python and Docker on an Ubuntu Linux platform using HTTP/REST interfaces with deployment into a multi-node Kubernetes environment.
- Implemented code to perform CRUD operations on MongoDB using PyMongo module and Improved code reuse and performance by making effective use of various design patterns and refactoring code base.
- Involved in development of a Map based application for integral analysis purpose and Updated and maintained Puppet rspec unit/system test.
- Developed and executed White box test cases using Python, Unitest/Pytest/Robot framework & PyCharm/Ride.
- Involved in analysis and design of the application features and Experience in debugging and troubleshooting programming related issues.
- Worked in MySQL database on simple queries and writing Stored Procedures for normalization and Deployment of the web application using the Linux server.
Environment: Python 2.7/3.2 (Numpy. Pandas, Scikit-learn), Django 1.7/1.9, HTML5, C, C++, CSS, XML, MySQL, JavaScript, Angular JS, JQuery, CSS Bootstrap, Kubernetes, Terraform, RESTful, Ansible, MS SQL Server, MongoDB, Spring Boot, Big Data, Jenkins, SageMaker, GitHub, Bit Bucket, Linux, and Windows, Pyspark.
Confidential, Seattle, WA
Sr. Python Developer
Responsibilities:
- Worked on development of internal testing tool framework written in Python and Developed GUI using Python and Django for dynamically displaying the test block documentation and other features of python code using a web browser.
- Wrote scripts in Python for extracting data from HTML file and Effectively communicated with the external vendors to resolve queries.
- Created functions and assigned roles in AWS Lambda to run python scripts, and AWS Lambda using java to perform event driven processing.
- Developed views and templates with Python and Django's view controller and templating language to create a user-friendly website interface.
- Designed, developed and implemented new classes and objects in C++ for handling various trade and clearing events.
- Programming experience with SQL and SAS, including relational database query construction, optimization and predictive modeling
- Developed Docker container based micro services using Spring Boot and deployment on Kubernetes cluster.
- Used JavaScript and JSON to update a portion of a webpage and Used AngularJS as the development framework to build a single-page application.
- Used IAM to create new accounts, roles and groups and polices and developed critical modules like generating amazon resource numbers and integration points with S3, Dynamo DB, RDS, Lambda and SQS Queue.
- Develop consumer-based features and applications using Python, Django, HTML, Behavior Driven Development (BDD) and pair based programming.
- Created server monitoring daemon with Psutil, supported by Django app for analytics which I created. Also researched big data solutions with Cassandra database.
- Knowledge in Terraform as infrastructure providers, build images using Packer.
- Rewrite existing Python/Django modules to deliver certain format of data and Able to create scripts for system administration and AWS using languages such as BASH and Python.
- Responsible for debugging the project monitored on JIRA (Agile) and Wrote Python scripts to parse JSON documents and load the data in database.
- Managing / monitoring/ trouble shooting batch SAS programs on Unix Server
- Worked on analyzing Hadoop cluster using different big data analytic tools including Hive, MapReduce, Pig and flume.
- Used Python and Django to interface with the jQuery UI and manage the storage and deletion of content.
- Created the front end of the app using Angular JS and Implemented migration tasks from Oracle apps to PostgreSQL databases.
- Involved in configuring CI/CD with Docker and Kubernetes.
- Experienced in creating package dynamics by using SSIS transformations and variables.
- Used Ansible to document all infrastructures into version control.
- Extensively used Python's multiple data science packages like Pandas, NumPy, matplotlib, Seaborn, SciPy, Scikit-learn and NLTK.
- Responsible for on boarding Application teams to build and deploy there code using GitHub Jenkins, Nexus and Ansible.
- The solution processes compressed archive to SAS data sets based on the busines logic.
- Created database using MySQL, wrote several queries to extract data from database using ETL and ELT tool (SSIS).
- Query and set up employee registration and login using Python PostgreSQL
- We use a multiple row data storage strategy called MVCC to make effective PostgreSQL responsive in Querying and storing in database.
- Developed entire frontend and backend modules using Python on Django including Tastypie Web Framework using Git.
- Managed datasets using Panda data frames and MySQL, queried MYSQL database queries from python using ETL and ELT tools like SSIS.
- Generating various capacity planning reports (graphical) using Python packages like Numpy, matplotlib.
- Created database using MySQL, wrote several queries to extract data from database and Setup automated cron jobs to upload data into database, generate graphs, bar charts, upload these charts to wiki and backup the database.
- Developed Merge jobs in Python to extract and load data into MySQL database and Successfully migrated the Django database from SQLite to MySQL to PostgreSQL with complete data integrity.
- Dynamic implementation of SQL server work on website using SQL developer tool and Designed front end using UI, HTML, Bootstrap, Node JS, underscore JS, Angular JS, CSS, and JavaScript.
- Followed AGILE development methodology to develop the application and Designed, developed and maintained PostgreSQL database architecture
- Developed server side application to interact with database using Spring Boot and Hibernate.
- Used and customized apache server to for checking our developed project and Used Test driven approach (TDD) for developing services required for the application.
- Implemented Integration test cases and Used Git to resolve and coding the work on python and portlet
Environment: Python 2.7 (Numpy. Pandas, Scikit-learn), Django 1.6, C, C++, HTML5, CSS, XML, MySQL, MySQL, JavaScript, Angular JS, Kubernetes, Spring Boot, Big Data,Terraform, Backbone JS, JQuery, Sagemaker, CSS Bootstrap, T-SQL, JavaScript, Ansible Eclipse, Git, GitHub Linux, Shell Scripting.
Confidential, Greenville, SC
Sr. Python Developer
Responsibilities:
- Followed Agile Methodologies to manage full life-cycle development of the project.
- Writing backend programming in Python and used the Django Framework to develop the application.
- Implemented user interface guidelines and standards throughout the development and maintenance of the website using the HTML5, CSS3, JavaScript, JQuery and Angularjs.
- Developed views and templates with Python and Django view controller and templating language to create a user-friendly website interface.
- Developed RESTful services using Django.
- Designed and developed communication between client and server using Secured Web services.
- Developed and tested many features for dashboard using Python, Java, Bootstrap, CSS, JavaScript and JQuery.
- Used JavaScript and XML to update a portion of a webpage.
- Experienced in building a Command line tool to interact with RESTful API using in Golang.
- Using Go Programming Language (GoLang) and Scala in the development of the application.
- Avoid Goroutine leaks by utilizing wait groups and error groups
- Documenting code extensively for use with godoc
- Used Terraforms to launch EC2 instances by writing a configuration file and destroy them if not required.
- Run a single command on the nodes to provision the infrastructure of the organization using Terraform.
- Worked on changes to openstack and AWS to accommodate large-scale data center deployment.
- Used Amazon Cloud EC2 along with Amazon SQS to upload and retrieve project history.
- Experience in project deployment using Heroku/Jenkins and using web services like Amazon Web Services (AWS) EC2, AWS S3, Auto scaling, Cloudwatch and SNS.
- Created interactive data charts on Customer portal web application using Highcharts JavaScript library with data coming from Apache Cassandra.
- Worked on front end frameworks like CSS, Bootstrap for development of Web application.
- Worked in MySQL database on simple queries and writing Stored Procedures for normalization.
- Deployed the project into Jenkins using GIT version control system.
- Learned to index and search/query large number of documents inside Elastic search.
- Worked with WEB API's to make calls to the web services using URLs, which would perform GET, PUT, POST and DELETE operations on the server.
- Created stored procedure, trigger on the database to provide/insert specific data from multiple tables for Web API services.
- Wrote code to support model-view-controller (MVC) pattern of Python Django framework in developing several modules for the application.
- Developed Application to access JSON and XML from Restful Web Service from consumer side using JavaScript.
- Developed remote integration with third party platforms by using RESTful web services.
- Creating invitation flow for customers to use the client portal for monitoring applications.
- Created the environment specific settings for a new deployment and update the deployment specific conditional checks in code base to use specific checks.
Environment: Angular,Python, Bootstrap, SOAP, Go, Golang, REST, Pathwise Analytics studio, AON Pathwise modelling, Windows Azure Servlet, Terraform, Flask, Django, JBoss, IntelliJ, Oracle 10g/11g, XML, Java Script, CSS, HTML, GIT, Windows, Agile, JIRA