We provide IT Staff Augmentation Services!

Sr. Python/api Developer Resume

4.00/5 (Submit Your Rating)

Johnston, RI

SUMMARY

  • Sr. Python Developer with specialization in design, development, testing and implementation of various stand - alone and client-server architecture based enterprise application software in Python along with strong experience in analytical programming using Python 3.6/3.4.6, Django 1.9/1.8, Flask and C++, XML, CSS3, HTML 5, JavaScript, jQuery & AngularJS.
  • Experienced in developing Web Services with Python programming language - implementing JSON based RESTful and XML based SOAP webservices.
  • Experience in developing and designing Web Based, Multi-tier distributed applications using latest analytical programming Python, Django, PHP, XML, CSS, HTML, Java Script and jQuery.
  • Experience in Amazon Web Services (AWS) cloud platform like EC2, Virtual private clouds (VPCs), Storage models (EBS, S3, instance storage), Elastic Load Balancers (ELBs), RDS, Redshift, Cloud Formation, SNS, Athena, Cloud Watch, IAM, Lambda.
  • Experienced in Setting up the build and deployment automation for Terraform scripts using Jenkins.
  • Experienced in NoSQL technologies like DynamoDB, Cassandra, MongoDB and relational databases like Oracle, SQLite, PostgreSQL and MySQL databases. experience in developing Web Applications using HTML (4/5), CSS (2/3), JavaScript, TypeScript, Angular (2/4), Node.js, Express JS, jQuery, AJAX, XML, Bootstrap, JSON, Java/J2EE.
  • Worked with ETL tools Including Talend Data Integration, Talend Big Data, Pentaho Data Integration and Informatica.
  • Expertise in Service Oriented Architecture (SOA) and its related technologies like Web Services, BPEL, WSDLs, SOAP1.1, XML, XSD, XSLT etc.
  • Private Cloud Environment - Leveraging AWS and Puppet to rapidly provision internal computer systems for various clients.
  • Experience with Chef Enterprise Hosted as well as On-Premise, Installed Workstation, Bootstrapped Nodes, Wrote Recipes and Cookbooks and uploaded them to Chef-server, managed On-site Applications/ Services/Packages using Chef as well as AWS for EC2/S3/Route53 & ELB with Chef Cookbooks.
  • Experienced in developing Web Services with Python programming language - implementing JSON based RESTful and XML based SOAP webservices.
  • Experience building reusable framework for consuming and providing REST API’s using Java/ Node.js / Python / Swagger.
  • Experience data processing like collecting, aggregating, moving from various sources using Apache Flume & Kafka.
  • Performed Unit testing, Integration testing and generating of test cases for web applications using Junit and Python Unit test framework.
  • Good working experience in processing large datasets with Spark using Scala and Pyspark and Familiar with JSON based REST Web services.
  • Good experience using various Python libraries to speed up development (Beautiful Soup, NumPy, SciPy, Matplotlib, python-twitter, Pandas data frame, network, Pickle, Pyside, urllib2, DynamoDB for database connectivity, JSON libraries).
  • Good experience in Hadoop technologies like Apache Spark, Scala, and Spark SQL.
  • Strong experience in DevOps Environment by enhancing Continuous Delivery and infrastructure change by using Chef, Ansible, Kubernetes and Docker to deploy code with GIT, Jenkins.
  • Strong Experience in Big data technologies including Apache Spark, Hadoop, HDFS, Hive, Cassandra & DynamoDB.
  • Experienced in using Version Control Systems like GIT, SVN and CVS to keep the versions and configurations of the code organized.
  • Good hands on experience with pyspark for using Spark libraries by using python scripting for data analysis.
  • Excellent knowledge in Hadoop ecosystem, HDFS, MapReduce, Spark, Hive, AWS - EMR, S3, Athena, Kinesis, Glue, Flume, Sqoop, HBase, Confidential.
  • Experienced in developing web-based applications using HTML/HTML5, DHTML, CSS/CSS3, JavaScript, Angular JS, AJAX, XML and JSON.

PROFESSIONAL EXPERIENCE

Sr. Python/API Developer

Confidential - Johnston, RI

Responsibilities:

  • Created API’s to consume data from REST endpoints and cleansing the data and store it in database.
  • Developed AWS centralized logging solutions for security teams to consolidate AWS logs and analyze them to detect incidents, using Elasticsearch Service, CloudTrail, VPC flow logs and EC2 server logs.
  • Used Spark for streaming APIs to perform transformations and actions on the fly for building the common learner data model which gets the data from Kafka in near real time and persists into Cassandra.
  • Design and Develop ETL Processes in AWS Glue to migrate Campaign data from external sources like S3, ORC/Parquet/Text Files into AWS Redshift.
  • Used Python and Django creating graphics, XML processing, data exchange and business logic implementation & Utilized PyUnit, the Python unit test framework, for all Python applications.
  • Wrote Python, Golang and Linux shell scripts to streamline the data analysis, algorithm development, and model optimization workflows.
  • Provisioned the highly available EC2 Instances using Terraform and cloud formation and wrote new plugins to support new functionality in Terraform.
  • Created Typescript reusable components and services to consume REST API's using Component-based architecture provided by Angular. Developed single page applications using Angular 2, Typescript, web pack and grunt.
  • Worked on ETL Migration services by developing and deploying AWS Lambda functions for generating a serverless data pipeline which can be written to Glue Catalog and can be queried from Athena.
  • Designed detailed Migration Plans for Workloads from any platform to AWS & Utilized workload migration tools to AWS (i.e. Cloudscape, Zerto, Platespin, etc.)
  • Created MySQL queue using AWS SNS, SQS, and Golang (Go), to concurrently process SQL queries in the background and Built a Golang web server to host multiple tools so another has http access to them.
  • Implemented a 'server less' architecture using API Gateway, Lambda, and Dynamo DB and deployed AWS Lambda code from Amazon S3 buckets. Created a Lambda Deployment function and configured it to receive events from S3 bucket.
  • Worked on Stretch Database feature of SQL Server for the cold data residing on on-premises SQL Server Databases can be migrated transparently and securely to AWS. Worked on Amazon Kinesis to process and analyze streaming data with standard SQL.
  • We also worked on DynamoDB to maintain the record of all the logs. These were all constructed via IaaC like CloudFormation and Terraform.
  • Worked on functions in Lambda that aggregates the data from incoming events, and then stored result data in Amazon DynamoDB.
  • Created various performance metrics and configured notifications using CloudWatch and SNS.
  • Setup the CloudWatch monitoring dashboards with SNS notification configurations on various performance metrics retrieved from various AWS Resources.
  • Worked on Service Oriented Architecture (SOA) and its related technologies like Web Services, BPEL, WSDLs, SOAP1.1, XML, XSD, XSLT etc.
  • Worked on writing complex SQL queries with multiple joins to fetch data and work on validation for the processed data in ETL jobs.
  • Designed and developed Use-Case Diagrams, Class Diagrams, and Object Diagrams using UML Rational Rose for OOA/OOD techniques.
  • Set-up databases in AWS using RDS, storage using S3 bucket and configuring instance backups to S3 bucket.
  • Created functions and assigned roles in AWS Lambda to run python scripts, and AWS Lambda using java to perform event driven processing.
  • Created API’s to consume data from REST endpoints and cleansing the data and store it in database.
  • Used Spark for streaming APIs to perform transformations and actions on the fly for building the common learner data model which gets the data from Kafka in near real time and persists into DynamoDB.
  • Developed the ETL jobs as per the requirements to update the data into the staging database (Postgres) from various data sources and REST API’s.
  • Created external tables with partitions using Hive, AWS Athena and Redshift
  • Containerized and Deployed the ETL and REST services on AWS ECS through the CI/CD Jenkins pipe.
  • Managed the Docker container through the pods and performing the load balance between the pods through Kubernetes.
  • Used Kubernetes to deploy scale, load balance, and worked on Docker Engine, Docker HUB, Docker Images.
  • Implemented Workload Management (WML) in Redshift to prioritize basic dashboard queries over more complex longer running adhoc queries.
  • Used python for end to end processing of documents with Spark Streaming, Kafka RPC framework and AWS.
  • Implemented a Continuous Delivery pipeline with Docker, Jenkins, GitHub and AWS AMI's, also worked on creating the Docker containers and Docker consoles for managing the application life cycle.
  • Developed Puppet modules and role/profiles for installation and configuration of software for required for various applications/blueprints.
  • Used Pandas API to put the data as time series and tabular format for east timestamp data manipulation and retrieval.

Python AWS Developer

Confidential - San Jose, CA

Responsibilities:

  • Used AWS Redshift, S3, Spectrum and Athena services to query large amount data stored on S3 to create a Virtual Data Lake without having to go through ETL process.
  • Built/deployed custom Docker images from Artifactory into Amazon Elastic Kubernetes Service (EKS) K8s cluster as part of a Gitlab CI pipeline.
  • Worked on Amazon Kinesis Streams to collect and process large streams of data records.
  • Used DynamoDB global tables to replicate data across multiple AWS Regions to get fast, local access to data for globally distributed applications.
  • Configured NoSQL databases like Apache Cassandra and Mongo DB to for increasing compatibility with Django.
  • Experience in setting up Elastic Load Balancers (ELB's) and Auto Scaling groups on Production EC2 Instances to build Fault-Tolerant and High Availability applications.
  • Designed and managed API system deployment using fast HTTP server and Amazon AWS architecture & Setup database in AWS using RDS and configuring backups for S3 bucket.
  • Migrated infrastructure from inhouse servers to AWS cloud. Used Docker Container, EC2, IAM, RDS, Route 53, REST API gateway and Lambda of AWS.
  • Developed data transition programs from DynamoDB to AWS Redshift (ETL Process) using AWS Lambda by creating functions in Python for the certain events based on use cases.
  • Used CloudWatch and SNS for monitoring AWS Cloud resources and the application that were deployed on AWS by creating new alarm and enabling notifications.
  • Build servers using AWS Importing volumes, launching EC2, creating security groups, Auto-scaling, load balancers, Route53, SES and SNS in the defined virtual private connection (VPC).
  • Created S3 buckets and managing policies for S3 buckets and Utilized S3 bucket and backup on AWS. Designed code to transform logs from AWS CloudWatch to Kibana.
  • Used IAM to create new accounts, roles and groups and polices and developed critical modules like generating amazon resource numbers and integration points with S3, Dynamo DB, RDS, Lambda and SQS Queue.
  • Designed CI/CD processes in the context of a Jenkins orchestration, including the use of automated build, test/ QA and deployment tools.
  • Worked on optimizing and memory management of the ETL services
  • Used GitHub repository to submit code changes & for source code version control and deploying in AWS Lambda.
  • Provisioning the AWS EC2 servers by assigning the EBS volumes, auto scaling groups, load balancers, security groups in the defined VPC (Virtual Private Cloud).
  • Developed an ETL service that looks for the files in the server and update the file into the Kafka queue.
  • Built Jenkins jobs to create AWS infrastructure from GitHub repos containing Terraform code.
  • Designed and maintained databases using Python and developed Python-based API (RESTful Web Service) using Flask, SQL Alchemy, and PostgreSQL.
  • Developed Spark Streaming script which consumes topics from distributed messaging source Kafka and periodically pushes batch of data to spark for real time processing.

Python Developer

Confidential - Pittsburgh, PA

Responsibilities:

  • Developed Microservices, and creating API's using Java Spring Boot framework using Maven as a build tool and Cassandra as an enterprise level database.
  • Used Test driven (TDD) approach for developing the application and Implemented the unit tests using Python PyTest Framework.
  • Generated Python Django forms to record data of online users and used Py-test for writing test cases.
  • Developed RESTful Web Services for getting and sending data from the external interface in the JSON format.
  • Created Jenkins build and deployment pipeline jobs to deploy the docker images into AWS ECR repositories and integrated with GITHUB. Performed debugging, testing, maintaining and deploying the application.
  • Designed the data models to be used in data intensive AWS Lambda applications which are aimed to do complex analysis creating analytical reports for end-to-end traceability.
  • We created an on-premise application to trigger AWS GLUE ETL process, those triggers were mainly using lambdas and step functions. Wrotepythonscripts to manage AWS resources from API calls usingBOTOSDK and worked withAWS CLI.
  • Developed Python scripts to monitor health of MongoDB and performed-hoc backups using Mongo dump and Mongo restore.
  • Implemented continuous integration using Jenkins and involved in the deployment of application with Ansible automation engine.
  • Imported required tables RDBMS to HDFS using Sqoop & also used Storm and Kafka to get real time streaming of data into HBase.
  • Developed Docker container based micro services using Spring Boot/Cloud and deployment on Kubernetes cluster & a fully automated continuous integration system using Git, SQL Server and custom tools developed in Python and Bash.
  • Developed Sqoop scripts to handle change data capture for processing incremental records between new arrived and existing data in RDBMS tables. Added support for Amazon AWS S3 and RDS to host static/media files and the database into Amazon Cloud.
  • Managed datasets using Panda data frames and MySQL, queried MYSQL database queries from python using Python-MySQL connector and MySQL dB package to retrieve information.
  • Implemented AWS high availability using AWS Elastic Load Balancing (ELB), which performed balance across instances.
  • Used Python unit and functional testing modules such as unit test, unittest2, mock, and custom frameworks in-line with Agile Software Development methodologies.
  • Created Restful API in NodeJS and communicate with Clojure server via protocol and use Backbone to generate template.
  • WroteAnsibleplaybooks to launchAWSinstances and usedAnsibleto manage web applications, configuration files, used mount points and packages.
  • Cleaned data and processed third party spending data into maneuverable deliverables within specific format with Excel macros and python libraries such as NumPy, SQLAlchemy and matplotlib.
  • Used GitHub for Python source code version control, Jenkins for automating the build Docker containers, and deploying in Mesos.
  • Used PyUnit, the Python unit test framework, for all Python applications. Worked on Jenkins continuous integration tool for deployment of project.
  • Designed the functionality to read the data from MySQL and clean the data and arrange the data into timeframes using Pandas.
  • Worked with version control tools like, CVS, SVN, Perforce and expertise in DevOps using tools like Jenkins, Bamboo, Gradle, Serena Products, Clear Case, and Build Forge, Hudson.

Python Developer

Confidential

Responsibilities:

  • Worked on container Services (AKS) for deploying CI/CD pipelines integrated with Git, Jenkins and Docker for micro services-based applications.
  • Wrote Python modules to view and connect the Apache Cassandra instance. Developed Pyspark code using Python and Spark-SQL for faster testing and data processing.
  • Responsible for Configuring Kafka Consumer and Producer metrics to visualize the Kafka System performance and monitoring.
  • Installed and configured Hadoop MapReduce, HDFS, Developed multiple MapReduce jobs in java for data cleaning and pre-processing.
  • Designed and developed Application based on the Django MVC Framework using MVC design pattern. Developed the REST API using Django for fetching the data from NoSQL MongoDB database.
  • Used Angular JS framework for single page applications and validating the client-side user information based on their business rules.
  • Designed and managed API system deployment using fast http server and Amazon AWS architecture.
  • Implemented AWS solutions using E2C, S3, RDS, EBS, Elastic Load Balancer, Auto-scaling groups. Implemented AWS client API to interact with different services as Console configuration for AWS EC2.
  • Developed tools using Python, Shell Scripting and XML to automate some of the menial tasks. Interfacing with supervisors, artists, systems administrators and production to ensure production deadlines are met.
  • Worked with MVW frameworks like Django, AngularJS, HTML, CSS, XML, Java Script, jQuery, Bootstrap. And Worked on designing, coding and developing the application in Python using Django MVC.
  • Developed a front-end application using React.JS and FLUX architecture for internal team's productivity use. Designed SPA (Single page applications) in Flux architecture
  • Designed and developed the UI of the website using HTML5, CSS3, JavaScript, AngularJS and jQuery.
  • Used Django configuration to manage URLs and application parameters. Responsible for gathering requirements, system analysis, design, development, testing and deployment.
  • Implemented RESTful Web-Services for sending and receiving the data between multiple systems.
  • Developed Python based API (RESTful Web Service) to track the events and perform analysis using Django.
  • Views and Templates were developed with Python and to create a user-friendly website interface Django’s view controller and template language is used. Worked on writing JSPs, JavaScript and Servlets to generate dynamic web pages and web content.

We'd love your feedback!