Lead Python Developer Resume
Palo Alto, CA
SUMMARY
- 9 + Years of experience in Analysis, Design, Development, Management, and Implementation of various standalone and client - server architecture-based enterprise application software.
- Demonstrate a full understanding of the Fact/Dimension data warehouse design model, including star and snowflake design methods.
- Evaluating and selecting data warehousing tools for business intelligence, data population, data management, metadata management, and warehouse administration.
- Work with e-commerce and systems that support supply chain management and APIs.
- Evaluate and select data warehousing tools for business intelligence, data population, data management, metadata management, and warehouse administration.
- Extensive knowledge inPython, PHP, MySQL, NoSQL, UNIXandLinux.
- Experience with Design, code, debug operations, reporting, data analysis and web applications utilizing Python.
- WrittenTerraformtemplates,ChefCookbooks, recipes and pushed them ontoChefServer for configuringEC2Instances.
- Experience in AWS platform and its features includingIAM, EC2,EBS,VPC,RDS,Cloud Watch,Cloud Trail,Cloud FormationAWS Configuration,Autoscaling,Cloud Front, S3, SQS, SNS, LambdaandRoute53.
- Experienced in source to target data mapping using Data lineage technique and calculating the impact on the data flow using Impact Analysis.
- Experienced in MVW frameworks likeDjango,Angular.js, Java Script, jQueryandNode.js.
- Experience working with notebook technologies like Jupiter and open-Source distribution Anaconda.
- Created automated pipelines in AWS Code Pipeline to deployDockercontainers in AWSECSusing serviceslikeCloudFormation,Code Build,Code Deploy,S3andpuppet
- Expertise in AmazonAWS Cloud Administration which includes services like:EC2,S3,EBS,VPC,ELB,AMI,SNS,RDS,IAM,Route53,Autoscaling,CloudFront,CloudWatch,CloudTrail, Lambda,CloudFormation,SecurityGroups.
- Experience in using Informatica Metadata Manager to perform data lineage.
- Worked onHadoop, Hive, JAVA, python, Scala Struts web framework.
- Hands on experience in AWS like Amazon EC2, Amazon S3, Amazon Redshift, Amazon EMR and Amazon SQS.
- Implemented CI/CD process, CIT automated testing, deployment using Hg/GIT, REST API, Gradle & Puppet.
- Develop data cleansing, retrieval, migration tools & Experience in writing JSON REST APIs usingGolang.
- Implemented a'server less'architecture usingAPI Gateway, Lambda, and Dynamo DBand deployedAWS Lambda codefrom Amazon S3 buckets. Created a Lambda Deployment function, and configured it to receive events from your S3 bucket
- Designed the data models to be used in data intensiveAWS Lambdaapplications which are aimed to do complex analysis creating analytical reports for end-to-end traceability, lineage, definition of Key Business elements from Aurora.
- Having knowledge in Amazon EC2, S3, VPC, RDS, Elastic Load Balancing, Autoscaling, IAM, SQS, SWF, SNS, Security Groups, Lambda, Cloud Watch services.
- Worked on standard python packages like boto and boto3 for AWS.
- Good experience in working with various Python Integrated Development Environments likePyCharm, Spyder,Jupyter Notebook, Anacondaand UBUNTU.
- Hands on Experience in AWS like Amazon EC2, Amazon S3, Amazon Redshift, Amazon EMR and Amazon SQS.
- Worked with MVW frameworks likeDjango, Angular JS, HTML, CSS, XML, Java Script, jQuery, JSONandNode.js.
- Involvement in building frameworks and automating complex workflows using Python for Test Automation.
- Good knowledge in using apacheNiFito automate the data movement between different Hadoop systems.
- Created entire application using Python, Django, Flask, MySQL and Linux.
- Experience in writing REST APIs in Python for large-scale applications.
- Experience in resolving on-going maintenance issues and bug fixes; monitoring Informatica sessions as well as performance tuning of mappings and sessions.
- Configuring, automation and maintaining build and deployment CI/CD tools Git/GitLab, Docker
- Wrote Python modules to extract/load asset data from the MySQL source database.
- Good Command of web services with protocolsSOAP, REST.
- UtilizedPyUnit, the Python unit test framework, for all Python applications.
- Anticipated potential parts of failure (database, communication points, file system errors).Good working experience in using version control systemsCVS, SVN,Amazon EC2, Git, and GitHub.
- Evaluated potential software products based on new and existing system development and migration requirements.
- Proficient in using Confidential Web Services AWS. Extensive experience focusing on services like EC2, VPC, Cloud Watch, Cloud Front, Cloud Formation, IAM, S3, Confidential RDS, Elastic Cache, SNS, SQS.
- Performed regression and system-level testing to verify software quality and function before it was released.
- Familiar with UNIX / Linux internals, basic cryptography & security
- Experience in working with Python ORM Libraries includingDjango ORM.
- Superior Troubleshooting and Technical support abilities with Migrations, Network connectivity and Security and Database applications.
- Assessed costs and risks associated with developing new features and products.
- Set up rules and policies with aNode.js/Pythonback end.
- Front-end web development using HTML/CSS, JQuery, Bootstrap as well as back-end development usingGolangandSQL.
- Contributed to the Python codebase used in the automated deployment of software on multiple virtual machines.
- Expertise in Production support and knowledge of deployment using AWS, Heroku and Jenkins.
- Experienced in requirement gathering, Use case development, Business Process flow, Business Process Modelling Strong knowledge and experience onAWS, specifically inLambda,IAM,API Gateway,Dynamo DB,S3,Cloud Front,VPC,EC2.
- Responsible for user validations on client side as well as server side.
- Adept at automating repetitive work throughShell scriptsand Python.
- Leading, guiding and helping the team members with the challenges faced during the project development process and problem solving.
- Able to analyse a requirement and act accordingly by managing the resources efficiently.
TECHNICAL SKILLS
- Python
- Django
- Angular
- Node.js jQuery
- Vue.js
- React
- Snowflake
- MySQL
- Java
- Bootstrap.js
- HTML
- PostgreSQL
- JDBC
- C
- C++
- AWS
- Flask
- Anaconda
- Ansible
- MongoDB
- Pandas.
PROFESSIONAL EXPERIENCE
Lead Python Developer
Confidential, Palo Alto, CA
Responsibilities:
- Worked on development ofinternal testing tool frameworkwritten inPython.
- Worked with Marketing and Sales teams to enhance applications to suit their needs.
- DevelopedGUIusing Python and Django fordynamically displaying block documentationand other features of python code using a web browser.
- Involved in ingesting data into HDFS using ApacheNifi. Developed and deployed ApacheNififlows across various environments, optimizedNifidata flows and written QA scripts in python for tracking missing files.
- Wrote various data normalization jobs for new data ingested into Redshift.
- Developed web page and form validation with team using Angular.JS, React, Bootstrap.js, Node.js, Backbone.js, HTML5, CSS & JavaScript.
- Advanced knowledge on Confidential Redshift and MPP database concepts.
- Migrated on premise database structure to Confidential Redshift data warehouse
- Experienced in building a Command line tool to interact with RESTful API using inGolang.
- Architected and developed a Golang API using TDD to aggregate data to show application server alignment.
- Deploying and maintaining production environment usingAWS EC2 instances and ECS with Docker.
- Configuring, automation and maintaining build and deployment CI/CD tools Git/GitLab
- As part of Data Quality analysis: Traced Data Lineage of data elements to be used in the ADS.
- ODG backend-Images Machine Learning Application Integration Project: - Designing, developing, implementing and testing ODG AR Glass Big-Data Machine Learning application using Python, Pandas, Anaconda, Miniconda, Opensource-TensorFlow, NumPy, SciPy, Machine Learning, Deep Learning, CNN, Images Data-Prediction, Images Preprocessing, Convolution Model, Hidden-Layers, Data-Accuracy and working with ODG Scientist, production team and QA team.
- Experience in working withDocker,Kubernetes, ECScontainer services and successfully deployed the images in the cloud environment for managing Application.
- Maintained stored definitions, transformation rules and targets definitions using Informatica repository Manager.
- Configuring, automation and maintaining build and deployment CI/CD tools Git/GitLab
- AutomatedAWSvolumes snapshot backups for enterprise using Lambda.
- Created functions and assigned roles in AWSLambdato run python scripts.
- Used various transformations like Filter, Expression, Sequence Generator, Update Strategy, Joiner, Stored Procedure, and Union to develop robust mappings in the Informatica Designer.
- Wrotescripts inPythonfor extracting data fromHTMLfile.
- Developed views and templates withPythonandDjango'sview controllerand templating language to create a user-friendly website interface.
- UsedJavaScriptandJSONto update a portion of a webpage.
- Performed troubleshooting, fixed and deployed manybug fixes for applications that were a main source of data for both customers and internal customer service team.
- Front-end web development using HTML/CSS, JQuery, Bootstrap as well as back-end development usingGolangandSQL.
- Handled potential points of failure (database, communication points and file system errors) through error handling and communication of failure.
- Implemented CI/CD process, CIT automated testing, deployment using Hg/GIT, REST API, grble & Puppet.
- WrotePython scriptstoparse JSON documentsand load the data in database.
- Worked on Restful APIs to access the third-party data for the internal analysis and statistical representation of data.
- Developed PySpark/Scala, Python for regular expression (regex) project in the Hadoop/Hive environment with Linux/Windows for big data resources.
- UsedPythonandDjangoto interface with thejQuery UIand manage the storage and deletion of content.
- Developed entire frontend and backend modules usingPythononDjangoincludingTasty pieWeb Framework usingGit.
- Developed the project in Linux environment. Prepared test data files using Linux Shell scripts, Perl script as per the business requirements.
- Utilized Python Libraries like Boto3, numPY for AWS.
- Using raw files loaded data files from URLs to Amazon S3 Bucket.
- Worked on reading queues in Amazon SQS, which have paths to files in Amazon S3 Bucket.
- Aggregate clean files in Amazon S3.
- Build sing page apps, modules, graphics and reusable components using Angular.JS, React.Js, Bootstrap.js, Node.js, Backbone
- Used Amazon EMR for map reduction jobs and test locally using Jenkins.
- Also worked on Amazon EC2 Clusters to deploy files into Buckets.
- Worked on AWS Data Pipeline to configure data loads from S3 to into Redshift
- Used JSON schema to define table and column mapping from S3 data to Redshift
- Worked on front end frame works like CSS Bootstrap for development of Web applications.
- Successfully migrated the Django database from SQLite to MySQL to PostgreSQL with complete data integrity.
- Worked on AWS EC2/VPC/S3/SQS/SNS based on automationTerraform, Ansible, Python, BashScripts.
- Designed front end usingUI, HTML, Bootstrap, Node JS, underscore JS, Angular JS, CSS,andJavaScript.
- Followed AGILE development methodologyto develop the application.
- Involved in Data base design, normalizations and de-normalization techniques.
- Involved in User Acceptance Testing and prepared UAT Test Scripts.
- Effectively communicated with the external vendors to resolve queries.
- Used and customized apache server to for checking our developed project.
- UsedTest driven approach (TDD)for developing services required for the application.
- ImplementedIntegration test cases & UsedGitto resolve and codingthe work onpythonandportlet.
Environment: Python, Django, HTML, CSS, XML, Scala, JavaScript, redux, Angular.js, Docker, React.JS, Redis, JSON, Dojo, Node.js, Backbone.js, Bootstrap, AWS, Elasticsearch, Kafka, Spark, Java, Golang,PL/SQL, MS-Sql, Web Services, SOAP, REST,, Agile, Scrum++, Linux.
Lead Python Developer
Confidential, Bannockburn, IL
Responsibilities:
- Lead the team in developing the test algorithms for covering all the scenarios during the virtual machine switching
- Used UML Rational Rose to develop Use-case, Class and Object diagrams for OOA/OOD techniques.
- Builtdatabase model, Views and API'susing Python for interactive web-based solutions.
- Placed data intoJSONfiles using Python to test Django websites. Used Python scripts to update the content in database andmanipulate files.
- Worked withTerraformto create AWS components likeEC2, IAM, VPC, ELB, Security group.
- Developed web-based application using Django framework with python concepts.
- Generated Python Django forms to maintain the record of online users.
- Developed a decision tree learning algorithm using Python and applied it to a synthetic dataset
- UsedDjango APIsto access the database.
- Created a project for predicting future sales volumes with SAS skills, including SAS/MACRO, SAS /IML, SAS/GRAPH, SAS/BASE, and SAS/STAT.
- Worked with HTML and CSS for website design,JavaScriptfor scripting, and used Express.JS and Node.JS frameworks for server-side connectivity.
- Extensively used Twitter Bootstrap for creating grid layout, responsive screen sizes and devices. Worked on NodeJS scripts, Karma, Jasmine for unit testing.
- Developed Single Page applications using AngularJS using components, directives using JavaScript, Backbone.js, TypeScript and NodeJS.
- Developed a Nifi Workflow to pick up the data from SFTP server and send that toKafkabroker. Loaded D-Stream data intoSpark RDDand did in-memory data computation to generate output response.
- Started using apacheNiFito copy the data from local file system toHDFS.
- Contributed source code in Golang to developing an automation framework for AWS CFN.
- Involved in Python OOD code forquality, logging, monitoring, and debuggingcode optimization.
- Skilled in using Collections in Python for manipulating and looping through different user defined objects.
- Built and Deployed Docker images on AWS ECS and automated the CI-CD pipeline.
- Configured the AWS ALB to route the traffic from target group to right targets on AWS ECS.
- Configuring, automation and maintaining build and deployment CI/CD tools Git/GitLab, Docker.
- Wrote Python modules to view and connect theApache Cassandrainstance.
- Created Unit test/ regression test framework for working/new code.
- Utilized standard Python modules such as CSV, itertools and pickle for development.
- Developed efficientAngular.jsfor client web-based application.
- UsedAWS Cloud Watchto monitor and store logging information
- Responsible for designing, developing, testing, deploying and maintaining the web application.
- Designed and developed the UI for the website with HTML, XHTML, CSS, Java Script and AJAX.
- Involved in working with Python open stock API's.
- Used Amazon Elastic Beanstalk with Amazon EC2 to deploy project into AWS
- Wrote and executed various MySQL database queries from Python-MySQL connector andMySQL db package.
- Used the Python's modulesnumpy, matplotlib, etc. for generating complex graphical data, creation of histograms etc.
- Developed and designed automation framework usingPythonandShell scripting.
- Involved in debugging and troubleshooting issues and fixed many bugs in two of the main applications which are main source of data for customers and internal customer service team.
- ImplementedSOAP/RESTfulweb services in JSON format.
- Deployed project into Amazon web services (AWS) using amazon elastic bean stalk.
- Attended many day-to-day meetings with developers and users and performed QA testing on the application.
- Experience in using containers like Docker.
Environment: Python, Django, HTML, CSS, XML, Scala, JavaScript, redux, Angular.js, Docker, React.JS, Redis, JSON, Dojo, Node.js, Backbone.js, Bootstrap, AWS, Elasticsearch, Kafka, Spark, Java, Golang, PL/SQL, MS-Sql, Web Services, SOAP, REST, Agile, Scrum, C++, Linux.
Lead Python Developer
Confidential, Redwood City, CA
Responsibilities:
- Leading the team membersto look into all the failures seen in execution and categorize to various signature buckets
- Responsible for using the best technologies to add features to the existing system and services.
- Involved in all aspects of the development process from product inception to scaling in production.
- Accountable for driving software development best practices for the team and also mentoring and developing junior engineers.
- To fetch data of definite options that are selected, Python routines were written to log into websites.
- Automated AWS S3 data upload / download using Python scripts.
- Responsible for setting up Python REST API framework using DJANGO.
- Tackled highly imbalanced Fraud dataset using sampling techniques like down-sampling, up-sampling and SMOTE (Synthetic Minority Over-Sampling Technique) using Python Scikit-learn.
- Developed and implemented UI controls and APIs with JavaScript, Bootstrap, Ember.js, Backbone.js, Angular.js and Node.js. Used Node.JS for asynchronous data communication between server and client.
- Writing REST APIs, as part of developing web-based applications for insurance premium calculations, using Django’sREST framework.
- Experience in breaking down information utilizing Pig Latin Scripts and Hive Query Language, Experience in Apache NIFI which is a Hadoop technology and also Integrating ApacheNIFIand Apache Kafka.
- Heavily leveragedPython’s graphics APIs for creating graphics and serialization libraries for encoding data inXML/JSONformats.
- Correspondingly involved in writingREST APIsusingDjango frameworkfor data exchange and business logic implementation. Deployed project into Amazon web services (AWS) using amazon elastic bean stalk.
- Developed Golang API and chat-bot using TDD to automate software deployments and rollbacks
- Involvement in using collections inPythonfor manipulating and looping through different user defined objects.
- Used Django configuration to manage URLs and application parameters.
- Experience on working with Apache Nifi for Ingesting data into Bigdata from different source system.
- Responsible for configuringNoSQLdatabases likeApache CassandraandMongo DBto for increasing compatibility with Django.
- Developed and tested many features for dashboard using Python, Bootstrap, CSS, and JavaScript
- Built various graphs for business decision making using Python library.
- Good hands-on experience with Python API by developing Kafka producer, consumer for writing Avro Schemes.
- Actively worked as a part of team with managers and other staff to meet the goals of the project in the stipulated time.
- Developed and executedUser Acceptance Testingportion of test plan.
- GeneratedDjango forms to record data of online users and usedPyTestfor writing test cases.
Environment: Python, Django, HTML, CSS, XML, Scala, JavaScript, redux, Angular.js, Docker, React.JS, Redis, JSON, Dojo, Node.js, Backbone.js, Bootstrap, AWS, Elasticsearch, Kafka, Spark, Java, Golang, PL/SQL, MS-Sql, Web Services, SOAP, REST, Agile, Scrum, C++, Linux.
Sr. Python Developer
Confidential, Seattle, WA
Responsibilities:
- Designed and developed data management system using MySQL.
- Worked on high level design and detail design.
- Design, develop, test, deploy and maintain the website.
- Responsible for implementingMap Reduceprograms intoPySparktransformations usingPySpark and Scala.
- Getting real time data usingKafkaand processing usingPySpark and Scala.
- Developed the interactive user interface using jQuery JavaScript library.
- Developed/ModifiedGUIusingHTML, CSSandJavaScript (jQuery).
- Created data dictionary,data lineage documentation and ETL, and also calculating the impact analysis.
- Built application logic using Python 2.7, Django and MYSQL.
- Rewrite existingPython/Djangomodules to deliver certain format of data.Used Django Database APIs to access database objects.
- Created internal diagnostic tools usingGolangandAngularJSin order to assist with customer issues.GolangandJavawere used as a backend REST service whileAngularJSwas used for the user interface.
- Developed responsive web product features using React JS, SASS, onGolangwith REST.
- Built enterprise-wide DNS historical data trending analysis tools in Go (Golang), Languages with REST API for user queries as microservice.
- Building a Command line tool to interact with RESTful API using inGolang.
- Be responsible in transforming the data which the required by the Salesforce Marketing Cloud. Using the AWS Glue to transform the data and stage it in the Amazon S3.
- Using the Crawler to create the database catalog in the AWS Glue which is used to create the database schema.
- Use TCP/IP protocol to connect with server which has database available to connect for the ETL tool.
- Used GIT for the version control and deployed project into AWS.
- Developed python scripts to parseXMLdocuments and load the data in database.
- Worked on all the client-side validation using JavaScript. Developed Stored Procedures and used them in Stored Procedure transformation for data processing and have used data migration tools
- Documented Informatica mappings in Excel spread sheet & tuned the Informatica mappings for optimal load performance.
- Worked withjQueryfor all client-side JavaScript manipulation.
- Developed unit test/regression test framework for working/new code.
- Used Subversion control tool to coordinate team-development. Worked with Forms, views, models using Django.
- Developed entirefrontend and backendmodules using Python on Django Web Framework.
- Debugging and troubleshooting the web application.
- Developed views and templates with Python and Django's view controller and templating language to create a user-friendly website interface.
- Generated complex graphical data, creation of histograms etc. using the Python's modulesnumpy, matportlibetc.
Environment: Python, Django, HTML, CSS, XML, Scala, JavaScript, redux, Angular.js, Docker, React.JS, Redis, JSON, Dojo, Node.js, Backbone.js, Bootstrap, AWS, Elasticsearch, Kafka, Spark, Java, Golang, PL/SQL, MS-Sql, Web Services, SOAP, REST, Agile, Scrum, C++, Linux.
Python Developer
Confidential
Responsibilities:
- Worked on requirement gathering and High-level design & UsedHTML/CSS, XMLandJavaScriptfor UI development.
- Converted Visual Basic Application to Python, MySQL.
- Used python scripts to update content in the database and manipulate files.
- Created Reports usingJASPER.
- Modified queries, functions, cursors, triggers and stored procedures forMySQLdatabase to improve performance, while processing data.
- Prepared the Test data (Input files) for interpreting the Positive/Negative/regression results based on the design requirements.
- Developed automated test scripts from manual test cases for Regression testing based on the requirement documents usingQuick Test Professional.
- Used Collections in Python for manipulating and looping through different user defined objects.
- Created data base tables, functions, stored procedures and wrote prepared statements usingPL/SQL.
- AppliedEMV card algorithmsto system via python programs.
- Contributed patches back to Django.
- Responsible for getting the teams up and running with game record features.
- Performed research regarding Python Programming and its uses and efficiency.
- Utilized Python in the handling of all hits onDjango, Redis, and other applications.
- Used Thales theorem for applying encryption and decryption of ISO standard message in Python programming.
- Used Redis as messaging broker to execute asynchronous tasks.
- Developed object-oriented programming to enhance company product management.
- FollowedAgileMethodology andSCRUMProcess.
- Extensive code reviewing usingGitHubpull requests, improved code quality, and conducted meetings among peer.
- Collaborated with Product Management and User Experience experts regarding product definition, schedule, scope and project-related decisions.
- Managed, collaborated and coordinated the work of an offshore development team.
Environment: Python, Django, HTML, CSS, XML, Scala, JavaScript, redux, Angular.js, Docker, React.JS, Redis, JSON, Dojo, Node.js, Backbone.js, Bootstrap, AWS, Elasticsearch, Kafka, Spark, Java, Golang, PL/SQL, MS-Sql, Web Services, SOAP, REST, Agile, Scrum, C++, Linux.
Python Developer
Confidential
Responsibilities:
- UsedAgileMethodology andSCRUMProcess.
- Worked with the Stakeholders, gathered requirements, developed High level design and Detail design documents.
- Developed UI using HTML, AJAX, JavaScript and jQuery and jQuery.
- Re-engineered various modules for implementing changes and creating efficient system.
- Developed rich UI web application usingJavaScriptlibraries likejQueryUI, data grid, jscolor, and high charts.
- Designed and developed components using Python with Django framework. Implemented code in python to retrieve and manipulate data.
- Implemented database access usingDjango ORM.
- Used MySQLas backend database and MySQL dB of python as database connector to interact with MySQL server.
- Used Restful APIsto access data from different suppliers.
- Used Python and Django creating graphics,XMLprocessing of documents, data exchange and business logic implementation between servers.
- Associated with Restful APIs to gather network traffic data from Severs.
- SupportedApache Tomcatweb server on Linux Platform.
- Support the scripts configuration, testing, execution, deployment and run monitoring and metering.
- Developed and executed User Acceptance Testing portion of test plan
Environment: Python, Django, HTML, CSS, XML, Scala, JavaScript, redux, Angular.js, Docker, React.JS, Redis, JSON, Dojo, Node.js, Backbone.js, Bootstrap, AWS, Elasticsearch, Kafka, Spark, Java, Golang, PL/SQL, MS-Sql, Web Services, SOAP, REST, Agile, Scrum, C++, Linux.