Sr Data Engineer Resume
Denver, CO
SUMMARY
- 6+ years of experience in Design, Development, Implementation of Python, Django, JavaScript and client - server technology-based applications.
- Experienced in developing web-based applications using HTML/HTML5, DHTML, CSS/CSS3, JavaScript, Angular JS, AJAX, XML and JSON.
- Designed and implemented large scale business critical systems using Object oriented Design and Programming concepts using Python and Django.
- Experience on ETL and ELT Tools like SQL Server Integration Services (SSIS), also have knowledge in Data Migratory (IBI).
- Worked on standard python packages like boot and boto3 for AWS.
- Hands on Experience in AWS like Amazon EC2, Amazon S3, Amazon Red shift, Amazon EMR and Amazon SQS.
- Worked on several standard python packages like NumPy, matplotlib, Pickle, PySide, Scipy, wxPython, PyTables etc.
- Worked on various applications using python integrated IDEs Eclipse, PyCharm, NetBeans and Geany.
- Good experience in developing web applications and implementing Model View Control (MVC) architecture using server-side applications like Django, Flask and Pyramid.
- Well versed with design and development of presentation layer for web applications using technologies like HTML, CSS, and JavaScript.
- Implemented responsive web pages using HTML5/CSS3, Bootstrap and XML/JSON based SOAP and REST web services.
- Good experience in handling errors/exceptions and debugging the issues in large scale applications.
- Hands on experience working in WAMP (Windows, Apache, MYSQL, and Python/PHP) and LAMP (Linux, Apache, MySQL, and Python/PHP) Architecture.
- Experienced in using Caching applications for large scale applications like Memcached, Redis.
- Experienced in working Asynchronous Frameworks like NodeJS, Twisted and designing the automation framework using Python and Shell scripting
- Expertise in working with different databases like Oracle, MySQL, PostgreSQL and Good knowledge in using NoSQL databases MongoDB (2.6,2.4)
- Proficient in developing complex SQL queries, Stored Procedures, Functions, Packages along with performing DDL and DML operations on the database.
- Proficient in Automated Verification and Validation testing tools.
- Hands on Experience in Verification and Validation testing project schedules.
- Excellent working knowledge in UNIX and Linux shell environments using command line utilities.
- Expertise in Production support and knowledge of deployment using AWS, Heroku and Jenkins.
- Experience working in both Water fall and Agile software methodologies.
- Familiarity with development best practices such as code reviews, unit testing, system integration testing (SIT) and user acceptance testing (UAT).
- Hands on experience in working with various Version Control Systems, mostly GIT, CVS and subversion SVN.
- Involved in all the phases of Software Development Life Cycle (SDLC) using Project management tools JIRA, Red mine and Bugzilla.
- Expertise in Verification and Validation tools for coding used in Python.
- Highly motivated, quality minded developer, with proven ability to deliver applications against tight deadlines.
- Possess good interpersonal, analytical presentation Skills, ability to work in Self-managed and Team environments.
TECHNICAL SKILLS
Languages: Python, C#, C++, C, SQL, Java, ASP.net
Web Development: HTML, CSS, JavaScript, AJAX
Frameworks: Django, Flask, CherryPy, Pyramid, NodeJS, Angular JS, JSP, NumPy, Matplotlib, Servlets
Databases: PostgreSQL, MySQL, Cassandra, Redis, MongoDB, SQL Server
Tools: Git, SVN, Mercurial, Memcached, Jira, SSIS, Data Migrator
IDE: Notepad++, Eclipse, IDLE, Geany, PyCharm, Liclipse
Cloud Platforms: AWS, Heroku
PROFESSIONAL EXPERIENCE
Confidential, Denver, CO
Sr Data Engineer
Responsibilities:
- Gathered data files from Data Warehouse URL’s.
- Developed file cleaners using Python libraries and made it clean.
- Utilized Python Libraries like Boto3, NumPy for AWS.
- UsedDjangoAPIs for database access and worked on databases likeMySQL, Postgres.
- Using raw files loaded data files from URLs to Amazon S3 Bucket.
- Worked on reading queues in Amazon SQS, which have paths to files in Amazon S3 Bucket.
- Knowledge about setting up Python REST API Framework usingDjango.
- Modify the existingPython/Djangomodules to deliver certain format of data.
- Aggregate clean files in Amazon S3.
- Used Amazon EMR for map reduction jobs and test locally using Jenkins.
- Also worked on Amazon EC2 Clusters to deploy files into Buckets.
- Worked on Matillion ETL Tool, used it to transfer and load data into Amazon Redshift.
- Mentored and provided technical guidance to other test engineers as necessary during verification and validation activities
- Developed and maintained the Verification and Validation group's project schedules and roadmap ensuring project on schedule.
- Experienced in Agile Methodologies and SCRUM Process.
- Exported/Imported data between various data sources.
- Created database using MySQL, wrote several queries to extract/store data.
Confidential, Dallas, TX
Data Engineer
Responsibilities:
- Analyzed and gathered business requirements specifications by interacting with client and understanding business requirement specification documents.
- Developed the presentation layer using HTML, CSS, JavaScript, jQuery and AJAX.
- Used jQuery libraries for all client-side JavaScript manipulations.
- Utilized Python libraries wxPython, NumPy, Twisted and matplotlib.
- Implemented SQLAlchemy which is a python library for complete access over SQL.
- Worked on Element Tree XML API in python to parse XML documents and load the data in database.
- Skilled in collections and used for manipulating and looping through different user defined objects.
- Developed views and templates with Python and Django's view controller and templating language to created user-friendly website interface.
- Used Django configuration to manage URLs and application parameters.
- Created entire application using Python, Django, MySQL and Linux.
- Used Amazon Elastic Beanstalk with Amazon EC2 to deploy project into AWS.
- Accessed database objects using Django Database APIs.
- Created database using MySQL, wrote several queries to extract/store data.
- Exported/Imported data between various data sources.
- Integrated data from multiple applications using ETL and ELT tools like SSIS.
- Experienced in Agile Methodologies and SCRUM Process.
- Identified several hidden bugs caused by complicated multithreading issues such as race conditions caused by asynchronous events and resolved them.
- Responsible for debugging and troubleshooting the web application.
- Took part in the entire project's lifecycle which includes Design, Development and Deploying, Testing, Implementation and support.
- Used Design patterns efficiently to improve the code reusability.
- Coordinated with the offshore development team and assisted them when required.
Environment: Python 2.7, Django 1.6, CSS, HTML, JavaScript, jQuery, AJAX, MYSQL, Linux, AWS, GIT.
Confidential
Python Developer
Responsibilities:
- Implemented user interface guidelines and standards throughout the development and maintenance of the website using the HTML, CSS, JavaScript and jQuery.
- Implemented AJAX for dynamic functionality of web pages for front end applications.
- Worked on front end frameworks like CSS Bootstrap for responsive web pages.
- Developed and tested many features for dashboard, created using Bootstrap, CSS, and JavaScript.
- Worked on server-side applications with Django using Python programming.
- Used Pandas for a data alignment and data manipulation.
- Utilized standard Python modules such as csv, itertools and pickle for development.
- Worked on Python OpenStack APIs and used NumPy for Numerical analysis.
- Used Ajax and jQuery for transmitting JSON data objects between frontend and controllers.
- Developed Wrapper in Python for instantiating multi-threaded application.
- Developed views and templates with Python and Django's view controller and templating language to created user-friendly website interface.
- Deployed project into Amazon web services (AWS) using amazon elastic bean stalk.
- Managed datasets using Panda data frames and MySQL, queried MYSQL database queries from python using ETL and ELT tools like SSIS.
- Used JIRA for bug tracking and issue tracking.
- Added several options to the application to choose algorithm for data and address generation.
- Developed the project in Linux environment.
- Used Agile Methodology and SCRUM Process.
- Maintained the versions using GIT and sending the release notes for each release.
- Supported the issues seen in the tool across all the teams for several projects.
Environment: Python 2.7, Django 1.4, CSS, HTML, BOOTSTRAP, JavaScript, jQuery, AJAX, MYSQL, Linux, AWS, GIT.
Confidential
Python/Django Developer
Responsibilities:
- Used Agile Methodology and SCRUM Process.
- Responsible for gathering requirements, system analysis, design, development, testing and deployment.
- Participated in the complete SDLC process.
- Developed Business logic using Python 2.7
- Used Django framework for database layer development.
- Developed user interface GUI using CSS, HTML, JavaScript and jQuery.
- Responsible for setting up Python REST API framework using DJANGO.
- Created database using MySQL, wrote several queries to extract data from database using ETL and ELT tool (SSIS).
- Used memcache as in memory key-value pair database to reduce traffic to database server.
- Wrote scripts in Python for automation of testing jobs.
- Deployment and build of various environments including Linux and UNIX
- Installed and maintained web servers Tomcat and Apache HTTP (1.3, 2.2) Web servers in Red Hat Linux.
- Used web services for integration and testing.
- Jira is used as project management tool for issue tracking and bug tracking.
- Implemented monitoring and established best practices around using elastic search.
- Effectively communicated with the external vendors to resolve queries.
- Used GIT for the version control and deployed project into AWS.
Environment: Python 2.7, Django 1.4, C++, JSON, XML, SOAPUI, HTML, Restful API, Shell Scripting, SQL, MySQL, AWS, GIT, Linux.