We provide IT Staff Augmentation Services!

Sr Data Engineer Resume

5.00/5 (Submit Your Rating)

Denver, CO

SUMMARY

  • 6+ years of experience in Design, Development, Implementation of Python, Django, JavaScript and client - server technology-based applications.
  • Experienced in developing web-based applications using HTML/HTML5, DHTML, CSS/CSS3, JavaScript, Angular JS, AJAX, XML and JSON.
  • Designed and implemented large scale business critical systems using Object oriented Design and Programming concepts using Python and Django.
  • Experience on ETL and ELT Tools like SQL Server Integration Services (SSIS), also have knowledge in Data Migratory (IBI).
  • Worked on standard python packages like boot and boto3 for AWS.
  • Hands on Experience in AWS like Amazon EC2, Amazon S3, Amazon Red shift, Amazon EMR and Amazon SQS.
  • Worked on several standard python packages like NumPy, matplotlib, Pickle, PySide, Scipy, wxPython, PyTables etc.
  • Worked on various applications using python integrated IDEs Eclipse, PyCharm, NetBeans and Geany.
  • Good experience in developing web applications and implementing Model View Control (MVC) architecture using server-side applications like Django, Flask and Pyramid.
  • Well versed with design and development of presentation layer for web applications using technologies like HTML, CSS, and JavaScript.
  • Implemented responsive web pages using HTML5/CSS3, Bootstrap and XML/JSON based SOAP and REST web services.
  • Good experience in handling errors/exceptions and debugging the issues in large scale applications.
  • Hands on experience working in WAMP (Windows, Apache, MYSQL, and Python/PHP) and LAMP (Linux, Apache, MySQL, and Python/PHP) Architecture.
  • Experienced in using Caching applications for large scale applications like Memcached, Redis.
  • Experienced in working Asynchronous Frameworks like NodeJS, Twisted and designing the automation framework using Python and Shell scripting
  • Expertise in working with different databases like Oracle, MySQL, PostgreSQL and Good knowledge in using NoSQL databases MongoDB (2.6,2.4)
  • Proficient in developing complex SQL queries, Stored Procedures, Functions, Packages along with performing DDL and DML operations on the database.
  • Proficient in Automated Verification and Validation testing tools.
  • Hands on Experience in Verification and Validation testing project schedules.
  • Excellent working knowledge in UNIX and Linux shell environments using command line utilities.
  • Expertise in Production support and knowledge of deployment using AWS, Heroku and Jenkins.
  • Experience working in both Water fall and Agile software methodologies.
  • Familiarity with development best practices such as code reviews, unit testing, system integration testing (SIT) and user acceptance testing (UAT).
  • Hands on experience in working with various Version Control Systems, mostly GIT, CVS and subversion SVN.
  • Involved in all the phases of Software Development Life Cycle (SDLC) using Project management tools JIRA, Red mine and Bugzilla.
  • Expertise in Verification and Validation tools for coding used in Python.
  • Highly motivated, quality minded developer, with proven ability to deliver applications against tight deadlines.
  • Possess good interpersonal, analytical presentation Skills, ability to work in Self-managed and Team environments.

TECHNICAL SKILLS

Languages: Python, C#, C++, C, SQL, Java, ASP.net

Web Development: HTML, CSS, JavaScript, AJAX

Frameworks: Django, Flask, CherryPy, Pyramid, NodeJS, Angular JS, JSP, NumPy, Matplotlib, Servlets

Databases: PostgreSQL, MySQL, Cassandra, Redis, MongoDB, SQL Server

Tools: Git, SVN, Mercurial, Memcached, Jira, SSIS, Data Migrator

IDE: Notepad++, Eclipse, IDLE, Geany, PyCharm, Liclipse

Cloud Platforms: AWS, Heroku

PROFESSIONAL EXPERIENCE

Confidential, Denver, CO

Sr Data Engineer

Responsibilities:

  • Gathered data files from Data Warehouse URL’s.
  • Developed file cleaners using Python libraries and made it clean.
  • Utilized Python Libraries like Boto3, NumPy for AWS.
  • UsedDjangoAPIs for database access and worked on databases likeMySQL, Postgres.
  • Using raw files loaded data files from URLs to Amazon S3 Bucket.
  • Worked on reading queues in Amazon SQS, which have paths to files in Amazon S3 Bucket.
  • Knowledge about setting up Python REST API Framework usingDjango.
  • Modify the existingPython/Djangomodules to deliver certain format of data.
  • Aggregate clean files in Amazon S3.
  • Used Amazon EMR for map reduction jobs and test locally using Jenkins.
  • Also worked on Amazon EC2 Clusters to deploy files into Buckets.
  • Worked on Matillion ETL Tool, used it to transfer and load data into Amazon Redshift.
  • Mentored and provided technical guidance to other test engineers as necessary during verification and validation activities
  • Developed and maintained the Verification and Validation group's project schedules and roadmap ensuring project on schedule.
  • Experienced in Agile Methodologies and SCRUM Process.
  • Exported/Imported data between various data sources.
  • Created database using MySQL, wrote several queries to extract/store data.

Confidential, Dallas, TX

Data Engineer

Responsibilities:

  • Analyzed and gathered business requirements specifications by interacting with client and understanding business requirement specification documents.
  • Developed the presentation layer using HTML, CSS, JavaScript, jQuery and AJAX.
  • Used jQuery libraries for all client-side JavaScript manipulations.
  • Utilized Python libraries wxPython, NumPy, Twisted and matplotlib.
  • Implemented SQLAlchemy which is a python library for complete access over SQL.
  • Worked on Element Tree XML API in python to parse XML documents and load the data in database.
  • Skilled in collections and used for manipulating and looping through different user defined objects.
  • Developed views and templates with Python and Django's view controller and templating language to created user-friendly website interface.
  • Used Django configuration to manage URLs and application parameters.
  • Created entire application using Python, Django, MySQL and Linux.
  • Used Amazon Elastic Beanstalk with Amazon EC2 to deploy project into AWS.
  • Accessed database objects using Django Database APIs.
  • Created database using MySQL, wrote several queries to extract/store data.
  • Exported/Imported data between various data sources.
  • Integrated data from multiple applications using ETL and ELT tools like SSIS.
  • Experienced in Agile Methodologies and SCRUM Process.
  • Identified several hidden bugs caused by complicated multithreading issues such as race conditions caused by asynchronous events and resolved them.
  • Responsible for debugging and troubleshooting the web application.
  • Took part in the entire project's lifecycle which includes Design, Development and Deploying, Testing, Implementation and support.
  • Used Design patterns efficiently to improve the code reusability.
  • Coordinated with the offshore development team and assisted them when required.

Environment: Python 2.7, Django 1.6, CSS, HTML, JavaScript, jQuery, AJAX, MYSQL, Linux, AWS, GIT.

Confidential

Python Developer

Responsibilities:

  • Implemented user interface guidelines and standards throughout the development and maintenance of the website using the HTML, CSS, JavaScript and jQuery.
  • Implemented AJAX for dynamic functionality of web pages for front end applications.
  • Worked on front end frameworks like CSS Bootstrap for responsive web pages.
  • Developed and tested many features for dashboard, created using Bootstrap, CSS, and JavaScript.
  • Worked on server-side applications with Django using Python programming.
  • Used Pandas for a data alignment and data manipulation.
  • Utilized standard Python modules such as csv, itertools and pickle for development.
  • Worked on Python OpenStack APIs and used NumPy for Numerical analysis.
  • Used Ajax and jQuery for transmitting JSON data objects between frontend and controllers.
  • Developed Wrapper in Python for instantiating multi-threaded application.
  • Developed views and templates with Python and Django's view controller and templating language to created user-friendly website interface.
  • Deployed project into Amazon web services (AWS) using amazon elastic bean stalk.
  • Managed datasets using Panda data frames and MySQL, queried MYSQL database queries from python using ETL and ELT tools like SSIS.
  • Used JIRA for bug tracking and issue tracking.
  • Added several options to the application to choose algorithm for data and address generation.
  • Developed the project in Linux environment.
  • Used Agile Methodology and SCRUM Process.
  • Maintained the versions using GIT and sending the release notes for each release.
  • Supported the issues seen in the tool across all the teams for several projects.

Environment: Python 2.7, Django 1.4, CSS, HTML, BOOTSTRAP, JavaScript, jQuery, AJAX, MYSQL, Linux, AWS, GIT.

Confidential

Python/Django Developer

Responsibilities:

  • Used Agile Methodology and SCRUM Process.
  • Responsible for gathering requirements, system analysis, design, development, testing and deployment.
  • Participated in the complete SDLC process.
  • Developed Business logic using Python 2.7
  • Used Django framework for database layer development.
  • Developed user interface GUI using CSS, HTML, JavaScript and jQuery.
  • Responsible for setting up Python REST API framework using DJANGO.
  • Created database using MySQL, wrote several queries to extract data from database using ETL and ELT tool (SSIS).
  • Used memcache as in memory key-value pair database to reduce traffic to database server.
  • Wrote scripts in Python for automation of testing jobs.
  • Deployment and build of various environments including Linux and UNIX
  • Installed and maintained web servers Tomcat and Apache HTTP (1.3, 2.2) Web servers in Red Hat Linux.
  • Used web services for integration and testing.
  • Jira is used as project management tool for issue tracking and bug tracking.
  • Implemented monitoring and established best practices around using elastic search.
  • Effectively communicated with the external vendors to resolve queries.
  • Used GIT for the version control and deployed project into AWS.

Environment: Python 2.7, Django 1.4, C++, JSON, XML, SOAPUI, HTML, Restful API, Shell Scripting, SQL, MySQL, AWS, GIT, Linux.

We'd love your feedback!