Hadoop Etl Application Developer Resume
Columbus, OhiO
SUMMARY
- Have two years of IT Experience and technical expertise in Web Development
- Have one year of experience in Hadoop development
- Experienced in Data Warehousing, ETL and Business Intelligence tools
- Built applications using JavaScript, Java, Ruby, React, Node, Ruby on Rails, Express, SQL
- Experienced in Toad for Apache Hadoop
- Created detail ETL Standards documents for design, development, release management and production support
- Created detail ETL Migration Processes in Ab Initio
- Experienced in analysis, design, development, implementation and documentation of ETL solutions using Ab Initio
- Experienced in Ab Initio (GDE 3.3.2) and UNIX Programming
- Used Control M and Oozie to schedule jobs
- Involved in the full project life cycle (SDLC) of the data warehouse projects
- Experienced in Teradata
- Experienced in Hive
- Involved in conducting KT sessions to the other venders/client users
- Have strong knowledge in Business Intelligence, Data warehousing, Dimensional modeling, Star Schema, Snowflake Schema and OLAP concepts
- Have strong domain knowledge in Banking and Retail financial services
TECHNICAL SKILLS
Programming Languages: Java, SQL, JavaScript, Ruby, Python
Software: VMWare, JDBC, HDFS, Hive, Sqoop, Oozie, Docker, Control - M, Toad for Apache Hadoop
Operating Systems: Windows, Mac OS, Linux, Unix
Frameworks: Hadoop, Node.js, Express.js, Ruby On Rails, Ember, Sinatra, React
Databases: MySQL, PostgreSQL, SQLite, Teradata
ETL: Ab Initio, Data Warehouse, Scheduling, Big Data, Data Distribution
Web Development: HTML5, CSS3, SASS, Bootstrap, Git, GitHub, jQuery, Heroku
Other: JIRA, Confluence, SharePoint, Microsoft Office, Microsoft excel, WinSCP, FTP Transfer, Putty, Teradata SQL Assistant
PROFESSIONAL EXPERIENCE
Confidential, Columbus, Ohio
Hadoop ETL Application Developer
Responsibilities:
- Work in a team, in an agile platform, to build applications that migrate data to Hadoop platform
- Build and run graphs in Ab Initio for entity registrations, data ingestions in Development environment
- Promote code (Ab Initio graphs) to QA, UAT and Production environment
- Create documentation for the code
- Design scripts, flowcharts and data flow diagrams
- Create ETL mapping and graphs based on technical specification document
- Debug data (Ab Initio graphs) in case of data issues by using Ab Initio debugger
- Create Unix scripts for ETL’s operations
- Create Source DDLs for tables creation
- Prepare SQL Queries for testing data across environments
- Create connection strings for connectivity with databases
- Maintain the quality of the ETL solutions to achieve customers’ satisfaction
- Complete SOR registration, data ingestion into Hadoop Confirmed zone with all validation
- Create PI classification
- Involve in production deployment planning and implementation
- Create and run jobs in Control M
- Do performance tuning for Ab-Initio graphs
- Responsible for on-boarding process involving knowledge transfer, knowledge building, presentations and code walk-through
- Create Source DDLs for Hive tables using Teradata Production tables and send them to Data Modelers for PG classification and DRP approvals
- Use Toad for Apache Hadoop to create and test Hive tables in dev environment, promote and test hive tables in QA, UAT and Production environment (end to end process)
Environment: Ab-Initio, HDFS, Hortonworks, Teradata, Teradata SQL AssistantWinSCP, Putty, Control-M, Microsoft Office, Windows, Unix, Toad for Apache Hadoop
Confidential, Bronx, NY
Data Engineering Trainee
Responsibilities:
- Used OOPs concept to build the project. Also used JDBC, ODBC drivers for the connection of RDBMS
- Used RDBMS concept with Structured Query Language. Created Database for the credit card management system and performed multiple actions in a database such as create, delete, select, insert, update, modify, drop and commit
- Used Hadoop framework. Set up Hadoop using Ambari. Worked on Architecture Namenode(NN), DataNode(DN) . Accessed, analyzed, and manipulated data in Hadoop
- Used Hortonworks sandbox for the project
- Created external and internal tables in Hive. Used partitioning in Hive for better performance
- Used Hive to design batch queries on Hadoop by providing a declarative abstraction layer
- Used Sqoop to import data from a relational source to HDFS and vice versa
- Used Oozie to create a scheduler system to run and manage Hadoop jobs
Confidential
Software Engineer
Responsibilities:
- Created UI on the client side using JavaScript
- Worked on a device, MoG, to create software-defined LAN
- Built the UI for the project MoG on Ember framework - a JavaScript library
- Contributed to the code base, the server side and client side, on GitHub
- Ran dockerized containers (backend and frontend) to run the project on my local machine for the development work
- Worked on Ruby on Rails, Ember.js, Docker, Jira, GitHub, and Terminal on a daily basis
- Learned Ember and Docker on the job
Confidential, New York, NY
React Developer
Responsibilities:
- Developed and maintained front-end applications
- Built a React.js project for Confidential
- Created responsive design for the website
Confidential, New York, NY
TTP Engineering Fellow
Responsibilities:
- As an Engineering Fellow at Confidential, I went through a 14-week long training program dedicated to preparing us, the fellows, to think like engineers and approach problems creativity in order to build the next generation of web applications and digital products using JavaScript, Node, Express, Ruby, Ruby on Rails and React.
- Used JavaScript, Node, Express and React to build 5 projects and Ruby on Rails to build 3 projects.
