Etl Developer Resume
4.00/5 (Submit Your Rating)
Columbus, OH
TECHNICAL SKILLS
- Hadoop
- SQL
- Python
- Linux/Unix
- Bash regex
- Vim
- Tmux
- SVN
- Oozie
- Sqoop
- Hive
- HDFS
- Ambari
- YARN
- Control - M
- Rally
- Informatica
- SSIS
- SQLSRV
- IBM DB2
- Datalake
PROFESSIONAL EXPERIENCE
ETL Developer
Confidential, Columbus, OH
Responsibilities:
- Responsible for development of complete and incremental Sqoop jobs to Datalake
- Responsible for working with business users and SMEs to create custom data extracts
- Ability to customize sqoop jobs based on source system performance
- Ability to transform hacky scripts created by business users into production ready code
- Ability to manually implement SCDs through Hive approximating insert/update logic
- Ability to use Hive windowing functions and complex data types to perform transposition of rows to columns
- Experience scheduling Hadoop jobs with Oozie and Control-M
- Experience using SVN for version control
- Created Python script for automating the creation of Sqoop jobs and Hive DDL
- Created Python scripts to monitor Sqoop job progression and check database permissions
Hadoop Administration
Responsibilities:
- Responsible for uptime of HDP cluster services for the rest of Analytics Data team
- Responsible for modifying config file settings for any part of HDP ecosystem as problems or opportunities for improvements arise
- Responsible for killing long running Linux system processes or Yarn processes
- Responsible for filing vendor support tickets with Hortonworks and implementing fixes during correspondence
- Responsible for user account creation with roles in HDFS and HUE
- Ability to debug issues with Sqoop or Hive Mysql metastores
- Experience with Linux CLI and HDFS CLI
- Experience working with MIG systems engineers to add data nodes or resolve node issues
- Created bash scripts to monitor cluster space issues and when applicable clean logs
Analytics Data Team Member
Responsibilities:
- Development of MIG datalake principles, processes, and guidelines
- Serving as a lead for a MIG proof of concept using Microsoft Azure's PaaS
- Participant in daily standups and agile iteration based Rally user stories
- Member of company objective team for creating a central repository for Reinsurance
- Created Python script to extract text from hundreds of PDFs and upload to a SharePoint List for Actuarial Department
- Created Python script to upgrade formulas in hundreds of excel files for a BPC conversion for Accounting Department
- Tutoring member of the Accounting team in Python
Business Intelligence Consultant
Confidential, Columbus, OH
Responsibilities:
Technology: Informatica, Shell Scripting, SQL, UNIX, Vim, Oracle, Netezza
- Built and modified Informatica mappings and Netezza SQL scripts to support financial data
- Serviced walk-up requests, defects, incidents and enhancements for financial data loads in an AGILE environment
- Part of nightly on-call support rotation responsible for over 6000 jobs
- Experience with scheduling tools and version control software
- Experience in UNIX development environment and familiarity with Vi/Vim
ETL Developer & Data Analyst
Confidential
Technology: SSIS, SQL, MS SQL Server, PeopleSoft, Excel, Microsoft Access, PeopleSoft
Responsibilities:
- Developed SSIS packages for accounts payable reconciliation application
- Worked with Accounting Process SMEs and SQL Server DBAs to solve requirements issues
- Performed and documented ETL unit test
- Documented accounts payable and visual management processes and problems
- Created formal business requirements for these processes
- Helped develop test case scenarios for business requirements
- Mapped source fields to report fields for solution design phase
- Created Business Objects report mock-ups
- Documented reporting technical specifications
