Senior Etl/elt Developer Resume
Phoenix, AZ
SUMMARY
- Over 7 years of IT experience in Design, Development, Implementation, Data Migration, and Testing of Database/Data Warehousing applications using Extraction, Transformation, Loading Data Analysis Techniques.
- Exclusive experience in Big data Technologies and Confidential ecosystem's such as HDFS, MapReduce, PIG, Hive, Hbase, Sqoop and Flumes.
- Drawing on experience in all aspects of analytic/data warehousing solutions (Database issues, Data modeling, Data mapping, ETL Development, metadata management, data migration and reporting solutions) I have been key in delivering innovative database /data warehousing solutions to Telecom Industry & Health Care.
- Extensive experience in Pig Scripting and analyzing data using HiveQL, Pig Latin, and HBase.
- Experience in importing and exporting data using Sqoop from HDFS/Hive/HBase to Relational Database Systems.
- Worked in job workflow schedulers and monitoring applications such as Oozie and Zookeeper.
- Extensive hands on experience in using the Data warehousing tool IBM Web Sphere Data stage 7.5/ 7.5.1 Info sphere Datastage 11.3, 8.7, Talend Integration ETL, Informatics Power Center 9.
- worked on a modern data pipeline, to collect, cleanse and process diverse data from disparate sources across the organization.
- Having Experience in implementing data warehouse solutions, ETL, Analytic and Reporting.
- Extensively involved in the development of ETL process for extracting data from different data sources, data transformation and loading the data into data warehouse for analytical purpose.
- Strong understanding of Data Modeling (Relational, dimensional, Star and Snowflake Schema), Data analysis, implementations of Data warehousing using Windows and UNIX.
- Involved in performance tuning of targets, sources, mappings, and sessions.
- Migrated Data Stage Business intelligence tool from Version 7.x to 8.x.
- Translated business requirements into technical design specifications using Visio to design ERD schema.
- Worked with and extracted data from various databases sources Teradata, Oracle 11g/10g/9i, Sequential files and worked with different format of file systems.
- Widely worked with Teradata utilities like BTEQ, Fast Export, Fast Load, Multi Load and SQL LOADER scripts to export and load data to/from different source systems including flat files.
- Hands on experience using query tools like TOAD, SQL Developer, PLSQL developer, Teradata SQL Assistant and Query man.
- Excellent working experience on multiple platforms like LINUX, UNIX.
TECHNICAL SKILLS:
- ETL Tools:
- IBM DataStage 11.3, 8.7, 8.5, Talend Integration ETL Tool 5 & 6, Ascential DataStage 7.5, Informatica Power Center 9:
- Databases:
- Oracle 9i/10g/11g, MS Access, CASSANDRA, MONGO DB:
- Languages:
- UNIX SHELL, HSQL, CQL (CASSANDRA QUERY), TERADATA, SQL, Confidential & Confidential Product - Cymbel Query Language, JAVA, XML:
- Confidential:
- Hbase, Pig, Hive,Ambari:
- Operating Systems:
- Windows XP/NT/2000, UNIX, Linux.:
- Scripting:
- Unix Shell Scripting. TWS Composer Files:
- Other Tools:
- Datastage Internal Scheduler, Cron Tab, Zera, IBM Tivoli TWS:
PROFESSIONAL EXPERIENCE
Confidential Health Care, Phoenix, AZ
Senior ETL/ELT Developer
Responsibilities:
- Analyze business requirements and created technical specification document for source to target mapping for the ETL development.
- Develop UML Diagrams: Use Cases, Activity Diagram, Sequence Diagram, and Class Diagram.
- Importing and exporting data from Confidential UNIX server into HDFS.
- Involved in Confidential requirement gathering and legacy system analysis.
- Based on User stories in RALLY, Estimated Development Tasks in RALLY ( CA CENTRAL Confidential ) for each Sprint User Story .
- Writing UNIX file Validation, File Watcher Scripts and Pig scripts to process the data and load date in HDFS.
- Experienced in analyzing data with Hive and Pig.
- Experienced in managing and reviewing Confidential log files.
- Experienced in defining job flows.
- Extracted the data from oracle into HDFS using Sqoop.
Environments: Hortonworks Confidential , MapReduce, HDFS, Hive, Sqoop, Pig, Oozie, Linux, Shell Scripting, Oracle 12 c database, SFTP, File watcher UNIX Scripts. CA RALLY Confidential central, Cron tab
Senior ETL/ELT Developer
Responsibilities:
- Analyze business requirements and created technical specification document for source to target mapping for the ETL development.
- Importing and exporting data into HDFS and Hive using Sqoop.
- Experienced in analyzing data with Hive and Pig.
- Writing Pig scripts to process the data.
- Developed a data pipeline using Talend Integration ETL to store data into HDFS and performed the real-time analytics on the incoming data.
- Developed PIG Latin scripts to extract the data to load into HDFS.
Involved in HBase setup and storing data into HBase, which will be used for further analysis.
- Experienced in managing and reviewing Confidential log files.
- Experienced in defining job flows.
- Involved in creating Hive tables, loading with data and writing Hive queries using the HiveQL which will run internally in the map-reduce way.
- Extracted the data from oracle into HDFS using Sqoop.
Environments: Hortonworks Confidential , MapReduce, HDFS, Hive, Sqoop, HBase, Pig, Oozie, Talend Integration ETL Tool, Linux, Shell Scripting. CA RALLY Confidential central
Senior ETL Developer
Responsibilities:
- Analyze business requirements and created technical specification document for source to target mapping for the ETL development.
- Involved in preparing high level and detailed design documents and acceptable differences documents for the end users.
- Data extraction from fixed width files and transformed as per the business requirement and loaded into the staging Oracle Confidential 5.2 Tables.
- Involved in Confidential requirement gathering and legacy system analysis.
- Based on User stories in RALLY, Estimated Development Tasks in RALLY ( CA CENTRAL Confidential ) for each Sprint User Story .
- Recurrent billing payment for Confidential HEALTH CARE Medicade claim auto monthly billing payments.
- Worked extensively with Dimensional modeling, Data migration, Data cleansing, ETL Processes for data warehouses.
- Developed Slowly Changing Dimension Mappings for Type 3 SCD .
- Formulated UNIX File watcher and File validation Script.
- Developed Tableau workbooks from Confidential Data Source for Exception and Data Balancing & Control report.
- Integrated a wide variety of source file layouts into the data warehouse.
Environment: RALLY, IBM datastage 11.5, Confidential 5.2, Oracle Developer, Oracle 12c database, UNIX Shell Scripting, IBM TIVOLI, Tableau
Senior ETL Developer
Responsibilities:
- Collaborated with multiple health plans to understand and implement detailed requirements for HEDIS and other reporting needs.
- Created detailed functional and technical design documents.
- Planned, coordinated analysis, design and extraction of encounter data from multiple source systems into the data warehouse relational database (Oracle) while ensuring data integrity.
- Developed, documented and validated complex business rules vital for data transformation.
- Enhanced and expanded the encounter data warehouse model through sound detailed analysis of business requirements.
- As a Dev Lead appeared in Confidential SCRUM meetings and recommend plan of execution to meet business requirements.
- Involved in Confidential requirement gathering and legacy system analysis.
- Based on User stories in RALLY, Estimated Development Tasks in RALLY ( CA CENTRAL Confidential ) for each Sprint User Story .
- Worked on, CQA Sprint CTO (Code Turn Over) deliveries.
- Datastage environment and Database Table initial setup for NEW Confidential processes.
- Confidential development Supported for CQA Defects and Clarification
Environment: RALLY, IBM datastage 11.5, Confidential 5.2, Oracle Developer, Oracle 12c database, UNIX Shell Scripting, IBM TIVOLI, Confidential WRAPER UNIX SCRIPTS, MAINFRAME JCL
