Senior Etl Developer/data Warehouse Engineer Resume
Richmond, VA
SUMMARY
- More than 6 years of experience in Information Technology with a strong background in Analysis, Design, Development, Implementation of Data warehousing in ETL for OLAP, OLTP and Hadoop technology stack.
- Experienced in working on Agile method of SDLC in bi - weekly sprints.
- Good knowledge of Data warehouse concepts and principles of Ralph-Kimball and Bill-Inmon methodologies - Star Schema, Snowflake, SCD, Surrogate keys, Normalization/De normalization, Facts and Dimensions tables, Physical and Logical data Using Erwin for Data Marts and Staging Database.
- Extensive development experience for the Extraction, Transformation and Loading of data from multiple disparate sources such as Oracle, MS SQL Server, DB2, Teradata, Flat Files, XML Files into ODS (Operational Data Store) and EDW (Enterprise Data Warehouse) systems.
- Experienced in integrating Sybase/SQL Server with Reltio MDM and RDM offered as a PAAS solution using Informatica.
- Design, Implement, troubleshoot, and optimize distributed solutions based on modern big data technologies like Hive, Hadoop, Spark, Sqoop, and Pig in both an on premise and cloud deployment model to solve large scale processing problems.
- Extensive experience in MS SQL Server 2012/2008 R2/2005 Business Intelligence in MS SQL Server Integration Services (SSIS) and MS SQL Server Reporting Services (SSRS).
- Proficient in Creating, Configuring and Fine-tuning ETL workflows designed in MS SQL Server Integration Services (SSIS).
- Experienced in providing Logging, Error handling by using Event Handlers, and Custom Logging for SSIS Packages.
- Proficient in designing and scheduling complex SSIS Packages for transferring data from multiple data sources to SQL server.
- Good understanding of Snowflake cloud technology in terms of cluster size and credit usage
- In-depth knowledge of Data Sharing in Snowflake.
- In-depth knowledge of. Snowflake Database, Schema and Table structures.
- Experience in using Snowflake Clone and Time Travel.
- Experienced in Automating, Configuring and deploying instances on AWS, also familiar with EC2, Cloud watch, Cloud Formation and managing security groups on AWS.
- Expertise in implementing complex business rules by creating re-usable transformations, Mapplets and Mappings.
- Extensive knowledge in handling slowly changing dimensions type
- Experienced in version control and source code management tools using GIT
- Hands on experience in Performance Tuning of sources, targets, transformations and sessions.
- Good experience in data profiling and data cleansing activities and documenting the ETL process flow for better maintenance and analyzing the process flow.
- Extensively worked on Push Down Optimization and Deployment groups.
- Solid Expertise in Oracle Stored Procedures, Triggers, Cursors, Indexes, Functions, Table Partitions and experienced in working with Oracle using SQL, PL/SQL, SQL Plus, SQL Loader, TOAD.
- Strong Knowledge in optimizing database performance
- Well Experienced in Doing Error Handling and Troubleshooting using various log files.
- Experience in using the Informatica command line utilities like pmcmd to execute workflows in non-windows environments.
- Experience in UNIX, shell scripting, CRON, FTP and file management in various UNIX environments.
- Expertise in creating Test Plans and writing Test Cases.
- Expertise in doing Unit Testing, Integration Testing, System Testing and Data Validation for Developed Informatica Mappings.
- Highly motivated to take independent responsibility as well as ability to contribute and be a productive team member.
TECHNICAL SKILLS
ETL Tools: Informatica 10.x/9.x/8.x (Power Center/Power Mart/Power Exchange) (Designer, Workflow Manager, Workflow Monitor, Server Manager, Power Connect), SSIS SSRS 2012/2008
Data Modeling: Erwin 4.0/3.5, Star Schema Modelling, Snow Flake Modelling
Databases: Oracle 12c/10g/9i, MS SQL Server 2005/2000, DB2, Sybase
Languages: SQL, PL/SQL, Postgres SQL,T-SQL, Unix Shell Script, Python 3.7
Tools: Toad, SQL* Loader, SQL Navigator, PLSQL Developer, PG Admin
Cloud Technologies: Snowflake, AWS
PROFESSIONAL EXPERIENCE
Confidential, Richmond, VA
Senior ETL Developer/Data warehouse Engineer
Responsibilities:
- Built workflows to load Chrome data to Reltio MDM
- Created informatica mappings to load vehicle options, packages and technical specifications to Reltio RDM
- Created SSIS packages which involved a variety of transformations such as Slowly Changing Dimension, look up, Aggregate, Derived Column, Conditional Split, Multicast, Union All, Merge, Merge Join, and Data Conversion before loading the data into Data Warehouse.
- Created a report model on SSAS cubes.
- Extracted data from Sybase database into flatfile format to convert to JSON.
- Created dynamic JSON converters using python to load data from SQL Server/Sybase to Reltio.
- Responsible for creating ETL mapping to parse XML data from files and load it into Sybase tables
- Involved in the Migration process from Development, Test and Production Environments.
- Analyzed and fixed the defects and issues in UAT and production environments.
- Prepared Workflow process to run Worklets, Sessions based on Load dependency.
- Made substantial contributions in simplifying the development and maintenance of ETL by making the efficient use of the existing Informatica objects and by creating mapplets.
- Involved in identifying bugs in existing mappings by analyzing the data flow, evaluating transformations and fixing the bugs so that they conform to the business needs.
- Created mappings to gather statistics for each workflow storing it as Data Quality metrics in Teradata.
- Developed reports and dashboards on data quality metrics for data steward using Tableau and PowerBI
- Involved in server migration for SQL Server Dev, Stage and Prod
- Responsible for code reviews of peers.
- Heavily involved in testing Snowflake to understand best possible way to use the cloud resources
Environment: Informatica Powercenter 10.1.1, MSBI 2012, Sybase, SQL Server 2012, DBArtisian,Teradata SQL Assistant, Snowflake
Confidential, Richmond, VA
Senior ETL Developer/Data warehouse Engineer
Responsibilities:
- Understanding the data warehouse and data mart models as well as being familiar with the business information contained in each with Active participation in Data Warehouse architecture and project discussions
- Involved in Sprint planning, Daily Stand up calls, Retrospective and Review Meeting using Version one
- Develop and implement oozie workflows for Bigdata technologies and schedule them via crontab while monitoring their performance using Hue which is an opensource SQL workbench for DWH.
- Import data using Sqoop into Hive and Hbase from legacy source system(ADMIN SERVER).
- Develop complex mappings in Informatica Designer tool using transformations like lookup, aggregator, expression, router. Creates and schedules workflows for mappings in Informatica Workflow manager. These mappings and workflows are used for:
- Receiving data files from Admin server on a daily batch basis,
- Loading the admin files to Valuations Annuities Greenplum DB by performing a Change Data Capture and loading delta records in downstream Warehouse and mart
- Apply topsides and generate seriatim data outputs after performing calculations based on manual assumption inputs by actuaries
- Optimized Query Performance, Session Performance and Reliability.
- Work with Data Governance Manager and Data Stewards to convert business requirements to Informatica AXON/EDC configuration
- Create complex Structured Query Language (SQL) procedures and functions in PGAdmin tool for Greenplum database
- Created the Deployment groups and deployed the objects from one environment to the other using Servicenow.
- Involved in making ongoing enhancements to the existing data warehouse.
- Worked with Informatica Best Practices guidelines to minimize performance issues.
- Scheduled the batches to be run using Appworx.
- Created AWS S3 buckets, performed folder management in each bucket, managed cloud trail logs and objects within each bucket.
- Completed POC on usability of AWS using EC2 and S3 storage and lambda functions
- Developed, Code Reviewed, fixed bugs, tested and deployed SSIS packages using SQL Server 2012/2008 R2 Business Intelligence Development Studio.
- Transferred data from various data sources/business systems including DB2, MS Excel, MS Access, Flat Files etc. to SQL Server using SSIS Packages and using various features like Excel source, Flat file source, transformation etc. Created derived columns from the present columns for the given requirements.
Environment: Informatica Powercenter 10.1.1, Oracle 12c, PLSQL Developer, Greenplum 9.6,PG Admin, YARN,MAPReduce,Pig,Hive,HBase,Sqoop,Oozie, Hue, Linux, Informatica AXON,EDC, MSBI 2012/2008
Confidential, Houston, TX
Senior ETL Developer
Responsibilities:
- Prepared the design and related technical documents including Mapping specification documents and Source to target mapping documents.
- Involved in deriving Technical Specifications based on Functional Specifications.
- Developed and test ETL components using Informatica Power Center.
- Worked with Flat Files and relational sources (Oracle and Netezza), XML Files.
- Worked with Informatica Scheduler.
- Worked on push down optimization to load the Netezza tables and deliver efficient ETL code.
- Worked on Informatica Designer tools like Source Analyzer, Target Designer, Transformation Developer, Mapping Designer and Mapplet Designer.
- Involved in creating Tasks, Sessions, Workflows and Worklets by using the Workflow Manager tools like Task Developer, Worklet and Workflow Designer.
- Extensively used transformations such as Source Qualifier, Joiner, Expression, Aggregator, Rank, Router, Normalizer, Connected and Unconnected Lookups, Filters, Stored Procedures, Update Strategy and Sequence Generator to implement the business logic.
- Worked with mapping parameters and variables to load data from different sources to corresponding database table.
- Called unix scripts from Informatica.
- Worked on the conversion of Oracle Stored Procedures to Informatica mappings.
- Created migration document and supported the production deployment.
- Created the Deployment groups and deployed the objects from one environment to the other.
- Trained and helped co-workers to work on the Deployment groups.
- Analyzed and fixed the defects and issues in QA and production environments.
- Prepared Workflow process to run Worklets, Sessions based on Load dependency.
- Unit/peer testing of developed components.
Environment: Informatica Powercenter 9.5.1, Netezza, Oracle 11g, PLSQL developer, Toad, Linux, WinSCP
