Senior Data Warehouse Engineer Resume
Charlotte, NC
SUMMARY:
- 8+ years of experience in Data Warehousing and Business Intelligence parts of IT Industry.
- Worked across various domains of the industry like banking, communications, publishing, supply chain and pharma.
- Experienced DWBI Solution Architect - Involved in defining ETL system architecture, Administration, implemented end to end ETL, created DataMart’s, designed data & process flow, maintained data dictionary and business definitions.
- Expert in designing ETL strategies for moving data to Staging and Datamart/Data warehouse tables using tools like Informatica Power center, Informatica Data Quality, DataStage and Teradata.
- Developed ETL strategies & jobs for loading data into SCD1, SCD2, Rapid changing dimensions, FACT, Late arriving Dimensions & FACT tables.
- Developed ETL strategies for reading data from the real-time sources like REST and SOAP webservices.
- Strong knowledge in designing ETL jobs for reading data from Big data (Hadoop) sources and writing to them.
- Extracted data from various sources such as Relational Sources (Oracle, SQL Server and DB2) and File formats (All flat files, XML & COBAL files)
- Developed ETL jobs for integrating data from heterogeneous source systems to CRM & MDM systems.
- Developed ETL jobs for extracting metadata information from ETL and Data warehouse systems and loading data in to Metadata repository
- Developed Advanced transformation for data cleansing using various transforms like Filter, Expression, Sorter, Joiner, Match & Consolidate, Address Doctor and various other data quality transforms etc., to develop mappings in IDQ.
- Developed Profile and scorecards on datasets and applied business rules to analyze patterns and statistics and drilldown for necessary detailed analysis.
- Developed ETL process to extract data from Data warehouse and feed downstream systems
- Recommended and implemented performance tuning opportunities to improve system response time and ETL job execution times.
- Developed ETL code, advocated standards, and defined ETL best practices with emphasis on adherence to standards and provided support documentation.
- Experience in the areas of Configuration Management, Development & Deployment ETL tools & Reports, conducting testing and validations, conducting user training, documentation and Production Support.
- Experience in installation of multiple versions Informatica Power Center and Data Stage on Unix, Windows and AWS Cloud Environment.
- Experience in Upgradation of Informatica Power Center and Data Stage from current versions to higher versions.
- Experience in Migration of Mappings, Sessions and Workflows from Dev to UAT and PROD environment.
- Worked with Business Team to create the Business vocabulary for the enterprise using Information Server Business Glossary, assigning owners, workflows for the approval process
- Used Information Server Metadata Asset manager to load objects into metadata repository.
- Created Quality controls, scheduling & monitoring them to ensure the quality of the data warehouse
- Created the lineage documents, KPI’s, reports & dashboards for reporting the health of warehouse to management.
- Expert in Systems Integration and creating the Enterprise Data Warehouses.
- Created Star data model for analyzing SARM CRM data, apex device transactional, inventory data.
- Implemented Star Schema modeling, Snowflake Schema modeling and creating data warehouse using Enterprise Bus Architecture model and conform dimensions.
- Created Data warehouse using Dimensional Data Modeling concepts like Facts, Dimensions, Degenerate dimension, Transaction fact, Periodic fact, accumulating fact & Aggregated Fact tables
- Experienced in creating KPI, visualizations, view ports and Dashboards using Birst, created various visualizations like heat maps, transactional trends, geo charts, bubble charts, overlaying different charts to compare key trends.
- Experienced in creating and maintaining Data models in Hummingbird reporting tool
- created, fixed and published various reports like tabular, pivot, drill down, drill up’s etc. using Hummingbird reporting tool
- Created, scheduled and monitored subscription, sales and revenue reports using Sql queries, UNIX scripts.
- Worked with monthly Out of balance reports and fixing appropriate data issue
- Worked in generating reports & creating dashboards on the operational information required for the Leadership
- Proficient in interaction with the business and end users.
- Involved in gathering, analyzing, and documenting business requirements, functional requirements and data specifications for ETL Processing & Reporting.
- Hands on experience in analyzing and troubleshooting issues at functional and technical levels.
- Good functional knowledge to interface with end-users and to identify the information needs and business requirements
- Pro-active, highly adaptable, work independently in a team environment.
- Effective in cross-functional and global environments to manage multiple tasks and assignments concurrently.
- Possess strong communication skills and believes in team work and cooperation.
- Managed problem tickets; change requests and maintained production operational systems with emphasis on issue tracking and resolution. Worked closely with QA teams during testing cycles to help validate and define test cases and ensured testing requirements are met & provided post production support for the project
- Coordinated with offshore teams and tracked project status/issues and managed deliverables.
TECHNICAL SKILLS:
ETL Tools: Informatica 7.X, 8.X,9.X, DataStage 7.5, 8.1,8.5
Visualization Tools: Birst, Sienese & Tableau
Database: Redshift, Teradata, Sybase, SQL Server, DB2 & Oracle
Operating System: Windows 9x/XP, UNIX, Open VMS
Languages: Shell scripts, PL/SQL
PROFESSIONAL EXPERIENCE:
Confidential, Charlotte, NC
Senior Data Warehouse Engineer
Responsibilities:
- Responsible for business requirements collection and analysis to develop use cases required for development of Data ware house application.
- Designed and customized data models for Data warehouse application to handle data from multiple source systems.
- Involved in building the ETL architecture and Source to Target mapping to load data into Data warehouse.
- Involved in Dimensional modeling (Star Schema) of the Data warehouse and used Erwin to design the business process, dimensions and measured facts.
- Maintained stored definitions, transformation rules and targets definitions using Informatica repository Manager.
- Worked on different tasks in Workflows like sessions, events raise, event wait, decision, e-mail, command, worklets, Assignment, Timer and scheduling of the workflow.
- Used Type 1 SCD and Type 2 SCD mappings to update slowly Changing Dimension Tables.
- Used Debugger to test the mappings and fixed the bugs.
- Wrote UNIX shell Scripts & PMCMD commands for FTP of files from remote server and backup of repository and folder.
- Involved in movement of Informatica 9.X server and client from physical system to AWS ec2 instance cloud.
- Mounted S3FS bucket in all Informatica instances that will be added to virtual job server cluster.
- Installed and managed Admin console to manage domain and node for repository and integration services.
- Involved in Performance tuning at source, target, mappings, sessions, and system levels.
- Prepared migration document to move the mappings from development to testing and then to production repositories.
Environment: Informatica Power Center, Informatica Data Quality, Informatica Power Connect / Power Exchange, Data Analyzer 8.1, PL/SQL, Oracle 10g/9i, Erwin, Autosys, SQL Server 2005, Sybase, UNIX AIX, Toad 9.0, Cognos 8.
Confidential, Charlotte, NC
Senior ETL Developer
Responsibilities:
- Involved in gathering and analyzing the requirements and preparing business rules.
- Installed and configured Power Center 8.6.1 & 9.0.1 on UNIX platform.
- Involved in Informatica Power Center upgrade from V8.6.1 to 9.0.1.
- Involved in meetings with key stakeholders of the business and discussed on strategies and roadmaps for Informatica Grid implementation.
- Developed and maintained ETL (Extract, Transformation and Loading) mappings to extract the data from multiple source systems like Oracle, SQL server and Flat files and loaded into Oracle.
- Designed and developed complex mappings by using Lookup, Expression, Update, Sequence generator, Aggregator, Router, Stored Procedure, etc., transformations to implement complex logics while coding a mapping
- Involved in creating new table structures and modifying existing tables and fit into the existing Data Model.
- Extracted data from different databases like Oracle and external source systems like flat files using ETL tool.
- Created Source/ Target objects and mappings on Informatica Cloud to connect, monitor, synchronize the data in sfdc.
- Involved in debugging Informatica mappings, testing of Stored Procedures and Functions, Performance and Unit testing of Informatica Sessions, Batches and Target Data.
- Developed Mapplets, Reusable Transformations, Source and Target definitions, mappings using Informatica power center.
- Worked on implementation of data profiling, creating score cards, Creating reference tables and documenting Data Quality metrics.
- Developed knowledge on implementation of various data quality transformation like Address Doctor, Filter, Expression, Sorter for data cleansing tasks.
- Generated queries using SQL to check for consistency of the data in the tables and to update the tables as per the Business requirements.
- Involved in Performance Tuning of mappings in Informatica.
- Involved in analyzing, defining & documenting data requirements by interacting with the client and Salesforce team for the Salesforce objects.
- Good understanding of source to target data mapping and Business rules associated with the ETL processes.
Environment: Informatica Power Center 8.6.1 & 9.0.1, Informatica Data Quality, Oracle 11g, SQL server 2008 R2, SQL, T-SQL, PL/SQL, Toad 10.6, SQL Loader, Tidal Enterprise Scheduler 5.3.1, Accurev, Unix, Flat files.
Confidential, Kansas City, MO
Senior Data Warehouse Developer
Responsibilities:
- Understanding the architecture of IStrategy product (SSIS Packages & Stored Procedures) to build Student DataMart using Informatica.
- Installed and configured Power Center 9.0.1 on UNIX platform.
- Installed and configured Informatica Power Exchange CDC 9.0.1 for Oracle on UNIX platform.
- Developed to Staging and dimensional jobs to populate Staging, SCD1 & SCD2 tables.
- Responsible for creating process for identifying and capturing changes to the past records and loading them to DataMart.
- Developed dynamic and automated prestaging process for the Financial DataMart, jobs developed as part of this process contains Start loop, end loop, user variable, command activities, capturing previous run times for the jobs using dsjob - report command, logic to rank the runtimes, Bulk load & others
- Responsible for implementing process and developing jobs for logically deleting records on DataMart & activating the reinstated records
- Responsible for fixing Dimensional & Fact issues of Financial DataMart.
- Responsible for Testing the Student DataMart dimensions and both dimensions & facts for Financial DataMart.
- Used the PL/SQL procedures for Informatica mappings for truncating the data in target tables.
- Created jobs for reading data from real time sources like REST and SOAP method webservices
Environment: Informatica 9.0.1, Oracle & SQL Server 2008
Confidential, Stamford, CT
ETL Developer
Responsibilities:
- Responsible for performing analysis, design, development, testing, installation and configuration tasks required for integrating data to CRM and ECIF systems
- Responsible for performing impact analysis to migrate jobs from 7.5.1 to 8.1
- Responsible for making necessary changes to 7.5.1 jobs and migrate them to 8.1 server
- Responsible for ensuring jobs comply with enterprise standards on the 8.1 server
- Responsible for creating sequence, server and parallel jobs to move data from multiple source to CRM and ECIF systems and tuning better job designs.
- Responsible for writing shell scripts to support development and production support activities
- Responsible for preparing design documents of data model for SARM project.
Environment: DataStage 8.1 & 7.5.3, DB2 & UNIX
Confidential
Software Analyst
Responsibilities:
- Worked with the business team in defining the business & technical vocabulary for the enterprise data house
- Worked with Business Team to create the Business vocabulary for the enterprise using Information Server Business Glossary, assigning owners, workflows for the approval process
- Used Information Server Metadata Asset manager to load objects into metadata repository.
- Integrated heterogeneous data sources like Oracle, DB2, SQL Server and Flat Files (Fixed & delimited) into Staging Area.
- Creating lineage documents for all the processes loading the data warehouse
- Responsible for implementing Data governance rules to ensure the quality of the data in the data warehouse
- Experience in integration of heterogeneous data sources like Oracle, DB2, SQL Server and Flat Files (Fixed & delimited) into Staging Area.
- Created quality components audits to reconcile counts between source and targets.
- Created components scoring rules to validate business rules
- Created engine to run the quality components and report status of them.
- Created KPI’s, reports & dash boards to report the health of the data warehouse
Environment: Informatica 8.1, Teradata, Oracle & UNIX
Confidential
Associate Software Analyst
Responsibilities:
- Responsible for modifying workflows based on requirements
- Load operational data from Oracle, SQL Server, flat files, Excel Worksheets into various data marts like PMS and DEA.
- Involved in developing Informatica workflows which Extract, Transform, and Load from sources like flat files & XML files.
- Involved in creating the stored procedures for Downstream feeding and reporting purposes
- Involved in creating the Out of balance reports, load balancing jobs & error handling routines
- Involved in optimizing performance by tuning the Informatica ETL jobs.
Environment: DataStage 7.5, Teradata 11.2, and SQL server 2005, Sybase
