Data Warehouse Developer Resume
SUMMARY
- Around 12+ years of IT consulting experience in analysis, design, coding, development, testing and maintenance of data warehouse systems. Hands on experience include developing Data Warehouses/Data Marts/ODS within Energy Utilities and Healthcare industries.
- Primary technical Skills: Informatica PowerCenter, Teradata, Informatica Data Quality and Control - M
- Involved in full lifecycle implementation of multiple projects, including requirement gathering, system designing, application development, enhancement, deployment, maintenance and support.
- Hands on experience in Teradata (Teradata SQL Assistant, BTEQ, Fast Load, MultiLoad, Fast export) in a Data warehousing Environment.
- Strong experience in Teradata Database design, Implementation and Maintenance mainly in large-scale Data Warehouse environments.
- Strong SQL experience in Teradata from developing the ETL with Complex tuned queries including analytical functions and BTEQ scripts.
- Expert in Coding Teradata SQL, Teradata Stored Procedures, Macros and Triggers.
- Expertise in Query Analyzing, performance tuning and testing.
- Hands on experience in monitoring and managing varying mixed workload of an active data warehouse using various tools like Teradata Workload Analyzer, and Viewpoint.
- Extensively worked on Query tools like SQL Assistant, SQL Developer.
- Proficient in Informatica Power Center tools - Designer, Repository Manager, Workflow Manager, and Workflow Monitor etc.
- Hands on experience in Star/Snowflake schema design and De-normalization techniques.
- Solid Experience in designing and developing of Extraction transformation and loading (ETL) process using the Informatica power center.
- Expertise in tuning the performance of Mappings and sessions in Informatica and determining the Performance bottlenecks.
- Practical experience working with transformations like Filter, Router, Expression, Sequence Generator, Update Strategy, Joiner, Stored Procedure, Aggregator and Union to develop robust mappings in the Informatica Designer.
- Proficient in implementing Complex business rules by creating re-usable transformations, workflows/worklets and Mappings/Mapplets. Comfortable with both technical and functional applications of RDBMS, Data Mapping, Data management, Data transportation and Data Staging.
- Experience in working with various heterogeneous Source Systems like Oracle, SQL Server, ERP, SFDC, Flat files and Legacy systems.
- Proficient in converting logical data models to physical database designs in Data warehousing Environment and in-depth understanding in Database Hierarchy, Data Integrity concepts and Data Analysis.
- Worked on Schedulers CTL-M and Workload Manager.
- Experience in writing UNIX shell to support and automate the ETL process.
- Involved in Unit Testing, Integration Testing and preparing test cases.
- Involved in production support activities 24/7 during on call and resolved database issues.
- Excellent communication, interpersonal skills and has a strong ability to work as part of a team and as well as handle independent responsibilities.
TECHNICAL SKILLS
Databases: Teradata, Oracle, SQL Server
ETL Tools: Informatica Power Center & Informatica Data Quality
Data Modelling: Logical/Physical/Dimensional, Star/Snowflake/Extended-star schema, OLAP
Scheduling Tools: Control-M, Tidal jobs
Operating Systems: Sun Solaris, Linux, Windows, UNIX.
PROFESSIONAL EXPERIENCE
Confidential
Data warehouse Developer
Responsibilities:
- Involved in Requirement gathering, business Analysis, Design & Development, testing and implementation of business rules.
- Development of scripts for loading the data into the base tables in EDW using Fastload, MultiLoad and BTEQ utilities of Teradata.
- Used extensively Derived Tables, Volatile Table and Global Temporary Tables in many of the ETL scripts.
- Tuning of Teradata SQL statements using Explain Analyzing the data distribution among AMPs and index usage, collect statistics, definition of indexes, revision of correlated sub queries, usage of Hash functions, etc.
- Use SQL to query the databases and do as much crunching as possible in Teradata, using very complicated SQL Query optimization (explains plans, collect statistics, data distribution across AMPS, primary and secondary indexes, locking, etc.) to achieve better performance.
- Performed bulk data load from multiple data source (ORACLE 8i, legacy systems) to TERADATA RDBMS .
- Used BTEQ and SQL Assistant (Query man) front-end tools to issue SQL commands matching the business requirements to Teradata RDBMS .
- Developed the Teradata Macros, Stored Procedures to load data into Incremental/Staging tables and then move data from staging into Base tables
- Performed Space Management for Perm & Spool Space .
- Reviewed the SQL for missing joins & join constraints, data format issues, mis-matched aliases, casting errors.
- Developed procedures to populate the customer data warehouse with transaction data, cycle and monthly summary data, and historical data.
- Dealt with initials, delta and Incremental data as well Migration data to load into the Teradata.
- Analyzing data and implementing the multi-value compression for optimal usage of space.
- Query Analysis using Explain for unnecessary product joins, confidence factor, join type, order in which the tables are joined.
- Performance tuning, monitoring and index selection while using Statistics wizard and Index wizard and Teradata Visual Explain to see the flow of SQL queries in the form of Icons to make the join plans more effective and faster.
- Very good understanding of Database Skew, PPI, Join Methods and Join Strategies, Join Indexes including sparse, aggregate and hash.
- Excellent experience in performance tuning and query optimization of the Teradata SQLs.
- Worked closely with the end users in writing the functional specifications based on the business needs.
- Developed, documented and executed unit test plans for the components.
- Automated the reports, and developed the mail alters for loads by using Shell Scripts.
- Extensively used of Performance tuning techniques to minimize the run time and create pre-session caches with load being balanced on server.
- Developed shell scripts to validate the files and SFTP the files.
- Collected Multi-Column Statistics on all the non-indexed columns used during the join operations & all columns used in the residual conditions.
- Working closely with user decision makers to develop the transformation logic to be used in Informatica PowerCenter.
- Identifying and tracking the slowly changing dimensions, heterogeneous sources and determining the hierarchies in dimensions.
- Using Workflow Manager for Workflow and Session Management, database connection management and Scheduling of jobs to be run in the batch process.
- Developed number of complex Informatica Mappings, Mapplets and Reusable Transformations for different types of studies for Daily, Monthly, and Yearly Loading of Data.
Environment: Teradata SQL Assistant, Teradata Utilities, Informatica, Unix/Linux, Windows2000, Control M
Confidential
Consultant
Responsibilities:
- Development of scripts for loading the data into the base tables in EDW using Fastload, MultiLoad and BTEQ utilities of Teradata.
- Used extensively Derived Tables, Volatile Table and Global Temporary Tables in many of the ETL scripts.
- Tuning of Teradata SQL statements using Explain Analyzing the data distribution among AMPs and index usage, collect statistics, definition of indexes, revision of correlated sub queries, usage of Hash functions, etc.
- Use SQL to query the databases and do as much crunching as possible in Teradata, using very complicated SQL Query optimization (explains plans, collect statistics, data distribution across AMPS, primary and secondary indexes, locking, etc.) to achieve better performance.
- Performed bulk data load from multiple data source (ORACLE 8i, legacy systems) to TERADATA RDBMS .
- Used BTEQ and SQL Assistant (Query man) front-end tools to issue SQL commands matching the business requirements to Teradata RDBMS.
- Developed the Teradata Macros, Stored Procedures to load data into Incremental/Staging tables and then move data from staging into Base tables
- Performed Space Management for Perm & Spool Space.
- Reviewed the SQL for missing joins & join constraints, data format issues, mis-matched aliases, casting errors.
- Developed procedures to populate the customer data warehouse with transaction data, cycle and monthly summary data, and historical data.
- Dealt with initials, delta and Incremental data as well Migration data to load into the Teradata.
- Analyzing data and implementing the multi-value compression for optimal usage of space.
- Query Analysis using Explain for unnecessary product joins, confidence factor, join type, order in which the tables are joined.
- Performance tuning, monitoring and index selection while using Statistics wizard and Index wizard and Teradata Visual Explain to see the flow of SQL queries in the form of Icons to make the join plans more effective and faster.
- Very good understanding of Database Skew, PPI, Join Methods and Join Strategies, Join Indexes including sparse, aggregate and hash.
Environment: Informatica PowerCenter, Teradata Utilities, SQL Assistance, Control-M, Unix/Linux, windows
Confidential
Specialist
Responsibilities:
- Documented data conversion, integration, load and verification specifications.
- Parsing high-level design specifications to simple ETL coding and mapping standards.
- Worked with the various enterprise groups to document user requirements, translate requirements into system solutions and produce development, testing and implementation plan and schedule.
- Used transformations like Joiner, Expression, Connected and Unconnected lookups, Filter, Aggregator, Store Procedure, Rank, Update Strategy, Router and Sequence generator.
- Developed, documented and executed unit test plans for the components.
- Documenting the developed code, run the sessions and workflows, keeping track of source and target.
- Collected performance data for sessions and performance tuned by adjusting Informatica session pram’s.
- Extensively used un-connected Look-Ups for minimizing the run time and add to the performance of the server, while making sure to avoid duplicates of data from other source systems.
- Created pre-session and post-session shell scripts and mail-notifications.
- Extensively worked on the Informatica Designer, Repository Manager, Repository Server, Workflow Manager/Server Manager and Workflow Monitor.
- Extensive use of Performance tuning techniques to minimize the run time and create pre-session caches with load being balanced on server.
- Created Workflows containing command, email, session, decision and a wide variety of tasks.
- Employed performance tuning to improve the performance of the entire system.
- Used Informatica as an ETL tool to create source/target definitions, mappings and sessions to extract, transform and load data into staging tables from various sources.
- Understanding the entire functionality and major algorithms of the project and adhering to the company testing process.
Environment: Informatica PowerCenter, Oracle, UNIX/Linux, Windows, Control-M
