We provide IT Staff Augmentation Services!

Datawarehouse Lead Engineer

4.00/5 (Submit Your Rating)

SUMMARY

  • 9+ years of strong IT experience in designing, developing and managing Datawarehousing Applications, designing data models, implementing logical and physical database designs for OLAP & OLTP systems, designing and developing ETL processes, leading Datawarehouse projects, and Project management.
  • Managed and supervised DW/BI design and development of multiple Data Warehouse Projects. Involved in analysis, development, and training of projects in multiple domains including banking, insurance, travel and Retail.
  • ETL design and architecture using Informatica Power Center 8.6/7.x/6.x and Ab - inito 3.1.2 Extensive experience in Extraction, Transformation and Loading of data from heterogeneous source systems like Flat files, Relational sources and XML sources. Administered Informatica Services/Repositories and deploying Repository objects. Performed deployment using folder level migrations, deployment.
  • Extensive knowledge in writing SQLs and performing SQL tuning. Implemented complex algorithms for customer segmentation, revenue management, database marketing and online marketing.
  • Multiple years of experience working closely with the Online and Database Marketing teams, Product teams and Revenue management team.
  • MPP architecture for Datawarehouse implementation that including Oracle Exadata and Teradata.
  • Strong Knowledge of Data Warehousing concepts and methodologies, primarily Star Schema and Snowflake Schema, dimensional data modeling, Fact and Dimensional tables, Slowly Changing Dimensions. Extensive experience in analysis, requirements gathering, design, and creation of technical documentation for OLTP and OLAP systems.
  • Unix Shell scripting including automating the creation of parameter files, creating file watcher loops, importing and exporting files, implementing cron jobs, writing functions and applying gpg encryption.
  • Implemented jobs, design job flows and perform Job scheduling using Autosys (Computer Associates Workload center r11.1). Hands on experience in Control-M
  • Hands on experience in Microstrategy Reporting tool v8/9 creating schema objects, metrices, filters and reports.
  • Experienced in working within the Scrum Agile methodology. Worked on Agile POC for two pilot projects for 1 year.
  • Exceptional problem solving and sound decision making capabilities, recognized by alternative solutions, and confident, accurate, decision-making coupled with excellent communication and interpersonal skills.
  • Excellent communication, inter personal and project management skills; a very good team player and self-starter with ability to work independently and as part of a team. More than 3 years of experience managing BI engineers.

TECHNICAL SKILLS:

Data Warehousing:

Informatica PowerCenter 8.6/8.1/7.1, Ab-Initio 3.1.2, Data Profiling using Informatica Data Explorer, Data cleansing, OLAP, OLTP, Star & Snowflake Schema, FACT & Dimension Tables, Physical & Logical Data Modeling

BI/Reporting Tools:

Microstrategy 9/8, Business Objects 5.1

Data Modeling:

Oracle SQL Developer, Microsoft Visio

Databases:

Teradata 12, Oracle 11g/10g/9i/8i/8/7.3, DB2, UDB

Languages/GUI:

C++, SQL, PL/SQL, UNIX Shell Scripting, JAVA

Operating System:

HP-UX11/10/9, Sun OS 5.1, Windows XP Professional/2000/NT/98/95

Other Tools:

MS Visual Source Safe, PVCS, Perforce, Autosys

DB Tools:

SQL*Plus, SQL*Loader, Export/Import, TOAD, Teradata SQL Assistant, Teradata Administrator.

PROFESSIONAL EXPERIENCE

Confidential,California, USA ( )

Datawarehouse Lead Engineer

Founded in 1956, Williams-Sonoma, Inc. is the premier specialty retailer of home furnishings and gourmet cookware in the United States. The company’s brands are among the best known and most-respected in the industry. It offers high-quality, stylish products for every room in the house: from the kitchen to the living room, bedroom, home office and even the hall closet.

Roles and Responsibilities -

Lead the design, development and Implementation of Coremetrics Integration into the Customer Data warehouse. This web analytics data contains key information about visits, page views, product views, campaigns, registration, orders and technical information.

Managed three developers and coordinated ETL development using Ab-Initio 3.1.2.

Assisted business users to enable them utilize the Web Analytics Data in Email modelling for personalized emails to customers.

Lead the Productivity effort to modularize the different subject areas in to minimize dependencies and maximize parallelism.

Lead the effort to implement Enhancement queues for quick wins on simple to complex fixes contributing millions of dollars in additional revenue.

Conducted multiple interviews to hire top notch talents for various Data Warehousing positions in Marketing Systems.

Environment: Ab-Initio 3.1.2 ETL tool, Teradata 12, Teradata Administrator, Teradata SQL Assistant, flat files, UNIX, Toad 9.6.x, Windows XP, MS Office, Microstrategy 9/8), IBM AIX OS 6.1.

Confidential, San Francisco, California, USA ( )

Senior Business Intelligence Engineer

Hotwire.com, a subsidiary of Expedia Inc, is a leading discount travel Web site with consistently lower prices on airline tickets, hotel rooms, rental cars, cruises and vacation packages. Launched in 2000 with funding from six major airlines, Hotwire negotiates deep discounts from its travel suppliers to help sell their excess inventory. Hotwire is a wholly owned subsidiary of Expedia, Inc. (NASDAQ: EXPE) and is based in San Francisco, CA

Roles and Responsibilities -

End to end implementation of projects including requirements gathering with business users, coordination with functional design writers, coordination with Software Engineers, Data Warehouse Schema design, ETL design, BI Software design documentation & presentation, ETL development, testing, deployment and post-implementation Support.

Data mapping, data modeling in Extract, Transform and Load (ETL) data from source systems and worked closely with the data analysts, to reduce the redundancy of the gathered data elements.

Worked as an Interface specialist and in customization, developing of macro and micro level designs.

Closely worked with the Database Marketing team and Email Marketing vendors including Responsys and Yesmail, to provide contents for marketing newletters and load the events data back to Data Warehouse for performance tracking.

Collected and linked metadata from diverse sources, including relational databases and flat files.

Designed, developed and maintained complex ETL mappings using Informatica Power Center. Extensively used Informatica client tools - Source Analyzer, Warehouse designer, Mapping designer, Mapplet Designer, Informatica Repository Manager and Informatica Workflow Manager.

UNIX Shell scripts to run Informatica workflows. Wrote UNIX shell scripts to work with flat files, to define parameter files and to create pre and post session commands.

Involved in performance tuning by optimizing the sources, targets, mappings and sessions.

Created and scheduled jobs on Autosys.

Wrote SQLs and PL/SQL programs to implement complex algorithms using tools like TOAD and SQL developer.

Held weekly meeting with DBAs to iron out Database performance issues and ensure smooth operations.

Formulated Test plans, Test Scenarios, setting up testing environment in conjunction with the Testing team and expertise in formulating test approaches with Load Testing, Integration Testing, Functional testing, and User Acceptance Testing.

Performed data base testing like checking the constraints, correctness of the data, field size validation, etc

Created schema objects, metrices, filters and reports in Microtrategy.

Investigated and fixed the root cause of the problems that are encountered during Production Support on day to day basis.

Identified design and configuration set-up, also created User Documentation and conducted training classes.

Involved in production control and production support and resolved production issues.

Conducted various interviews to fill in the positions for BI Engineers, Consultants and Senior BI Engineers.

Environment: Informatica Power Center 8.6.1 (Source Analyzer, Warehouse Designer, Mapping Designer, Mapplets, Transformations, Workflow Manager, Worklets, Workflow Monitor), Oracle 11g/10g, Informatica Data Explorer, XML files, flat files, UNIX, Toad 9.6.x, Windows XP, MS Office, Microstrategy 9/8), Sun OS 5.10.

Confidential,Milwaukee, USA ( )

Client - Northwestern Mutual Insurance

Programmer Analyst

Interacted with business community and gathered requirements based on changing needs. Incorporated identified factors into Informatica mappings to build the DataMart

Developed a standard ETL framework to enable the reusability of similar logic across the board. Involved in System Documentation of Dataflow and methodology.

Developed common routine mappings. Made use of mapping variables, mapping parameters and variable functions.

Used Informatica Designer to create complex mappings using different transformations like Filter, Router, Connected & Unconnected lookups, Stored Procedure, Joiner, Update Strategy, Expressions and Aggregator transformations to pipeline data to DataMart.

Developed Slowly Changing Dimension for Type 1 and Type 2 SCDs.

Used mapplets for use in mappings thereby saving valuable design time and effort

  • Used Informatica Workflow Manager to create, schedule, execute and monitor sessions, worklets and workflows.

Written shell scripts to run the workflows.

Responsible for submitting DBA requests, following up with data base DBA’s and Informatica administrators, creating remedy ticket, handling all the signoff’s for the production.

Troubleshooting database, workflows, mappings, source, and target to find out the bottlenecks and improved the performance.

Created Indexes, primary keys and checked other performance tuning at data base level.

Conducted Database testing to check Constrains, field size, Indexes, Stored Procedures, etc.

  • Implemented various Performance Tuning techniques on Sources, Targets, Mappings, Workflows and database tuning.

Performed Configuration Management to Migrate Informatica mappings/sessions /workflows from Development to Test to production environment.

Managed a team of 4 people offshore to coordinate the design and development or ETL process. Reviewed their documents and code to ensure all the requirements are met.

Environment: Informatica Power Center 7.1, (Source Analyzer, Warehouse Designer, Mapping Designer, Mapplets, Transformations, Workflow Manager, Worklets, Workflow Monitor), Oracle 10g, DB2, UDB, Rapid SQL, SQL, PL/SQL, flat files, HP UNIX 5, Toad 8.5, Microsoft Visio 2007, Windows XP, MS Office.

We'd love your feedback!