Etl Informatica Tech Lead Resume
San Ramon, CA
PROFESSIONAL SUMMARY:
- Around 13 years of IT experience in Analysis, design, development, testing and Implementation of Business Intelligence solutions using Data Warehouse/Data Mart Design, ETL, OLAP, BI, SOA, Client/Server applications and Data Modeling.
- Profound knowledge in Oracle database SQL & PL/SQL used to prepare data for testing, developing, and data migration.
- Advanced knowledge in SQL, PL/SQL Tunings
- Hands - on in Informatica Metadata Manager tool using data lineage
- Experienced in importing huge data from Confidential to RDBMS using Power Exchange. Hands on experience in Hive, Pig, Spoop commands like Import, Export, CodeGen, Eval & MapReduce.
- Writing Python 3.4 programs to extract the data from Data Warehouse tables and project them in reports to slice and dice the data
- Good experience in Data Modeling - used the tool Erwin
- Working in ETL Tool (Informatica 9.5) to extract data from Confidential, Oracle, MS-SQL, and flat files. Extensively used ETL methodology for complete development and production support projects.
- Excellent experience with defining and scoping business areas, compiling requirements, analyzing and documenting requirements, identifying solutions and verifying that the proposed solution meets the requirements
- Knowledge on FDRs (Full Dressed Rehearsal) for go-live DW projects
- Proficient in Test Conditions, Test Cases, Test Procedures & Test Plan preparation
- Strong Expertise in SDLC, Project Management and Testing Lifecycle Methodologies like Rational Unified Process (RUP), Waterfall, Agile methodologies in developing Confidential and TEDs
- Well experienced in Business Intelligence reports like BO Crystal reports, OBIEE, Hyperion Brio
- Written UNIX shell scripts to automate ETL jobs. Well versed with Vi commands.
- Hands-on in Sales Force Apex explorer and sales force relationships
- Hands on experience in Tableau 8 by creating dashboards for Finance reports
- Exposure to Business Objects Data Integrator (BODI)
PROFESSIONAL EXPERIENCE:
Confidential, San Ramon, CA
ETL Informatica Tech LeadResponsibilities:
- Understand the Confidential Risk FARM business and design the data flow according to the requirements
- Comply to ETL framework design that already in place and develop ETL jobs using Informatica 9.6 according to that framework
- Developed SCD1, SCD2 & Fact mappings extensively
- Validate the DQ (Data Quality) Rules using the mapplets built for each scenario like comparing Field 1 with Field 2 and valid values etc
- Mapplets are built by using IDQ (Informatica Developer 9.6)
- Creating detailed Unit Test documents with all scenarios before moving the code to Test environment
- Creating data pipelines for unstructured data using Luigi, Python package
- Performed data lineage by using Informatica Metadata Manager to find out where some critical fields are used and how many times they are used in the repositories
- Creating YTD, QTD, MTD reports using Python Tinkter packages
Environment: Informatica 9.6, IDQ 9.6, Oracle 11g, PL/SQL, Toad 11.5, SVN, Unix Shell Script, Windows 7
Confidential, San Francisco, CA
ETL Informatica Tech LeadResponsibilities:
- Designed ETL framework to move the data from Flat File to Datasets
- Created data pipelines for unstructured data using Luigi, Python package for Financial data sources
- Creating financial reports using Python Tinkter packages
- The framework includes design and development of ETL mappings from Flat File to ODS, ODS to Dimensions, Dimensions to Fact table / .csv target flat file
- An Unix script written to post the final target file to dataset which is formatted through JSON files
- The design done by creating Data Model for new tables joining with existing dimensional and fact tables
- Did a thorough analysis on data and its granularity levels before pitching into development
- Written shell scripts using AWK & SED commands to feed the Flat files into readable semicolon delimited formats and remove unwanted commas in between the fields
- Performed QA’s within our peers
- Deployed Shell Scripts, DMLs, DDLs and XMLs for Go-Live on SIT environment
- Integrated the Informatica jobs with Confidential Tidal Enterprise Scheduler tool, version 6.0.3.197
Confidential, South San Francisco, CA
ETL Informatica Tech Lead
Responsibilities:
- Involved in all sprint meetings where the project related specs and docs are shared and discussed with the team.
- Interacted closely with the Confidential to understand the step by step business requirements to create the tech specs and STMs
- Imported large datasets from Confidential to Informatica using Sqoop & Power Exchange
- Done analytics on huge datasets using Hive QL
- Supported Map Reduce jobs which was used to analyze unstructured data like Aprimo data which mostly contains Confidential feedback and profiles etc.
- Created complex mappings where the flow involves Landing, Delta, History, S1, S2 & DM schemas.
- Designed complex ETL logics by dividing the flow into simple steps with feasible ETL approaches that brought down the job timings well before the threshold timings.
- Extensively used PL/SQL Stored Procedure, Normalizer, Joiners and other regular transformations like, Expression, Lookups, Aggregator, Filters, Routers, etc.,
- Used dynamic session parameters widely
- Assisted SAP BO team in modeling the reports datamart in efficient ways
- Worked on Sales Force UI & APEX since SFDC is one of the source systems for AGGS Spend. Hands-on with sales force relationships and join queries
- Conducting regular technical meetings within the team where I would share the technical suggestions and clarify their functional queries.
Environment: Hadoop, Hive, Pig, Sqoop, Informatica Power Center 9.1, Oracle 11g, PL/SQL, SAP Business Objects XI3.1, Sales Force, Aprimo, Redwood (Scheduler), Toad, SQL*Loader, Unix Shell Script, Win 7
Confidential, Cupertino, CA
ETL Informatica Lead/ Data Analyst
Responsibilities:
- After studying the complete application, identified the bottlenecks in the system and suggested predominant performance improvements on PL/SQL part like using BULK Collects, bind variables, NOCOPY parameter, SIMPLE INTEGER in place of NUMBER data type etc.
- Processed the monthly and yearly jobs in parallel processing using Greenplum
- Requested AWR reports on daily basis and compared the report whenever any new code or major changes went live on system
- Used TKPROF utility to understand the AWR report in a better way and suggested to use bind variables to make less I/O, implemented using appropriate index based on the cardinality of the data
- Independently owned the validation part in of iCas whenever there are changes in the upstream systems like POS, Zingers. Recently owned POS R12.3 project
- Handled Brickhouse 1.5 project upgrade
- SPOC for Sawdust projects - which is the validation part in iCas when the Confidential store got inaugurated in Sweden recently
- Owner for Database refresh in test environments. Whenever the data is refreshed from prod to test, carried out the scrubbing part of prod customer information and encoding and decoding all fee columns.
- Written an automated shell script calling an stored procedure for post refresh activities like deletion of some prod only data in test systems and updation of email notifications addresses.
- Liaised closely with business people while month end closings and provided the solutions immediately to solve the issue on the fly
- Closely monitored the systems during the high volume season like iPhone 5 release. Mitigated the out of memory issue during that time by providing a feasible method.
- Conducted sessions with our offshore team on daily basis on particular topics and shared the knowledge.
Environment: Oracle 11g, PL/SQL, Toad, SQL*Loader, Unix Shell Script, Mac OS 10.7.4.
Confidential, San Jose, CA
ETL Informatica/ BIDW Lead
Responsibilities:
- Redesigned the source system and target loading architecture by creating materialized views in place of ordinary tables that saved 70% of job timings
- Modified the SQL queries used in Informatica to pick up the smallest table as driving table to convert the joins as HASH join which results in fastest execution of the queries
- Involved in the requirement phase with IT Team
- Created the Confidential & FSDs on their requirement. Once it got reviewed by IT team, started to prepare the ETL design of the requirement
- Shared the BRDs & FSDs with offshore team and explained the requirements and assigned tasks accordingly on ETL & reporting
- Conducted regular check point meetings with IT team
- Developed most complex ETLs for GFV (Global Fund Volume) Bookings
- Prepared unit test cases, regression test cases on Unit and SIT before moving to UAT
- During UAT fixed the defects raised by UAT team then and there
- Once UAT is signed off, prepared KT document for ITDS team and given a KT to them and got KT sign-off as well.
- Co-ordinated with ITDS (Support) team during migration code from UAT environment to production
- Made two successful Go-lives (Backlog & GFV Bookings)
Environment: Informatica Power Center 9.1, Oracle 10g, PL/SQL, SAP Business Objects XI3.1, Toad, SQL*Loader, UNIX Shell Script, $Universe ($U) Win XP
Confidential, Milpitas, CA
BIDW / ETL Informatica Lead
Responsibilities:
- Understood the complete architecture of EDW
- Closely worked with ERP source systems team in optimizing the creation of records for DW
- Involved in DB performance tuning during month end and quarter end closes when high volume of data flown into system by reducing the Physical reads and increased logical reads by tuning the top 10 queries listed in AWR.
- Supported end users by resolving the service tickets with high commitments and responsibilities
- Handled a 6 member team at offshore, India by assigning tickets after gathering enough inputs from users.
- Resolved the P1 & P2 tickets 24/7 then and there without any time on show stopper issues. Never breached P1 & P2s
- Worked on some vital Change Requests from end to end to change for the existing logic of several mappings and reports on Informatica and OBIEE respectively as requested by corporate users.
- Provided solutions to make the provisioning of access request hassle free, which is now under consideration by JDSU.
Environment: Informatica Power Center 8.6, DPA (Decision Point Administrator), Oracle 10g, PL/SQL, Oracle ERP (OM, PO, SCM, Item Master), OBIEE 10g, Hyperion Brio, Toad, Unix Shell Script, Win XP
Confidential
Senior Informatica Developer
Responsibilities:
- Analyzed the existing architecture of CDW
- Used Materialized views extensively to improve the data movement between source and target systems.
- With the help of Teradata utilities like TPump, Fast Load and with BTEQ queries migrated the Siebel source system to TD data base.
- Cleansed the legacy data using Informatica transformations such as sorters, expression transformations etc., usually cleansed customer data like addresses, telephone, zip code etc
- Assured the quality of data using Informatica transformations e.g. the commas between numeric fields, dashes between phone numbers, and product names such as MOL into Max OnLine.
- Developed several new mappings to pull data from legacy to new architecture
- Owner for bridge tables where the bridge tables serve as the reference for the legacy keys to current Siebel keys
- Involved in FDR3 cycle executions and fixed the runtime issues then and there
- Done performance tuning for long running jobs during FDR3 cycle and executed the jobs separately through an adhoc workflows.
Environment: Informatica Power Center 8.6, Siebel, Oracle 10g, PL/SQL, Toad, UNIX Shell Script, Win XP
Confidential, Redwood Shores, CA
ETL Informatica Developer
Responsibilities:
- As a Senior Systems Analyst for ETLAnalyzed the existing architecture
- Documented the analysis with complete detailed architecture and provided separate architectures for the proposed MDM
- Created a new database called R12 DB using data modeling tool Erwin for both logical and physical models
- Analyzed all ERP source systems existing in Oracle 11i and provided feasible solutions to move into Oracle R12.
- Designed high level ETL design in all feasible without affecting the performance.
Environment: Informatica Power Center 8.6, Oracle 9i, PL/SQL, Toad, Unix Shell Script, Win XP, HFM, Digital River, Demantra
Confidential
Informatica Developer/ Database Analyst
Responsibilities:
- Developed complex logic by using Oracle Procedures and Packages
- Cleansed the source data and assured the quality of the data at the staging level
- Developed complex logic by using transformations in Informatica
- Providing Technical Solutions to the Team
- Development work for new enhancements - Oracle PL/SQL, Informatica
- Testing - unit testing & integration testing
- Application Support
- Analyzing data-issues
- Coordinating with source systems to resolve data issues
- Performance tuning and providing technical solutions to critical issues
- Involved in production support activities for SLA project both in ODS and ETL
- Debugging and fixing the issues in UNIX shell scripts
Environment: Informatica Power Center 7.1/8.1, Oracle 9i, PL/SQL, Toad, UNIX Shell Script, Win XP
Confidential
Informatica Developer
Responsibilities:
- Changes in the existing module are sent by the business owner as Confidential (Business Requirement Document).
- Analyzing the Confidential, finding out the required changes, presenting the approaches to implement the changes includes the initial steps.
- Changes in the module include Database, PL/SQL, Informatica mappings/sessions, MSTR and ASCII changes.
Environment: Informatica Power Center 7.1/8.1, Oracle 9i, PL/SQL, MSTR, Toad, UNIX Shell Script, Win XP
Confidential
Oracle Lead
Responsibilities:
- Being a key person, analyzed all existing Pro*C files and converted them into PL/SQL process files comprising, pay slip printing, arrears calculation, increment & promotion updates etc. and D2k Reports comprising bonus calculation, diff in increment amt, family details etc, with same look & feel and functionality as per client’s requirements.
Environment: Oracle 8i, PL/SQL, Developer 2000 Forms 6.0, Reports 6i, Toad, Win XP
Confidential
Database Developer
Responsibilities:
- Being a key person, developed nearly 23 forms & 32 reports in D2K.
Environment: Oracle 7, PL/SQL, Developer 2000 Forms 4.5, Reports 2.5, HP Unix, Win XP
Confidential
Database Developer
Responsibilities:
- Being a team member analyzed and developed 5 forms, 9 reports and 3 store procedures for this module.
Environment: Oracle 8i, PL/SQL, Developer 2000 Forms 6.0, Reports 6i, Toad, Win XP