Sr Informatica / Teradata Developer Resume
Chicago, IL
SUMMARY
- Around 7+ years of experience in development of various projects using Data Warehousing tools like Informatica and Databases like Oracle, SqlServer, Teradata and DB2 UDB.
- Sound Knowledge of Data Warehouse/Data Mart, Data Modeling, Data Profiling Techniques.
- Creating ETL mappings using Informatica Power Center to move data from multiple sources such as XML, DB2, Teradata, MS SQL Server, flat files, and Oracle into a common target area such as data marts and data warehouse.
- Over 5+ years worked with Teradata utilities likeBTEQ, Fast Export, Fast Load, Multi Loadto export and load data to/from different source systems including flat files.
- Sound Knowledge of Data Warehouse/Data Mart, Data Modeling, Data Profiling Techniques.
- Experience in DBMS Utilities such as SQL, PL/SQL, TOAD, SQL*Loader and Teradata SQL Assistant.
- Experience in gathering and writing detailed business requirement and translating them into technical specifications and design.
- Experience to create vision, scope, and use case documents; business process models, use case diagrams, activity diagrams, and state chart diagrams.
- Expertise in building Enterprise Data Warehouses (EDW), Operational Data Store (ODS), Data Marts, and Decision Support Systems (DSS) using Data modeling tool ERWIN and Dimensional modeling techniques (Kimball and Inmon), Star and Snowflake schema addressing Slowly Changing Dimensions (SCDs).
- Creating complex mappings in PowerCenter Designer using Aggregate, Expression, Filter, Sequence Generator, Update Strategy, Union, Lookup, Joiner, XML Source Qualifier, and stored procedure transformations.
- Highly motivated and goal - oriented individual with a strong background inSDLC ProjectManagement and Resource Planning using AGILE methodologies.
- Exported the data into from UNIX to Mainframe for backup.
- Extensive Knowledge on the development life cycle process from requirements gathering to deployment of code to production and good knowledge on the Dimensional modeling.
- Experience to work with senior management to identify strategic goals, objectives, scope, budgets and process for internal and external development and to manage risk analysis and mitigation plans, status reports, and client presentations.
- Extensive experience in Production support management involving Informatica, Oracle, Unix and Mainframes.
- Hands on Experience with the scheduling tools like Control M, Autosys scheduler.
- Good Understanding and Knowledge on the Business Intelligence Tools like Cognos.
- Experience to create vision, scope, and use case documents; business process models, use case diagrams, activity diagrams, and state chart diagrams.
- Experienced in Erwin data modeling, Star-Schema design, Logical data modeling, Normalization, Physical design, Data Analysis, Data Modeling, Reports and Report Design.
- Involved in all phases of data warehouse project life cycle. Designed and developed ETL Architecture to load data from various sources like Oracle, Flat files, Db2 UDB, XML files and MS SQL Server into Oracle, XML and SQL server targets.
- Experienced in leading and managing onsite/off shore team.
- Excellent Analytical, problem solving, communication and interpersonal skills.
- Experience in Health, Banking, and Manufacturing domains.
- Flexible, enthusiastic and project oriented team player with excellent communication skills with leadership abilities to develop creative solution for challenging requirement of client.
- Ability to understand long-term project development issues at all levels, from interpersonal relationships to the details of coding scripts with strong analytical, organizational, presentation and problem solving skills.
TECHNICAL SKILLS
Platform: IBM OS/390, Windows, UNIX.
Languages: PL/SQL, SQL, COBOL,UNIX Scripting, JCL, CICS, XML.
Database: DB2 UDB, Oracle 10g, Teradata, SQL server, VSAM.
ETL tool: Informatica Powercenter 9.5.1/8.x/7.x/6.x
Database Access Tools: TOAD, Teradata SQL Assistant, T-SQL, Quality Center.
Database Utilities: Oracle PL/SQL developer, FTP client, Business Objects Supervisor, MQ Series, TPT, BTEQ, fastload, Multiload, FastExport, TPump, SQLPlus, CA-7, Business Objects.
PROFESSIONAL EXPERIENCE
Confidential, Chicago, IL
Sr Informatica / Teradata Developer
Responsibilities:
- Interacted with business users, analysts to gather, understand, analyze, program and document the requirements of Data Warehouse.
- Extracted data from various sources like databases, delimited flat files and XMLs.
- Designed and developed parameterized generic graphs
- Involved ingenerating and applying rulesto profile data for flat files and relational data by creating rules in IDE and case cleanse, parse, standardize data through mappings in IDQ and generated as Mapplets in PC.
- Worked on identifying Mapping Bottlenecks and improved session performance through error handling.
- Worked onMappletsand createdparameter fileswherever necessary to facilitatereusability.
- Responsible for designing ETL strategy for both Initial and Incremental loads.
- Loaded data into Teradata using TPT, Fast Load, BTEQ, and Fast Export, Multi Load, and Korn shell scripts.
- Extensively used Informatica FunctionsLTRIM, RTRIM, DECODE, ISNULL, IIF, INSTR and datefunctions in Transformations.
- Effectively workedon Mapping Designer, Workflow Manager, and Workflow Monitor.
- Extensively usedSequence Generator in all mappingsandfixed bugs / ticketsraised in production for existing mappings in common folder for new files throughversioning(Check in and Check out)on an urgency through support for QA in component unit testing and validation.
- Usedshortcuts for sources, targets, transformations, Mapplets, and sessions to reuse objectswithout creating multiple objects in therepository and inherit changesmade to the source automatically.
- Involved in Create / Modify / Drop Teradata objects like Tables, Views, Join Indexes, Triggers, Macros, Procedures, and Databases
- Involved in checkingData accuracystandards for NULLS, Comparison, key generator and labeler usingreference table manager in PWHand rolled based on statistics throughThreshold value and Score Cardsapplied the Data cleansing process in Model Repository on same domain and merged to Power center.
- Used the PL/SQL procedures for Informatica mappings for truncating the data in target tables at run time.
- Performed the data profiling and analysis making use ofInformatica Data Explorer (IDE) and Informatica Data Quality (IDQ).
- Extensively workedon performance tuningand also in isolatingheader and footer in single file.
- Provided performance tuning and physical and logical database design support in projects for Teradata systems
- Prepared the Standard Operating Procedure (Knowledge Transfer) document, which provides necessary information, required for the Maintenance and Operation of the application.
- Performed code migration ofmappings and workflows from Development to Test and ProductionServers through deployment groups for DEV, TEST and PROD repositories in retaining shortcuts, dependencies with versioning.
- Worked withUNIX commandsand usedUNIX shell scriptingto automate jobs. WroteUnix scripts to back up the log files inQAand production.
- Effectively understood session error logs and useddebuggerto testmapping and fixed bugsin DEV in following change procedures and validation.
- Used pmcmd command to run workflows though shell scripts.
- Tuned and optimized mappingsto reduce ETL run time and ensuring they ran within designated load window.
Environment: Informatica Power Center 9.5.1, Oracle 11g, Oracle SQL* LOADER, Teradata 14.10, TPT, BTEQ, Teradata SQL Assistant, FAST LOAD, Flat Files, UNIX Shell Scripting, TOAD, Crontab, SQL, VSS, IDE, IDQ, Outlook, Putty, WinSCP.
Confidential, Addison, IL
Sr. Informatica Developer
Responsibilities:
- Worked with business analysts for requirement gathering (BRD), business analysis, and translated the business requirements into technical specifications to build the Enterprise data warehouse.
- Interacted with both Technical, functional and business audiences across different phases of the project life cycle.
- Developed mappings for fact and dimension tables using the various transformations to extract data from different source databases Oracle, Db2 UDB, SQL Server and XML Files.
- Designed and developed complex ETL mappings by making use of transformations like Source Qualifier, Joiner, Update Strategy, Connected Lookup and unconnected Lookup, Rank, Expression, Router, Filter, Aggregator and Sequence Generator transformations.
- Worked on Migration of mappings from Data Stage to Informatica.
- Worked on Power Exchange bulk data movement processes by using Power Exchange Change Data Capture (CDC) method.
- Good knowledge in Unix Shell scripting.
- Excellent experience in ETL Tools like Informatica and on implementing Slowly Changing Dimensions (SCD).
- ETL performance enhancement using data-parallelism (m-file), component-parallelism and pipeline-parallelism, in-memory sorting.
- Implemented phasing and checkpoint approach in ETL process to prevent data loss and to maintain uninterrupted data flow against process failures.
- Employing the Informatica Data Quality (IDQ) to help identify data issues and implementing the cleansing procedures with existing interfaces/migrations.
- Written and used UNIX shell scripts extensively for scheduling and pre/post session management.
- Created Workflows using various tasks like sessions, events raise, event wait, decision, e-mail, command, worklets, Assignment and worked on scheduling of the workflows.
- Used mapping parameters and variables.
- Prepared mapping specification document, which gives the data flow and transformation logic for populating each column in the data warehouse table.
- Created test plans and test cases and responsible for unit testing.
- Used debugger to analyze the data flow between source and target to fix the data issues.
- Developed PL/SQL procedures, functions to facilitate specific requirement.
- Optimized and Tuned SQL queries and PL/SQL blocks to eliminate Full Table scans to reduce Disk I/O and Sorts.
- Used SQL Loader to load huge flat files into Oracle database.
- Implemented audit and reconcile process to ensure Data warehouse is matching with the source systems in all reporting perspectives.
- Worked with PowerCenter parameter file which is a list of parameters and variables and their associated values, includes information for multiple services, service processes, workflows, worklets, and sessions in a single parameter file.
- Prepared the Standard Operating Procedure (Knowledge Transfer) document, which provides necessary information, required for the Maintenance and Operation of the application.
- Created and automated a comparison process to compare the results generated by the old application (Mainframes) and the new application and captured the unmatched records.
- Analyzed the issues with the unmatched records and provided code fix to the problems.
- Extensive knowledge on Analysing the Software Requirement Specifications and Software Development Life Cycle (SDLC) like water fall and agile methodologies.
- Developed a UNIX Shell scripts which will send the reports to client over the network by using file transfer protocol (FTP & SFTP) and generating the log file, which will keep the history for the FTP reports.
- Executed Informatica workflows using PMCMD utility thru UNIX scripts.
- Provided data loading, monitoring, System support and worked on data issues raised by end user during its production support phase.
- Wrote SQL Queries as part of Data validation in the Target tables.
Environment: Informatica Power Center 9.1.0, Oracle 10g, Oracle SQL* LOADER, Flat Files, UNIX Shell Scripting, TOAD, Crontab, SQL, VSS, Outlook, Putty, MLOAD, TPUMP, FAST EXPORT.
Confidential, IL
Sr. Informatica Developer / Teradata Developer
Responsibilities:
- Involved interactively with the business units to understand the requirements and gather the feedback during the design, development and testing of solutions.
- Worked on various data sources such as Oracle, DB2 UDB and flat files.
- Extracted the data from various data source systems into the Landing Zone area by creating the Informatica mappings using the Teradata fast Loader Connections.
- Wrote SQL Queries as part of Data validation in the Target tables
- Created the Scripts to process the business logic from the Landing Zone to the Common Staging Area(CSA)
- SQL statements withsql extensions, which will be used in Database transformations to extract the data from different source tables and to load into the target table.
- Developed UNIX shell scripts using SQL programs for daily and weekly data loads.
- Database, Datasets, Transform, FTP and Sort to build Graphs in GDE
- Wrote Triggers and Stored Procedures using PL/SQL for Incremental updates.
- Integrated various sources in to the Staging area in Data warehouse to Integrate and for Cleansing data.
- Having brief practical knowledge on Power Exchange Navigator, Power Exchange Bulk Data movement, power exchange change data capture.
- Worked on utilities like FLOAD, MLOAD, FEXP of Teradata and created batch jobs using BTEQ.
- Created mapplets and reusable transformations.
- Creating sessions and batches to run with the logic embedded in the mappings using Informatica Power Center Workflow Manager.
- Used Informatica features to implement Type I, II changes in slowly changing dimension tables.
- Conducting debugging sessions and fixing invalid mappings.
- Designed and developed UNIX Scripts to automate the tasks.
- Used the different types of transformations in Informatica such as Source Qualifier, Look up, Router, Joiner, Union, Aggregator etc.
- Created necessary Repositories to handle the metadata in the ETL process.
- Created Data Breakpoints and Error Breakpoints for debugging the mappings using Debugger Wizard.
- Strong in UNIX Shell and PERL scripting. Developed UNIX scripts using PMCMD utility and scheduled ETL load using utilities like CRON tab, Maestro, Control-M.
- Done the Unit testing after successfully loading the data into Landing Zone (LZ) area.
Environment: Informatica PowerCenter 9.1, Teradata 13.10, TPT, BTEQ, Teradata SQL Assistant, Oracle 10g, Flat Files, Toad, SQL, PL/SQL, Unix Scripting, MLOAD, FASTLOAD, TPUMP .
Confidential, New York, NY
Sr. Informatica developer
Responsibilities:
- Interacted with business users, analysts to gather, understand, analyze, program and document the requirements of Data Warehouse.
- Developed shell scripts, PL/SQL procedures, for creating/dropping of table and indexes of performance for pre and post session management.
- Understood the business requirements with extensive interaction with users and reporting teams and assisted in developing the low level design documents.
- Using Sequence generator for Surrogate keys in the dimensions to reduce the complexity and for improving the performance of composite keys.
- Worked on Workflow Manager to Schedule the workflows and run the sessions according to job dependency
- Implemented phasing and checkpoint approach in ETL process to prevent data loss and to maintain uninterrupted data flow against process failures.
- Uploaded data from operational source system (Oracle 8i) to Teradata.
- Used utilities of FLOAD, MLOAD, FEXP of Teradata and created batch jobs using BTEQ.
- Imported Metadata from Teradata tables.
- Implemented Change Data Capture (CDC) using Power exchange.
- Prepared BTEQ scripts to load data from Preserve area to Staging area.
- Worked on Teradata SQL Assistant querying the source/target tables to validate the BTEQ scripts.
- Involved in peer to peer reviews.
- Troubleshoot the issues by checking sessions and workflow logs.
- Conducting debugging sessions and fixing invalid mappings.
- Created the Data Flow Diagrams to check the dependency.
- Involved in DBMS developments include building data migration scripts using Oracle SQL*LOADER and UTL packages.
- Wrote Unix Shell scripts to automate workflows.
- Developed unit testing, systems testing and post-production verification.
- Involved in writing the test cases and documentation
- Involved in extensive Performance tuning by determining bottlenecks at various points like targets, sources and systems. This led to better session performance.
- Participated in weekend reviews with team members and Business People.
Environment: Informatica Power Centre 8.6.0, Oracle 10g, Teradata 13.10, TPT, BTEQ, Teradata SQL Assistant, Teradata V2R6, FASTLOAD, Windows 2000.
Confidential, Lisle, IL
Informatica developer / Teradata Developer
Responsibilities:
- Involved in CompleteSoftware Development LifecycleExperience (SDLC) like water fall and Agile methodologies from Business Analysis to Development, Testing, Deployment and Documentation.
- Query optimization (explain plans, collect statistics, Primary and Secondary indexes).
- Responsible for day to day administration of Teradata databases.
- Experience with high volume datasets from various sources like Oracle, Text Files.
- Creating onetime data migrations of all conversions to the JDE Edwards enterprise one system
- Working with business units to identify mapping specifications.
- Created the ETL test plans and implemented the Code Review, Formal Testing, and Specification Testing using the Test Director.
- Implementing the standardized process to archive flat files and for loading indicator files.
- Also used the Informatica Data Exchange to connect to the Main frames source and extract the data.
- Create users, establish roles, create database structures and understand how to get Teradata database to perform well.
- Monitoring database space, Identifying tables with high skew, working with data modelling team to change the Primary Index on tables with High skew.
- Following a standard approach to create shortcuts for sources in the shared folder (JD World) and targets in the shared folder (JDE One World), naming conventions, and abbreviations
- Creating mapplets and reusable transformations.
- Implementing the error handling strategy process for all interfaces to avoid errors during the live environment and migrated the objects from the Dev, QA to Production Environment.
- Used the Informatica B2B Transformation to integrate the semi structured data and transformed into Usable format.
- Implementing Data Steward Notifications by creating the mapping template that is used to provide the high level and low level notification errors of workflows.
- Responding quickly and effectively to production issues and taking responsibility for seeing those issues through resolution.
- Good knowledge with DPI programming, direct inter-language function calls between the languages on either side of the interface.
- Performing code review, formal testing, optional testing, and specification review using Test Director.
- Implementing performance tuning methods to optimize developed mappings. .
- Constructed Korn shell driver routines (write, test and implement UNIX scripts)
- Involved in migration projects tomigrate datafrom data warehouses on Oracle/DB2 and migrated those toTeradata.
- Extensively worked on Informatica Power Center tools- Mapping Designer, Workflow Manager, Workflow Monitor and Repository Manager and Informatica Power Exchange.
- Performance tuned and optimized various complex SQL queries.
- Excellent knowledge on ETL tools such as Informatica, SAP BODS to load data to Teradata by making various connections to load and extract data to and from Teradata efficiently.
- Worked on data warehouses with sizes from 30-50 Terabytes.
- Coordinated with the business analysts and developers to discuss issues in interpreting the requirements.
Environment: Informatica PowerCenter 7.1, Power Exchange, Erwin, Oracle, Teradata 13.10, TPT, BTEQ, Teradata SQL Assistant SQL Tools, BTEQ, Power Connect, PL/SQL, UNIX, TOAD, FASTLOAD, Windows XP.
Confidential
Informatica developer
Responsibilities:
- Gathered the required information from the users.
- Interacted with different system groups for analysis of systems.
- Working with business units to identify mapping specifications.
- Created the ETL test plans and implemented the Code Review, Formal Testing, and Specification Testing using the Test Director.
- Implementing the standardized process to archive flat files and for loading indicator files.
- Also used the Informatica Data Exchange to connect to the Main frames source and extract the data.
- Designed database, tables and views structure for the new data mart.
- Using Teradata manager, Index Wizard and PMON utilities to improve performance.
- Populate or refresh Teradata tables using Fast load, Multi load & Fast export utilities for user Acceptance testing and loading history data into Teradata.
- Designed the ETL processes using Informatica to load data from SAP R/3, Oracle, Flat Files (Fixed Width), and Excel files to staging database and from staging to the target Teradata Warehouse database.
- Expertise in performance tuning the user queries, execution of frequently used SQL operations and improve the performance.
- Interacted with people from various teams in the Project like Oracle/Teradata DBAs', Maestro Schedulers, Spec. Creators, Reporting, Unix etc. to aid in the smooth functioning of the Project flow
- Extensive DB2 DBA and DB2 Connect experience with activities involving design, installation, configuration, requirements gathering, data modeling, tuning, security, backup, recovery and integration of database applications.
- Involved in debugging Informatica mappings, testing of Stored Procedures and Functions, Performance and Unit testing of Informatica Sessions, Batches and Target Data.
- Exported the data into from UNIX to Mainframe for backup.
- Knowledge transfer to the PS team.
- Developed the triggers to handle history and audit data for production environment.
- Created users, roles, profiles and Objects and system rights.
- Performance changes to allow fast handling of transaction processing related request (plan caching).
- Created Understanding documentation and Release Testing documentation on the tickets handled, and documented the issues found in a central repository.
- Involved in Performance testing of all the workflows/Mapping, which helped in analyzing its performance before moving into production.
- Extracted, Transformed and Loaded OLTP data into the Staging area and Data Warehouse using Informatica mapping and complex transformations (Aggregator, Joiner, Lookup, Normalizer, Filter).
- Involved in the code reviews prepared by the teams.
- Analyzing production support documents and finding the feasible time to run their jobs.
Environment: Informatica 6.2, SQL Tools, PL/SQL, Business Objects, UNIX, Windows XP.
