Etl/teradata Developer Resume
Plano, TX
PROFESSIONAL SUMMARY:
- Over 11 years of experience in IT industry with full development life cycle.
- Experience in Retail, Banking and Financedomains.
- Extensively worked with Teradata utilities like BTEQ, Fast Export, Fast Load, Multi Load to export and load data to/from different source systems including flat files.
- Experienced in Analysis, Design, Development and Maintenance of various software applications mainly in Data Warehousing, ETL Informatica Power Center, Oracle, UNIX and Sybase.
- Extensive experience on Informatica Power Center with strong business understanding and knowledge of ETL of data from heterogeneous source systems like Flat files, Excel, XML, Oracle andTeradata.
- Experience in Informatica 9.6.1 using components such as Mapping Designer, different types of Transformations such as (Source Qualifier, Filter, Aggregation, Router, Update Strategy, Connected and Unconnected Lookups, Union, Expression, Joiner, Sorter, Stored Procedure, Sequence Generator etc.)
- Proficient in using Informatica Workflow Manager, Workflow Monitor to create, schedule and control Workflows, Tasks, and Sessions
- Testing and Debugging of Informatica Mappings, Mapplets, Sessions, Tasks, Worklets and Workflows
- Expertise in the field of Data Warehousing and Involved in production support activities 24/7 during on call and resolved load issues
- Involved in Project Management, Projectestimations and resource management activities.
- Hands on experience using query tools like TOAD, SQL Developer, PLSQL developer and Teradata SQL Assistant.
- Expertise in writing large/complex queries using SQL.
- Proficient in performance analysis, monitoring and SQL query tuning using EXPLAIN PLAN, Collect Statistics, TD Viewpoint and Hints in Oracle.
- Experience with different indexes (PI, SI, JI, AJIs, PPI) and Collect Statistics.
- Expert in ETL design/development using Informatica
- Experience in working on different databases like Teradata, Oracle, Sybase, MS Access and Writing efficient and complex SQLs on huge volumes of data.
- Experience in creating Tables, Views, and Indexes, Stored procedures, Triggers, Cursors, Function and packages in Oracle.
- Extensive experience with Shell Scripting in the UNIX Environment. Used UNIX scripting and Scheduled PMCMD to interact with Informatica Server.
- Excellent experience in ETL Tools like Informatica and on implementing Slowly Changing Dimensions.
- Experience as an ETL developer using Informatica Power Center which includes Source analyzer, warehouse designer, mapping designer, mapplet designer, transformation designer and developer, Repository manager, Workflow manager and monitor.
- Expertise on Star Schema and Snowflake Schema, Fact Dimension Tables, Slowly Changing Dimensions. Interacting with both clients and users as well to know their requirements
- Implemented Performance Tuning Techniques and Error Handling at various levels like source and Target mappings.
- Extensive experience on Autosys and ESP scheduling tools.
- Good knowledge on Hadoop Ecosystem.
- Worked with unstructured and semi structured data.
- Extracted the data from Teradata into HDFS using Sqoop.
- Created Sqoop jobs with incremental load to populate Hive External tables.
- Experience in writing Pig scripts to transform raw data from several data sources into forming baseline data.
- Developed Hive scripts for end user / analyst requirements to perform ad hoc analysis.
- Knowledge onOozie workflow for scheduling and orchestrating the ETL process
- Sound knowledge of all phases of the Software Development Life Cycle (SDLC) Methodology and Agile method.
- Experience in working with both 3NF and dimensional models for data warehouse and good understanding of OLAP/OLTPsystems. Strong organizational and problem solving capabilities
- Technical team leadership
- Onsite/off - shore coordination Involved in Developing, Unit Testing, Integration Testing and preparing test cases. Testing and Debugging of Informatica Mappings, Mapplets, Sessions, Tasks, Worklets and Workflows
- Self-motivated and energetic, able to set priorities with adherence to guidelines and deadlines
- Using prototyping skills when appropriate, clarify customer requests/problems and determine appropriate action with proven success exceeding customer expectation
- Capable of working under high stress environment with resource
- Excellent communicator with emphasis on clearly presenting information and developing strong interpersonal relationships
TECHNICAL SKILLS:
Database: Teradata, Oracle,Sybase, MySQL
ETL Tools: Informatica Power Center 9.5x/9.x,Teradata
Data Modeling: ERWIN,Microsoft Visio, Visual Paradigm
Scheduling Tools: Autosys, ESP and Control-M
Languages: C,PL/SQL, Java, Teradata SQL, Oracle SQL
Web Technologies: HTML
Operating Systems: Windows, UNIX/Linux
Teradata Utilities: BTEQ, Fast Load, MutliLoad, Fast Export, Tpump, SQL Assistant, Teradata Parallel Transport utility (TPT)
Scripting Languages: UNIX Shell Scripting,Scala
PROFESSIONAL EXPERIENCE:
Confidential, Plano, TX
ETL/Teradata Developer
Responsibilities:
- Responsible for Requirements gathering & analysis, and Business Analytics. Design of Data Warehouse to meet the requirements.
- Prepare ETL design documents and review with the data modelers for data integrity.
- Determine data sources, their types, and perform data source analysis. Using mapping standards design simple transformations from complex data sources to the Data Warehouse. Create mapping documents to outline data flow from sources to targets.
- Designed and developed mappings, defined workflows and tasks, monitored sessions, exported and imported mappings and workflows, backups, and recovery.
- Created mappings, which involved transformations, like Filter, Router, Connected & Unconnected lookups, Stored Procedure, Sorter, Source Qualifier, Joiner, Update Strategy, Expression and Aggregator transformations to load the funds allocation transactions data. Used debugger to test the mappings and fixed the bugs.
- Extensively used ETL to load data from flat files involving both fixed width as well as delimited files, and also from the relational databases, Oracle and DB2.
- Developed slowly changed dimensions (SCD) Type 2 for loading data into Dimensions and Fact.
- Developed common routine mappings. Made use of mapping variables, mapping parameters and variable functions.
- Using Informatica Workflow Manager, define and develop workflow tasks like session, events raise, event wait, decision, e-mail, command, worklets.
- Extensively involved in writing SQL queries (Sub queries and Join conditions), Store Procedures and PL/SQL programming.
- Created and used reusable Mapplets and Worklets to reduce the redundancy.
- Analyzed the session and error logs for troubleshooting mappings and sessions.
- Test transformation output with expected outcome generated using SQL queries. Used Debugger to test the mappings and fixed the bugs.
- Performance tune source, target, mappings, and sessions.
- Created shell scripts in UNIX to automate the batch jobs.
- Used PMCMD to schedule jobs and shell scripting to upload data files into tables of the Oracle database.
- Define, configure and establish deployment best practices using development, staging and production environment. Prepare migration document to move the mappings from development to staging and then to production repositories.
- Assist Production Control team during deployments. Provided support for any production issues that may arise.
Environment: Informatica Power Center 9.6.1, Teradata 15.10,Oracle 11g, Mainframe andUNIX Shell Scripting
Confidential
ETL/Teradata Developer
Responsibilities:
- Interacted with technical, functional and business audiences across different phases of the project life cycle
- Researched on available data sources and identify data gaps. Collaborate with right data owners to bridge the data gaps and create new data sources. Also perform analysis and cleanup of existing data for redundancy and referential integrity.
- Designed and developed complex ETL mappings by making use of transformations like Source Qualifier, Joiner, Update Strategy, Connected and unconnected Lookup, Rank, Expression, Router, Filter, Aggregator and Sequence Generator transformations.
- Created Workflows using various tasks like sessions, decision, e-mail, command, worklet, assignment and worked on scheduling of the workflows.
- Prepared mapping specification document, which gives the data flow and transformation logic for populating each column in the data warehouse table.
- Developed PL/SQL procedures, functions to facilitate specific requirement.
- Design & optimization of complex SQL queries.
- Prepared the Standard Operating Procedure (Knowledge Transfer) document, which provides necessary information, required for the maintenance and operation of the application.
- Created the release requests for QA builds to include all the release requirements and involved in the implementation of QA, UAT and Production releases.
- Provided data loading, monitoring, and system support and worked on data issues raised by end user during its production support phase.
Environment: Informatica Power Center, Teradata, Oracle, SQL Server, Flat files, Toad, UNIX
Confidential
ETL Developer
Responsibilities:
- Interacted with Business Analysts for requirements gathering (BRD), business analysis, and translated the business requirements into technical specifications to build the Enterprise Data Warehouse.
- Developed PL/SQL procedures, functions to facilitate specific requirement.
- Worked with the DBA to improve ETL performance and query performance by collecting statistics and defining relevant indexes on database tables.
- Involved in performance tuning in Informatica for source, transformation, targets, mapping and session.
- Developed and Documented Unit Test cases as part of the interface development deliverable.
- Involved in System and Integration Testing in order to detect and resolve development defects.
- Provided Production Support to ensure smooth execution of the interfaces.
Environment: Oracle, Excel spreadsheets, Flat Files,UNIX
Confidential
ETL Developer
Responsibilities:
- Worked with business Analysts and Data Modelers to understand the data model and clarify transformation rules to propagate data movement
- Interacted with both Technical, functional and business audiences across different phases of project lifecycle.
- Designed target Data warehouse using Star schema, involved in extraction, transformation and loading process of purchase order details.
- Involved in designing dimensional model like Star schema, snowflake schema for procurement and Order management.
- Created mappings, sessions and workflows as per requirements.
- Created DDL scripts for creating table in Data warehouse and Staging Database.
- Developed UNIX shell scripts to automate data loading process.
- Analyzed session and error logs for troubleshooting mappings and session.
- Performed unit testing on all ETL components and prepared migration template
- Performed sanity check after QA migration.
Environment: Oracle 11g, Autosys, Datastage, Flat files, Unix
Confidential
Developer
Responsibilities:
- Designed and built data marts using star schema.
- Created parameter files for workflows and sessions.
- Created reusable transformations and mapplets and used them in mappings in case of reuse of the transformations in different mappings.
- Extensively used SQL overrides at Source Qualifier and lookup transformations while extracting data from multiple tables.
- Identified bottlenecks and executed performance tuning.
- Used debugger to analyze data flow between source and target to fix the data issues.
Environment: Oracle, SQL Server, Flat files, UNIX
Confidential
Developer
Responsibilities:
- Collaborated with Business users and prepared Business requirement document (BRD), Functional Requirement document and Technical requirement document (TDD) for development.
- Designed proof of concept and implemented data conversion, development, System Integration and User Acceptant testing.
- Developed logical Data Map documents to describe relationship between source and target data.
- Involved in System and Integration testing in order to detect and resolve development defects
- Improved performance of long running batch jobs with the help of SQL tuning, Indexes and partitioning and executed complex DB reports.
