We provide IT Staff Augmentation Services!

Sr. Idq Developer/teradata Developer Resume

5.00/5 (Submit Your Rating)

PhiladelphiA

SUMMARY:

  • 8+ years of IT experience as developer using Informatica and TERADATA ( V2R6, V12, V13, V14),ETL processes involving in all SDLC phases like Business Requirements Analysis, Application Design, Data Modeling.
  • 5+ years’ experience on Data Warehousing, developing strategies for Extraction, Transformation & Loading (ETL) mechanism - using Teradata and UNIX.
  • Successfully managed multiple projects under Agile SDLC stream & strategy planning stream to support modernization of client's enterprise communications architecture program.
  • Provided consulting services to multiple project delivery teams in the areas of Agile project management
  • Extensive experience on SQL programming and complex stored procedure development.
  • Strong knowledge of Teradata RDBMS Architecture (AMP, PE, BYNET and Data distribution/Index’s/Hash).
  • Captured the DQ metrics using the Profiles and Created scorecards to review data quality using IDQ
  • Expert in Dimensional Data Modeling, using Data Modeling, Star-Join Snowflake Schema Modeling, FACT & Dimensions Tables, Logical & Physical Data Modeling using ERWIN.
  • Expertise in Design, development, testing of Extract, Transform and Load (ETL) processes necessary to load and validate data warehouse using UNIX shell scripting.
  • Proficient in performance analysis, monitoring and SQL query tuning using EXPLAIN PLAN, Collect Statistics.
  • Worked on data profiling & various data quality rules development using Informatica Data Quality.
  • Worked with Informatica Data Quality 10.1.1 (IDQ) toolkit, Analysis, data cleansing, data matching, exception handling, and reporting and monitoring capabilities of IDQ 10.1.1.
  • Designed and developed Informatica Mappings, Mapplets, and Sessions, Workflows based on business user requirements and business rules to load data from source flat files and RDBMS tables to target tables.
  • Create Rules, Mappings, Mapplets, Worklets, Sessions and Workflows using Informatica suite of products such as Informatica PC, IDQ and BDE Worked with different file format and compression techniques to ensure optimal performance of hive queries .
  • Worked on Teradata SQL, BTEQ, MLoad, FastLoad, and FastExport for Ad-hoc queries, and build UNIX shell script to perform ETL interfaces BTEQ, FastLoad or FastExport. Created numerous Volatile, Global, Set, MultiSet tables
  • Experience in creating the Profiles, Scorecards and add the custom Rules and Filters in Informatica Analyst and Developer Tools.
  • Experience in developing Teradata databases, manipulating data and making change to dimensions in databases using Teradata Utilities. SQL scripts were developed for accessing data from the Teradata tables. Create Profiles and Scorecards on Hive and HDFS data sources to analyze data and monitor data quality health.
  • Created Mappings to read and write from RelationalSources, HDFS and Hive Tables using Informatica PC/ Developer tool.
  • Created multiple indexes on set and multi set tables in Teradata.
  • Worked with pre-and post-sessions and Created Workflows and used various tasks like Email, Event-wait and Event-raise , Timer, Scheduler, Control, Decision, Session in the workflow manager.
  • Attending project meetings and work with teams, Project managers, team member’s associates, business analysts, statisticians, and internal customers/ end users, working with multiple tasks.

TECHNICAL SKILLS:

Operating Systems: Windows 7, OS390, Linux, Unix

Languages: BTEQ, SQL, Unix/Linux Shell Script

Database: Teradata, Oracle, SQL Server

Special Software/ Tools: Putty, SQL Assistant, View Point, TSAM, FastLoad, MultiLoad, FastExport, Tpump

ETL Tools: Informatica Power center 9.6.1/9.1/8. x

Cleansing Tools: Informatica Data Quality (IDQ 10.1.0/1.1)

PROFESSIONAL EXPERIENCE:

Confidential, Philadelphia

Sr. IDQ Developer/Teradata Developer

Responsibilities:

  • Created Source to Target mapping document for various mappings and Rules developed for business line.
  • Worked with Informatica Data Quality (IDQ) toolkit, Analysis, data cleansing, data matching, data conversion, exception handling, and reporting and monitoring capabilities of IDQ.
  • Worked on data profiling & various data quality rules development using Informatica Data Quality.
  • Implemented Exception Handling Mappings by using Data Quality, data validation by using Informatica Analyst.
  • Created the Rule Specifications and applied them on profiles Using Informatica Analyst and Developer.
  • Extracted the Profile Statistics data from the Informatica repository tables and loaded them into the Fact tables.
  • Created the Scorecards to track the data quality results on a daily basis.
  • Developed Mappings using Informatica Power Center to load data from various sources, using different transformations like Source Qualifier, Expression, Lookup (Connected and Unconnected), and Aggregator, Update Strategy, Joiner, Filter and Sorter transformations.
  • Worked on Teradata SQL, BTEQ, MLoad, FastLoad, and FastExport for Ad-hoc queries, and build UNIX shell script to perform ETL interfaces BTEQ, FastLoad or FastExport. Created numerous Volatile, Global, Set, MultiSet tables
  • Debug the Informatica mappings for DQ Metrics and by utilizing the session logs in Informatica.
  • Worked with Informatica Power Center Workflow Manager to create sessions, workflows and work-lets.
  • Created Workflows and monitored Sessions to execute Informatica mappings.
  • Proficient in performance analysis, monitoring and SQL query tuning using EXPLAIN PLAN, Collect Statistics.
  • Defined Business rules in Informatica Data Quality to evaluate quality of data by creating cleanse processes to monitor compliance with standards and identified areas for data quality gaps and assist in resolving data quality issues.
  • Created multiple indexes on set and multi set tables in Teradata.
  • Worked on performance tuning of Informatica Jobs by optimizing all transformations.
  • Created Mappings to read and write from RelationalSources, HDFS and Hive Tables using Informatica PC/ Developer tool.
  • Prepared all documents necessary for knowledge transfer such as Data Lineage, ETL Development Standards, ETL Processes, etc.
  • Experience with Informatica BDE related work on HDFS, Hive, Spark.
  • Match and Merge rules will be implemented in Informatica MDM to find the duplicates and to analyze the golden record.
  • Developed profiles which include column level and join analysis on relational tables and flat files and generated scorecards.

Environment: Informatica Data Quality (IDQ) 10.1.0,10.1.1 Informatica Analyst 10.1.1, Oracle 11g/10g, Toad 12.7, Informatica BDE 10.1.0, MapR 3.1, Hive 0.12,Teradata 14.10, FastLoad, FastExport, Multiload

Confidential, Dallas, Texas

Sr.IDQ Developer/Tearadata Developer

Responsibilities:

  • Design, Development and implementation of Informatica Developer Mappings for data cleansing using Address validator, Labeler, Association, Parser, Expression, Filter, Router, Lookup transformations etc.
  • Used lookup transformation, Aggregator transformation, Filter transformation, Update strategy and Router transformations.
  • Designed and developed Informatica Mappings, Mapplets, and Sessions, Workflows based on business user requirements and business rules to load data from source flat files and RDBMS tables to target tables.
  • Built Physical Data Objects and developed various Mapping, Mapplets/rules using Informatica Data Quality based on requirements to profile, validate and cleanse the data.
  • Used transformations like Matc h, Expression, lookups, Filter, Aggregator, Merge and Sequence generator.
  • Create Rules, Mappings, Mapplets, Worklets, Sessions and Workflows using Informatica suite of products such as IDQ and BDE
  • Used different algorithms like Bigram Distance, Edit Distance, Jaro Distance, Reverse Distance, Hamming Distance in Match Transformation to determine the threshold values to identify and eliminate the duplicate datasets .
  • Create Profiles and Scorecards on Hive and HDFS data sources to analyze data and monitor data quality health.
  • Used Teradata utilities for Teradata ETL processing huge volumes of data throughput Fast Load, Fast Export, MultiLoad, Tpump and involved in implementation and batch monitoring.
  • Used IDQ (Informatica Data Quality) as data Cleansing tool to create the IDQ Mapplets and to correct the data before loading into the Target tables.
  • Created reports to retrieve data using Stored Procedures As per the User Needs.
  • Experienced in extracting data from different source systems with different schema types and loading into Teradata.
  • Developed Bteq scripts to load data to Teradata and developed UNIX scripts to access Teradata.
  • Proficient in performance analysis, monitoring and SQL query tuning using EXPLAIN PLAN, Collect Statistics.
  • Involved in massive data profiling and duplicate data removing using Informatica IDQ prior to data staging.
  • Create Scorecards in IDQ Developer and Analyst to identify the trend of the quality of data
  • Wrote Case Expressions, Data Manipulation Command by using Teradata (BTEQ).
  • Debug the Informatica mappings for DQ Metrics and by utilizing the session logs in Informatica.
  • Practical understanding of the Data modeling (Dimensional & Relational) concepts like Star-Schema Modeling, Snowflake Schema Modeling, Fact and Dimension tables.
  • Proficient in importing/exporting large amounts of data from files to Teradata and vice versa.
  • Developed UNIX shell scripts and used BTEQ, Fast Load, MultiLoad, and Fast Export/TPT utilities extensively to load to target database.
  • Worked with Informatica Data Quality 9.6.1 (IDQ) toolkit, Analysis, data cleansing, data matching, exception handling, and reporting and monitoring capabilities of IDQ 9.6.1.

Environnent: Teradata13, BTEQ, Multiload, KornShells, ViewPoint, IDQ 9.6.1 Informatica BDE 9.6.0, Hive 0.12

Confidential

Teradata Developer/Informatica Developer

Responsibilities:

  • Extensively used cursors and temp tables to load each row from legacy to application database.
  • Used Informatica PowerCenter (ETL) for data transformations from heterogeneous source systems into target database
  • Developed SQL for loading Meta data from Excel spread sheet to the database using SQL Loader.
  • Developed Informatica mappings and unit tested them as part of Change requests new development effort.
  • Designed and developed Teradata sorted procedures to extract data from various system and load the data into target environment in a specific format
  • Designed and developed Teradata Bteq export scripts to generate output files for the third party vendor requirement
  • Created technical specification documents based on the existing functionality and requirements.
  • Created detailed technical design specification for enhancing the batch programs
  • Identified and eliminated data skews and I/O skews as part of performance optimization
  • Created shortcuts for reusable source/target definitions, Reusable Transformations, mapplets in Shared folder.
  • Monitoring the Scheduled jobs and Respond for ant failure alert received from server.
  • Created detailed documentation using Data Flow diagrams, rule-sets/thresholds, and ETL mappings Involved
  • Prepared Test Cases for Unit and Integration Testing. Performed Unit and Integration Testing
  • Worked autonomously to provide solutions relative to ad hoc analysis and ad hoc SQL queries
  • Interact with business to collect critical business metrics and provide solution to certify data for business use

Environment: and Technologies: Teradata, UNIX, MS SQL Server, Teradata utilities - BTEQ, Informatica Power Center 8.6

Confidential

SQL Developer

Responsibilities:

  • Created Packages, stored procedures, queries, and triggers on Oracle 10g
  • Involved in the creation of Table design .
  • Created databases and tables based on Entity Relationship Model (ERM).
  • Used various Transformations Data and Control Flow, Implemented Event Handlers and Error Handling in SSIS.
  • Extensive knowledge in RDBMS concepts, logical/physical data models, indexes.
  • Wrote store procedures to generate account statements for different types of accounts
  • Involved in migration of SSRS from SQL 2005 to SQL 2008
  • Worked with T-SQL to create Tables, Views, and triggers and stored Procedures.
  • Using temporary tables and CTE for optimal utilization of resources when not affecting performance.
  • Created stored procedures to support the SSIS packages for retrieving data from Oracle.
  • Developed various types of reports like Cascading, Drill Down, and Drill through using SSRS.
  • Responsible for deploying the SSIS Packages from development to production server.
  • Involved in loading the partner flat files into the OLTP database. Also, developed the T-SQL stored procedures/functions to process these data and populate them in the appropriate destination tables.
  • Extensively used Joins and sub-queries for complex queries involving multiple tables from different databases.

Environment: Oracle, Microsoft SQL Server, SSIS

We'd love your feedback!