Informatica Developer Resume
Irvine, CA
SUMMARY
- A seasoned ETL/Tableau developer with around 7 years of IT experience in the Analysis, Design, Development, Testing and Implementation of business application system for Health, Banking, Insurance & Manufacturing.
- Strong Data Warehousing ETL experience of using Informatica 10.0.1 /9.1/8.6.1/ PowerCenter Client tools - Mapping Designer, Repository manager, Workflow Manager/Monitor and Server tools - Informatica Server, Repository Server manager.
- Experience in all phases of Data warehouse development from requirements gathering for the data warehouse to develop the code, Unit Testing and Documenting.
- Strong experience in Extraction, Transformation and Loading (ETL) data from various sources into Data Warehouses and Data Marts using Informatica Power Center (Repository Manager, Designer, Workflow Manager, Workflow Monitor, Metadata Manger), Power Connect as ETL tool on Oracle, DB2 and SQL Server Databases.
- Redshift, worked on project to migrate data from on premise databases to Amazon Redshift, RDS and S3.
- Hands-on experience across all stages of Software Development Life Cycle (SDLC) including business requirement analysis, data mapping, build, unit testing, systems integration and user acceptance testing.
- Experience with dimensional modelling using star schema and snowflake models.
- Understand the business rules completely based on High Level document specifications and implements the data transformation methodologies.
- Designed and developed Tableau dashboards that improved the look and feel as well as AWS Services: Data pipeline, S3.
- Hands on experience in AXON and EDC installation and configurations, bulk upload, creating and scanning the resources.
- Consulted with team of engineers to build out and maintain a reporting data warehouse in Snowflake and a reporting environment in Tableau to be utilized by various teams throughout the organization.
- Build data pipelines to move data from relational database to Redshift with the help of CDC
- Created UNIX shell scripts to run the Informatica workflows and controlling the ETL flow.
- Vast experience in Designing and developing complex mappings from varied transformation logic like Unconnected and Connected lookups, Source Qualifier, Router, Filter, Expression, Aggregator, Joiner, Update Strategy etc.
- Built tables and views in MySQL, Redshift, and Snowflake in order to efficiently house data used in various analyses.
- Pulled data from a data warehouse spanning multiple servers using MySQL, Snowflake, Redshift, Tableau, R, PHP, and Adobe Analytics.
- Ability to meet deadlines and handle multiple tasks, decisive with strong leadership qualities, flexible in work schedules and possess good communication skills.
- Authorized to work in United States for any employer.
TECHNICAL SKILLS
ETL Tools: Informatica Power Center 10.x/9.x/8.x, PDI(Pentaho Data Integration),SSIS(SQL Server Integration Services).
Analytics Tools: Tableau, Power BI, Excel, Pyramid
Databases: Teradata, Oracle 12c/11g/10g, DB2, MS SQL Server 2008, MS Access
RDMS Load Tools: TOAD 8.x, Oracle SQL Developer, SQL *Loader, Teradata SQL Assistant
Languages: C, C++, SQL, PL/SQL, Python, Perl, Shell Scripting, HTML
Database: MySQL, MS SQL, MongoDB, SQLITE
Data modelling tools: Erwin
Software Products: MS Office 2000/2007/2010 Visual Studio 2008, Putty
Monitoring Tools: Nagios, Splunk
Operating Systems: Windows, UNIX, Linux
Scheduler: Control-M, Informatica Scheduler, ActiveBatch.
PROFESSIONAL EXPERIENCE
Confidential, Irvine, CA
Informatica Developer
Responsibilities:
- Extensively Working on Informatica tools such as Source Analyzer, Warehouse Designer, Transformation Designer, Mapplet Designer and Mapping Designer.
- Create ETL mappings with complex business logic for high volume data loads using various transformations such as Aggregator, Sorter, Filter, Normalizer, SQL Transformation, Lookup, Joiner, Router, Update Strategy, Union, Sequence Generator, transformation language likes transformation expression, constants, system variables, data format strings etc.
- Developed Mapplets, Reusable Transformations, Source and Target definitions, mappings using Informatica 10.0.
- Used Teradata utilities FAST LOAD, MULTI LOAD, TPUMP to load data.
- Wrote, tested and implemented Teradata Fast load, Multiload and BTEQ scripts, DML and DDL.
- Used BTEQ and SQL Assistant (Query man) front-end tools to issue SQL commands matching the business requirements to Teradata RDBMS.
- Configured match rule set property by enabling search by rules in MDM according to Business Rules.
- Extensively worked on building workflows, worklets, sessions, command tasks etc.
- Analyzed the business data and defined the Match and Merge rules and Trust Scores for MDM Hub.
- Improved and upgraded the existing reports by collecting, processing, analyzing and reporting on metrics and quality control data, meeting specific customer reporting requirements.
- Created custom SQL to provide detailed results by tuning of Reports by validating SQL against database and troubleshoot reports that are not providing accurate data due to custom SQL codes.
- Enhanced overall system using multiple data providers and applied different functionality creating summarized reports for Sales, Production, Commission to analyze the different metric performances and effects on overall profit, loss or expenditure.
- Deployed new MDM Hub for portals in conjunction with user interface on IDD application.
- Implemented changes for improvement by creating reports for the representatives of the company and interacted with the representative trainers for the feedback on the reports created. Also, created reports for analyzing individual performances of the agencies through trends and scatter plots to identify the outliers.
- Involved in data migration to snowflake using AWS S3 buckets.
- Extensively worked on ETL performance tuning for tune the data load, worked with DBAs for SQL query tuning etc.
- Extensive experience in using Tableau functionalities for creating different Reports, Interactive Dashboards with page and dashboard Prompts.
- Proficient in design and development of various dashboards, reports utilizing Tableau Visualizations such as bar graphs, scatter plots, Heat maps, pie-charts, maps, funnel charts, lollypop charts, Dual axis, water fall charts, donuts, bubbles, etc. making use of actions and other local and global filters according to the end user requirement.
- Have worked with cloud-based data sources like Azure, DB2.
- Extensive knowledge in various reporting objects such as Dimensions, Measures, Hierarchies, Filters, Actions, Calculated Fields, Sets, Groups, and Parameters etc...
- Experience in Trouble Shooting, Performance tuning of reports and resolving issues within Tableau Server and Reports.
- Load the business terms of the organizations data dictionary into EDC and assign them to the data assets and create lineages for the data flow.
- Create different scanners Hive/Oracle/PowerCenter/Platform to load the data assets into a single place repository - EDC.
- Strong experience in creating Logical tables, columns, Dimensional Hierarchies, Level Based Measures, Time series data.
- Experienced in client requirement Analysis, Physical, Logical design, development (using Erwin, normalization and SQL Server Enterprise manager), Resource Planning, Coding, Debugging, Testing, Deployment, Support and Maintenance of business applications using MSBI.
- Created Dashboard's using multiple BI Tools with Drill-Down capabilities using Dashboard prompts, Local and Global Filters.
- Work experience in Informatica EDC 10.2, Axon 5.4/6.0 & Azure cloud infrastructure & IICS.
- Proficient in SQL programming - Stored Procedures, Functions, Packages, SQL tuning, and creation of Objects - Tables, Views, Materialized Views, Sequences, Synonyms, etc.
Environment: Informatica Power Center 10.1, Oracle Database 11g, SQL server, MySQL, MS office, Excel, PowerPoint, DIH, AXON, EDC, IDQ, BDM 10.2 Hadoop - Hortonworks Data platform 2.5, BI Tools: Tableau 9.1/10.3, MS Excel (VBA/Macros), Teradata 13, Teradata Manager Excel Writer, Excel Aspose, Crystal Reports (v2008, v2011, v2013, v2016),
Confidential, Burlington, MA
ETL Developer / Tableau Developer
Responsibilities:
- Proficient in implementing all transformations available on the SSIS (SQL Server Integration Services). toolbox.
- Using Source Qualifier & Lookup SQL overrides, Persistent caches, Incremental Aggregation, Partitions, and Parameter Files etc. for better performance.
- Created sessions to use pre & post session's stored procedures to truncate the tables, drop & create indexes on tables for bulk loading.
- Working on change requests to the existing processes in production
- Used Event wait Task, Control Task, Email Tasks, Command Tasks, Link conditions in workflows.
- Bulk load the database tables from flat files using Oracle SQL Loader
- Working on creating & modifying the Unix shell scripts.
- Installation of Informatica power center/DIH/IDQ/BDM/AXON/EDC and setup services and client tools.
- Built tables and views in MySQL, Redshift, and Snowflake in order to efficiently house data used in various analyses.
- Development of scripts for loading the data into the base tables in EDW and to load the data from source to staging and staging area to target tables using FastLoad, MultiLoad and BTEQ utilities of Teradata.
- Writing scripts for data cleansing, data validation, data transformation for the data coming from different source systems.
- Experienced in creating and maintaining the entity objects, hierarchies, entity types, relationship objects and relationship types using Hierarchy tool to enable Hierarchy Manager (HM) in MDM HUB implementation and Informatica Data Director (IDD).
- Integrate with EDC & Data Quality for business glossary, score cards discovery.
- Setup the EDC resources for Oracle, SQL servers and Azure cloud DBs for metadata lineage.
- Participated in the development and implementation of the MDM decommissioning project using Informatica PowerCenter that reduced the cost and time of implementation and development.
- Worked on data cleansing using the cleanse functions in Informatica MDM.
- Tuning of Teradata SQL statements using Explain analyzing the data distribution among AMPs and index usage, collect statistics, definition of indexes, revision of correlated sub queries, usage of Hash functions, etc
- Written complex SQLs using joins, sub queries and correlated sub queries. Expertise in SQL Queries for cross verification of data.
- Developed the Teradata Macros, Stored Procedures to load data into Incremental/Staging tables and then move data from staging into Base tables
- Extensively worked on Performance tuning to increase the throughput of the data load (like read the data from flat file & write the data into target flat files to identify the bottlenecks).
- Worked on Error handling and performance tuning in Teradata queries and utilities.
- Writing SQL Scripts to extract the data from Database and for Testing Purposes.
- Interacting with the Source Team and Business to get the Validation of the data.
- Used Teradata utilities fastload, multiload, tpump to load data.
- Wrote, tested and implemented Teradata Fastload, Multiload and Bteq scripts, DML and DDL.
- Performed tuning and optimization of complex SQL queries using Teradata Explain.
- Expert level knowledge of complex SQL using Teradata functions, macros and stored procedures.
- Developed Fast Load jobs to load data from various data sources and legacy systems to Teradata Staging.
- Provide test data in QA/UAT for the downstream application testing
- Extensively worked on the Repository Manager to create/modify/delete users/group/roles
- Provided production support to schedule and execute production batch jobs and analyzed log files in Informatica 9.5/& 9.6.1 Integration servers
- Publishing Data using Message Queues to notify external applications on data change in MDM Hub Base Objects.
- Developed shell scripts to automate the data loading process and to cleanse the flat file inputs
Environment: Informatica Power Center 10.1, DIH, AXON, EDC, IDQ, BDM 10.2 Hadoop - Hortonworks Data platform 2.5, IDQ (Informatica Data Quality) 10.0, Informatica MDM 10.0, Oracle Database 11g, SQL server, Toad for Oracle, Unix Shell scripts, Teradata.
Confidential, Redwood Shores, CA
ETL Developer / Tableau Developer
Responsibilities:
- Translated business needs into data analysis, business intelligence data sources and reporting solutions for different types of information consumers.
- Developed complex T-SQL code such as Stored Procedures, functions, triggers, Indexes and views for the application.
- Created many complex Stored Procedures/Functions and used them in Reports directly to generate reports on the fly.
- Effectively used data blending feature in Tableau to connect different databases like Oracle, MS SQL Server, SQL and Excel.
- Good exposure in Informatica MDM where data Cleansing, De-duping and Address correction were performed.
- Involved in Informatica MDM hub configuration, IDQ cleanse function implementation, Hierarchy Configuration in MDM hub.
- Created SSIS package to load data from XML Files, SQL Server 2005 and to SQL Server 2012 by using Lookup, Fuzzy Lookup, Derived Columns, Condition Split, Term Extraction, Aggregate, Pivot Transformation, and Slowly Changing Dimension.
- Migrated Tableau Dashboard from version 9.3 to 10.3 and adding users to the AD group.
- Used Joins, correlated and non-correlated sub-queries for complex business queries involving multiple tables & calculations from different databases.
- Used Tableau Desktop to create various analysis worksheets, including customer analysis and equipment analysis.
- Used advanced features of T-SQL in order to design and tune T-SQL to interface the database and other applications in most efficient manner.
- Used SSIS to create ETL packages to Validate, Extract, Transform and Load data to Data Warehouse and Data Mart Databases.
- Redshift database as a data warehouse solution and back-end for Tableau which increased its performance by 15x compared to SQL Server.
- Pulled data from a data warehouse spanning multiple servers using MySQL, Snowflake, Redshift, Tableau, R, PHP, and Adobe Analytics.
- Created actions, parameters, Filter (Local, Global) and calculated sets for preparing dashboards and worksheets using Tableau.
- Developed Unit Test Plans for SSIS packages for checking the functionality of each component.
- Modified the existing SSIS packages to meet the changes specified by the users.
- Design and development of various reports and dashboards that can be easily accessible through Tableau
- Scheduled Jobs for executing the stored SSIS packages which were developed to update the database on Daily basis using SQL Server Agent.
Environment: MS SQL Server 2008R2, T-SQL, SQL SSIS, SSRS, server 2003 Visual Source Safe, SQL Profiler, Visual Studio 2008, MySQL, MS office, Excel, PowerPoint, Visual Intercept Enterprise Edition, Oracle 10g, VB.Net