We provide IT Staff Augmentation Services!

Sr. Etl Developer Resume

5.00/5 (Submit Your Rating)

SUMMARY

  • Overall 6+ years of IT experience on Data warehousing, Data modeling, Data integration, Data Migration, ETL process and Business Intelligence.
  • Expertise in working with packed tools like Informatica ETL and reporting tools. Deep understanding of the Data Warehousing SDLC and architecture of ETL, reporting and BI tools.
  • Experience in all aspects of analytics/data warehousing solutions like Database issues, Data modeling, Data mapping, ETL Development, metadata management, data migration and reporting solutions.
  • Worked in different sectors like Insurance, Finance and fashion/retail industries where played an important role in delivering innovative database /data warehousing solutions.
  • Strong understanding of Data Modeling (Relational, dimensional, Star and Snowflake Schema), Data analysis, implementations of Data warehousing using Windows and UNIX.
  • Experience in mapping of different data sources into data warehouses using Informatica while using the transformations like JSON messaging systems, Source Qualifier, lookups and Joiners
  • Extensive experience in developing stored procedures, functions, Views and Triggers, Complex queries using SQL Server, TSQL and Oracle PL/SQL
  • Experience in resolving on - going maintenance issues and bug fixes; monitoring Informatica sessions as well as performance tuning of mappings and sessions
  • Experience in Quality Assurance testing of data warehousing and Business Intelligence processes, Web Based and Client/Server applications.
  • Excellent analytical skills for understanding the business requirements, business rules/processes, and detailed design of the application.
  • Experience in SDLC modeling systems and bug tracking software systems.
  • Proficient in coding of optimized Teradata batch processing scripts for data transformation, aggregation and load using BTEQ.
  • Prepared low level technical design document and participated in build/review of the BTEQ Scripts, FastExports, Multiloads and Fast Load scripts, Reviewed Unit Test Plans and System Test cases.
  • Expertise in using Agile and JIRA systems.
  • Experience in complete BigData flow of the application starting from data ingestion from upstream to HDFS, processing the data in HDFS and analyzing the data.
  • Experience in the Analysis, Design and Development of Data warehousing solutions and in developing strategies for Extraction, Transformation and Loading (ETL) mechanism using Ab Initio.
  • Expertise and well versed with various Ab Initio Transform, Partition, Departition, Dataset and Database components.
  • Expertise and well versed with various Ab Initio Transform, Partition, Departition, Dataset Database components, sort, validate and compress
  • Experience in using database tools like Oracle 10g/9i/8i/8.0/7.0, DB2, Ms - SQL servers, MS - Access, TOAD, SAP HANA studios.
  • Experience in database development using oracle databases. Expertise in working with Data cleansing, Data Profiling and Data analysis.
  • Experience in managing and reviewing Hadoop log files.
  • Experience in writing UNIX shell Scripting, SQL and PL/SQL coding and writing Sqoop scripts as well.
  • Expert in Database development including effective use of database objects, SQL trace, different types of optimizers, indexes, table partitions, sub partitions, materialized views, capabilities of using oracle built-in functions and performance tuning of Informatica mapping and workflow.
  • Experience in working with Data Warehousing using Informatica Power Center 8.6/8.4, excellent skills in implementing ETL packages using DTS and SSIS 20008/2005.
  • Designed and implemented robust data models (relational and dimensional) that are easy to access and maintainable.
  • Written reusable solutions/code that are well-managed in source-control.
  • Served as an administrator for data warehouse, reporting, and BI solutions.
  • Contributed to database backup/restore strategies, security, and change-management/deployment practices.
  • Create and maintain documentation of data-warehouse/BI architecture, including ERDs, process flows, data flow diagrams, etc.

TECHNICAL SKILLS

ETL Tools: Informatica PowerCenter 8.6.1/8.1/7.1/7.0/6.2/5.1 ,Visual Studio 2010, Business Intelligence Studio 2008, SQL Server Integration Services (SSIS) 2005/2008, SQL Server Reporting Services (SSRS) 2008, Power Mart 6.2/5.1/4.7 (Workflow Manager, Workflow Monitor, Warehouse Designer, Source Analyzer, Transformation developer, Mapplet Designer, Mapping Designer, Repository manager) Data Mining, Data mart, OLAP, OLTP, Autosys, IMS Rx Data.

Data Cleansing: Trillium 7.6/6.x (Converter, Parser, Matcher & Geocoder

QA tools: Agile, JIRA, GitHub, HP ALM 11.5/HP Quality Center 10, Test Director 7.5, IBM Clear Quest

Data Modeling: Erwin 4.5/7.3, Logical Modeling, Physical Modeling, Relational Modeling, ER Diagrams, Dimensional Data Modeling (Star Schema Modeling, Snowflake Schema Modeling, FACT and Dimensions Tables), Entities, Attributes, Cardinality, MS Visio

RDBMS: Oracle 8i/9i/10g/11g, Teradata, MS SQL Server 2000/2005/2008 , Sybase 12.x/11.x SQL Navigator, Teradata, SQL*Loader, MS Access 2000, Squirrel client services.

Others languages: SQL, PL/SQL, Unix Shell Scripting, ANSI SQL, JAVA, Transact SQL, SQL*Plus, HTML 4.0, ODBC, SSIS, Quest TOAD.

Environment: s: UNIX (Sun Solaris 2.6/2.7, HP-UX, IBM AIX 4.2/4.3), Windows 2003/2000/XP/98.

Other Tools: Putty, WinSCP, FileZilla, MS-Office.

PROFESSIONAL EXPERIENCE

Confidential

Sr. ETL Developer

Responsibilities:

  • Working with Business Users and Business Analyst and gathering requirements and business analysis.
  • Converted business requirement into high level and low level design.
  • Created, Designed and customized data models for data warehouse for supporting data from multiple sources in real time.
  • Responsible for cleansing the data from source systems using Ab Initio components such as Join, Dedup Sorted, Deformalize, Normalize, Reformat, Filter-by-Expression, Rollup.
  • Developed complicated graphs using various Ab Initio components such as Join, Rollup, Lookup, Partition by Key, Round Robin, Gather, Merge, Dedup sorted, Scan and Validate
  • Extensively involved in Ab Initio Graph Design, development and Performance tuning.
  • Performed bulk data load from multiple data source (ORACLE 8i, legacy systems) to Teradata RDBMS using BTEQ, Multiload and Fast Load.
  • Extracted data from different source systems like Flat Files, .CSV file, MS Excel, MS access, SAP HANA studio and transformed that data based on the user requirements using Informatica Power Center and Loaded data into Target systems using a scheduling the sessions.
  • Worked with different Informatica Power Center 8.6 tool like Source Analyzer, Data Warehousing designer, Mapping and Mapplet Designer and Transformation Designer.
  • Designed and develop/configure Informatica ETL Workflows and Mappings as per the requirements gathered.
  • Created and developed HLL design documents and the ETL mapping documents for source level, staging level as well as target level.
  • Supported QA UAT testing for delivered functionalities and helped QA team in strategizing in test plans for testing the data models.
  • Integration of data systems and define what data flows across the repository.
  • Pre-Migration testing and validation of all data elements been converted.
  • Worked on optimizing and tuning the Teradata views and SQL’s to improve the performance of batch and response time of data for users.
  • Used Teradata Data Mover to copy data and objects such as tables and statistics from one system to another.
  • Created reusable Mapplet and transformation strategies for the future use. Also worked on backing up, recovery and tuning sessions for the Informatica tools.
  • Developed PL/SQL Procedures and packages to kickoff the SQL loader control files and procedures to load the data into oracle.
  • Worked on developing SSIS packages to extract data from Excel Files and MS Access files using Pivot transformations and Fuzzy Lookup.
  • Executed SQL Task, Data Flow Task, Execute Package Task etc to generate underlying data for the reports and to export cleaned data from Excel Spreadsheets, Text file, MS Access and CSV files to data warehouse
  • Written SQL Scripts and PL/SQL Scripts to extract data from Database and for Testing Purposes.
  • Designed and developed Python scripts to test the loaded data for any data mishaps.
  • Extracted Data from SAP HANA as flat file with regards from the business and financial team requirements and transformed data using Informatica Power center 8.6 and then loaded data into the target systems like HIVE, JSON Data Lakes.
  • Supporting daily loads and work with business users to handle rejected data.
  • Developed Interfaces using UNIX Shell Scripts to automate the bulk load & update Processes.
  • Executing test scripts to verify actual results against expected results by using Power Connect for source (DB2) validation and Oracle for target validations.
  • Created JIRA tickets and acted upon JIRA tickets assigned in respective to the problems and assigned it back to the appropriate team players.
  • Stored reformatted data from relational, flat file, XML files using Informatica.
  • Implemented data cleansing for files using Informatica and trillium.
  • Done automation of file provisioning process using UNIX, Informatica mappings and Oracle utilities.

Environment: SQL, PL/SQL TOAD, BTEQ, TeraData, Oracle 11g, Agile/Scrum, MS Office, HIVE, Hadoop, SAP HANA Studio, UNIX, Scripting, Informatica, GitHub, JIRA, Python scripts, Sqoop and DB2.

Confidential

Informatica/ETL Developer

Responsibilities:

  • Experience in migrating data from the Database by generating the SQL from the Pivot table
  • Performed dynamic pivoting by using dynamic SQL by dynamically building the pivoting query
  • Worked on creating a custom SQL query on the DB to test the query, and then put the query inside an Excel pivot table in order to display the data.
  • Created Complex ETL Packages using SSIS to extract data from staging tables to partitioned tables with incremental load.
  • Setup and benchmarked Hadoop/HBase clusters for internal use.
  • This plugin allows HadoopMapReduce programs HBase Pig and Hive to work unmodified and access files directly.
  • Metadata mapping from legacy source system to target database fields and involved in creating Ab Initio DMLs and written complex XFRs for implementing the business logic transformation.
  • Replicate operational table into staging tables, transform and load data into warehouse tables using Ab Initio GDE.
  • Expert level knowledge of complex SQL using Teradata functions, macros and stored procedures.
  • Created SSIS Reusable Packages to extract data from Multi formatted Flat files, Excel, XML files into UL Database and DB2 Billing Systems.
  • Developed, deployed, and monitored SSIS Packages.
  • Created SSRS reports using Report Parameters, Drop-Down Parameters, Multi-Valued Parameters Debugging Parameter Issues Matrix Reports and Charts.
  • Exposure in Propose architectures considering cost/spend in Azure and develop recommendations to right-size data infrastructure.
  • Created reports with Analysis Services Cube as the data source using SSRS.
  • Developed SQL scripts to manipulate data for data loads and extracts.
  • Created complex SQL queries to check the Views built on the source tables and to compare data between source and target
  • Worked with SQL Queries using joins to facilitate the use of huge tables for processing several records in the database.
  • Designed and developed Informatica’s Mappings and Sessions based on business user requirements and business rules to load data from source flat files and oracle tables to target tables.
  • Worked on various kinds of transformations like Expression, Aggregator, Stored Procedure, Lookup, Filter, Joiner, Rank, Router and Update Strategy.
  • Developed reusable Mapplets and Transformations.
  • Used debugger to debug mappings to gain troubleshooting information about data and error conditions.
  • Involved in monitoring the workflows and in optimizing the load times.
  • Used Change Data Capture (CDC) to simplify ETL in data warehouse applications.
  • Involved in writing procedures, functions in PL/SQL.
  • Developed mappings in Informatica using BAPI and ABAP function calls in SAP.
  • Prepared UNIX Shell Scripts and these shell scripts will be scheduled in AUTOSYS for automatic execution at the specific timings.
  • Having good experience in Cognos, BO Administration.

Environment: Agile, Informatica, Oracle 11g, Unix Shell Scripting, OBIEE, SQL, PL/SQL, Toad for Oracle, Jira, Unix, Windows XP platform, MS Office, Soap UI, Data Profiling, Excel, Sqoop.

Confidential

ETL Developer

Responsibilities:

  • Developed and conducted a wide range of tests and analysis to ensure that software, systems, and services meet minimum company standards and defined end-user and system requirements.
  • Responsible for Business meeting, conversion of business rules into technical specifications.
  • Involved in Requirement gathering, business Analysis, Design and Development, testing and implementation of business rules.
  • Developed and supported the extraction, transformation and load process (ETL) for a Data Warehouse from their OLTP systems using Ab Initio and provide technical support and hands-on mentoring in the use of Ab Initio.
  • Installed and configured Hive and also written Hive UDFs.
  • Importing and exporting data into HDFS and Hive using Sqoop.
  • Worked on improving the performance of Ab Initio graphs by using various Ab Initio performance technique’s like using looks instead of Join’s etc.
  • Used components like run program and run sql components to run UNIX and SQL commands in AB Initio. Also used the components like filter by expression, partition by expression, replicate, partition by key and sort Components.
  • Used Informatica PowerCenter 9.1 for extraction, loading and transformation (ETL) of data in the data warehouse.
  • Extensively worked with various Passive transformations in Informatica PowerCenter like Expression Transformation, Sequence Generator, and Lookup Transformation.
  • Worked on technical strategy, provided hardware and software configuration, understood client-wide BI implementation project, designing and developing visualizations.
  • Worked with Business and Financial teams to understand the marketing needs and identify the source data for mapping the requirement.
  • Extensively used Informatica Client tools - Power Center Designer, Workflow Manager, Workflow Monitor and Repository Manager.
  • Extracted data from various heterogeneous sources like Oracle, SQL Server, Flat Files.
  • Responsible for developing for the ETL (Extract, Transform and Load) processes using Informatica Power Center.
  • Worked closely with DBA’s to develop dimensional model using Erwin and created the physical model using Forward Engineering.
  • Performed Design, Build and Unit Test parallel jobs to extract files from Oracle Enterprise stage and Flat files.
  • Working on Big data framework to move the data from the traditional RDBMS (Oracle) to HDFS.
  • Responsible for developing, support and maintenance for the ETL (Extract, Transform and Load) processes using Oracle and Informatica PowerCenter.
  • Created common reusable objects for the ETL team and overlook coding standards.
  • Reviewed high-level design specification, ETL coding and mapping standards.
  • Designed new database tables to meet business information needs. Designed Mapping document, which is a guideline to ETL Coding.
  • Used ETL to extract files for the external vendors and coordinated that effort.
  • Migrated mappings from Development to Testing and from Testing to Production.
  • Performed Unit Testing and tuned for better performance.
  • Created various Documents such as Source-to-Target Data mapping Document, and Unit Test Cases Document.
  • Experienced Informatica Power Exchange to extract the data from the Legacy Mainframe Source system to the Staging database.
  • Created PL/SQL stored procedures and called them from Informatica power center.
  • Developed and used the SQL Queries to validate the data in both source and target databases.
  • Involved in requirement gathering and performed ETL Process.
  • Created Dimension Tables and Fact Tables based on the warehouse design.
  • Wrote Triggers and Stored Procedures using PL/SQL for Incremental updates
  • Used Agile systems for story tracking and JIRA systems for defect tracking.

Environment: Agile, Informatica, Big Data/Hadoop, SQL, PL/SQL, Toad, Unix, shell script, Business Objects XI 3 Reports, DOORS, Oracle SQL Developer, HP/ALM Quality Center, QTP,UNIX, JIRA, Agile.

Confidential

Jr. Database Developer

Responsibilities:

  • Involved in complete Software Development Lifecycle (SDLC).
  • Created T-SQL queries, procedures, views, indexes and worked on SQL query Optimization and tuning.
  • Created and designed complex SQL queries to create stored procedures, Triggers, Views and Indexes as per the User Defined functions in implementing the business logic.
  • Involved in planning of SSIS packages to Extract, Transform and Load (ETL) data into data warehouse databases from the heterogenous databases/data sources.
  • To implement the business logics and requirements created and modified SQL Joins, Sub-queries, other T-SQL queries.
  • Developed technical system documentations.
  • Review, discuss and work within agreed timescales and feedback to project managers any variances arising as tasks are performed.
  • Work with development and IT teams to troubleshoot data or performance problems.
  • Tracked any bugs and other errors occurred using JIRA tracking software.

Environment: Agile, SQL, PL/SQL, Business Objects XI 3 Reports, T-SQL, Ms - Office Oracle SQL Developer, JIRA, ETL and MS - SQL Server Integration Services.

We'd love your feedback!