Sr. Etl/sql Developer Resume
Austin, TX
SUMMARY:
- 8 years of Experience as a Software Engineer Informatica Developer in developing large - scale Data Warehouse and Client/Server Applications, including Data Profiling, Data Migration, Data Modeling, Business Process, Design and Development, Integration and Testing, Database Programming, SDLC, Project Management and Production Support.
- Expert in all the data migration activities like Table/Column mapping between Legacy and Target system, data cleansing on legacy data, developing and maintaining ETL (Extraction, Transformation and Loading) mappings using Confidential Data Stage 9.1 to extract the data from multiple source systems that comprise databases, flat files to the staging area and then transformation and loading in Target system using ETL jobs
- Involved in creating Dashboards, reports as needed using Tableau Desktop and Tableau Server
- As a ETL developer have strong experience in data analysis, design, development and implementation of data warehousing and data integration applications using Teradata , SQL Server Integration Services , Informatica PowerCenter , SQL Server and Oracle
- Hands on experience in developing and delivering data warehousing and Business Intelligence solutions using Teradata, Oracle, SQL Server , Informatica PowerCenter , SSIS and SSRS
- Experience in analysis, design, development, testing and implementation of data warehousing and Business Intelligence solutions.
- Developed and executed Data Stage jobs including Job execution status, monitoring a job, job log view, job scheduling, creating batches and scheduling batches. Responsible to create Source to Target (STT) mappings to data flow diagrams to design and develop ETL jobs.
- Expertise in transforming complex business requirements into ETL solutions using Teradata utilities, Informatica PowerCenter, SSIS and SQL solutions (Stored Procedures, User Defined Functions, Views and Triggers)
- Expertise in tuning ETL jobs and SQL scripts and using best practices for optimal performance while developing ETL interfaces using Teradata utilities, Informatica Mappings and Sessions and SSIS packages
- Experience in Software development life cycle (SDLC) with a strong background in Design/Modeling, database development and implementation of various business intelligence and data warehouse / DataMart’s projects that cover gathering Business Requirements, Development, Implementations and Documentation.
- Strong experience in ETL methodologies for supporting Data Migration, Data Exchange, Data Transformation using Informatica Power Center v 9.x/8.x Suite.
- Work experience with Business Users to analyze the business process model and made necessary changes to schema objects to cater users reporting needs.
- Experienced with Teradata utilities Fast Load, Multi Load, BTEQ scripting , Fast Export, SQL Assistant .
- Experience in doing Tuning of Teradata Queries using Explain plan. Extensively worked with Sql and Pl/Sql .
- Experience in doing performance Tuning of Data Base queries. Experience in UNIX environment, file transfers and job scheduling.
- Experience preparing unit test cases and performed unit testing, documented and logging unit test results. Experience in understanding and analyzing defects/observations and fixing bugs
- Strong analytical, problem-solving, organizational, communication, learning and team skills.
- Design Source to Target maps, Code Migration , Version control, scheduling tools, Auditing, shared folders, data movement, naming in accordance with ETL Best Practices, Standards and Procedures.
- Experience in ETL techniques and Analysis and Reporting including hands on experience with the Reporting tools such as Cognos.
- Parsing high-level design specification to simple ETL coding along with mapping standards
- Proficient in understanding business processes / requirements and translating them into technical requirements. Excellent communication skills, technically proficient and result-oriented with problem solving skills.
TECHNICAL SKILLS:
Database: SQL Server 2008/2005/2000, Oracle 11g,10g/9/8i, Microsoft Access, DB2
Performance: Tuning, Capacity Planning, Installation, Migration, SSIS
Reporting Tools: SQL Server Reporting Services SSRS, Tableau, Crystal reports
DBMS Tools: SQL Server Management Studio
ETL Tools: SSIS, Informatica 9.1/8.6.1/8.5/8.1/7.1 PowerCenter Client tools
Languages: T-SQL, SQL, C, C#, XML/XSL, HTML, CSS
Development Tools: Visual Studio, Management studio, Erwin, SSRS, SSASVirtualization VM Ware, Citrix
Operating Systems: Windows 2008/2003/2000/ NT, Windows XP, Windows Vista, Windows 7, MS-DOS, UNIX, Linux
PROFESSIONAL EXPERIENCE:
Confidential, Austin, TX
Sr. ETL/SQL Developer
Responsibilities:
- Experience in Extraction, Transformation and Loading (ETL) data from various sources into Data Warehouses and Data Marts using Informatica Power Center Repository Manager, Designer, Workflow Manager, Workflow Monitor, Metadata Manger on flat file s, Oracle and SQL Server
- Databases. Implemented complex business rules by creating transformation, re-usable transformations (Expression, Aggregator, Filter, Connected and Unconnected Lookup, Router, Rank, Joiner, Update Strategy), and developing complex Mapplets and Mappings, and SQL Stored Procedure, and Triggers with Informatica power center.
- Testing and redesigning the existing Informatica mapping/workflows as a part of upgrade.
- Created and executed mapping using Slowly Changing Dimensions Type1, Type 2, Type 3 and Simple Pass Through.
- Worked with heterogeneous sources from various channels like Oracle, flat files and XML.
- Scheduling the Informatica and other related processes using control M. Analyzed and framed the business logic for the ETL process as per the requirements.
- Used Debugger to test the mappings and fixed the bugs. Deployment and Scheduling off ETL packages. Created the sessions and Batches.
- Created Informatica mappings with PL/SQL procedures/functions to build business rules to load data. Worked with Oracle DDL and DML Scripts and established relationships between tables using Constraints.
- Maintained SQL scripts and complex queries for analysis and extraction. Coding and testing of various database objects such as views, functions and stored procedures using SQL and PL/SQL.
- Identifying and resolving the bottlenecks in source, target, transformations, mappings and sessions to improve performance. Worked with various database objects like external tables, synonyms, complex views, sequence generator. Worked with java transformation.
- Worked with database connections, SQL joins, cardinalities, loops, aliases, views, aggregate conditions, created Indexes, parsing of objects and hierarchical queries.
- Involved in the creation of database Tables, Materialized views and Indexes and PL/SQL stored procedures, functions, triggers and packages. Extensively used T-SQL and PL/SQL for development of Procedures, Functions, Packages and Triggers.
- Design and develop SSIS packages, store procedures, configuration files, tables, views, and functions; implement best practices to maintain optimal performance.
- Created work flows with Data flow, control flow Task, Script Task, Execute Sql Task and Containers. Worked with transformations Conditional Split, Aggregate, Multicast, Sort , and Merge join, Data Conversion and Union all.
- Maintained log information in file to tracking Errors and recording package execution status. Utilized SSRS reporting services to generate different types of reports from the database.
- Created reports out of the views and developed OLAP cubes. Optimized queries using SQL Profiler and performance monitors to enhance the performance of database servers
Environment: MS SQL Server 2008/2008R2, SSIS, SSRS, Windows 2008 Server, T-SQL MS Excel, Visual Studio 2008s, Microsoft Visio
Confidential, Bowie, MD
ETL Developer
Responsibilities:
- Good experience in Teradata RDBMS using Fastload, Multiload, TPump, FastExport, Multiload, Teradata SQL Assistant and BTEQ utilities.
- Extensively used ETL processes to load data from various source systems such as Oracle, Teradata and Flat Files, XML files into target system Oracle by applying business logic on
- Experience in monitoring and managing varying workload of data warehousing tools like Teradata Workload Analyzer, Teradata Dynamic Workload Manager.
- Expertise in performance tuning and query optimization of the Teradata SQLs
- Write Teradata SQL, BTEQ, MLoad, FastLoad, and FastExport for Ad-hoc queries, and build Unix shell script to perform ETL interfaces BTEQ, Fast Load.
- Used Informatica tool for extracting data from landing to stage and Teradata utilities for loading data from stage to target tables. Design interactive dashboards in Tableau Desktop and published them to Tableau Server.
- Involved in defect fixing, test case creation and execution for data migration and Mainframe project. Strong Experience of requirement gathering for data migration activities.
- Write new SQL, PL/SQL code to support new enhancements to module(s).
- Designed and developed PLSQL Functions, Procedures, Cursors, Triggers and Packages. Automated data quality checks by creating PLSQL procedures, Cursors, Functions and dynamic SQL and enhanced with creating exceptions for error handling
- Optimize/tune sql and plsql queries/code to improve performance of reports and application. Design the logic to replicate table data through plsql to different schema using jobs and triggers
- Used different types of Stages such as Sequential File, Unstructured Data stage, Sort, Join, Aggregator, Transformer and others to develop processes for cleansing, transforming, extracting, integrating and loading data.
- Databases and DataStage: DB2, Oracle, SQL server, Confidential Infosphere Datastage, Unix Shell scripting. Strong design experience to independently turn Physical Data Model into DataStage job design..
- Experience in Designing, Compiling, Testing, and Scheduling and Running DataStage jobs
- Assist developers, DBAs in designing, architecture, development and tuning queries of the project. This included modification of queries, Index selection, and refresh statistic collection.
- Worked with DBAs to tune the performance of the applications and Backups. Experienced working as on-call/production support DBA. Teradata Production DBA support.
- Performing peer review & sign-off from the DBA side for any changes getting implemented on the warehouse. Worked on loading of data from several flat files sources using Teradata MLOAD & FLOAD in Teradata
Confidential, West Des Moines, Iowa
ETL Developer
Responsibilities:
- Prepared design specification documents as per the inputs received from the Architect and the Business Analyst.
- Extracted data from Heterogeneous source systems like Oracle, SQL Server and Flat files with fixed width and delimited
- Involved in requirement gathering, design, testing, project coordination and migration. Prepared Project estimation for ETL activity and scoping
- Involved in Cleansing and Extraction of data and defined quality process for the warehouse.
- Developed Informatica ETL mappings, sessions and workflows based on the technical specification document.
- Created Mappings using transformations like Source Qualifier, Joiner, Aggregator, Expression, Filter, Router, Lookup, Update Strategy, and Sequence Generator.
- Designed and developed the logic for handling Slowly Changing Dimension tables load by flagging the record using update strategy for populating the desired.
- Developed reusable mapplets and transformations for reusable business calculations. Used exception handling logic in all mappings to handle the null values or rejected rows.
- Applied slowly changing Dimensions Type I and Type II on business requirements. Extensively worked on performance tuning and also in isolating header and footer in single file.
- Working with large amounts of data independently executing data analysis, utilizing appropriate tools and techniques (Interpreting results and presenting them to both internal and external client.
- Writing SQL queries to create end-user reports /Developing SQL Queries and stored procedures in support of ongoing work and application support.
- Created requirement specifications documents, user interface guides, and functional specification documents, ETL technical specifications document and test case.
- Used most of the transformations such as the Aggregators, Filters, Routers, Sequence Generator Update Strategy, Rank, Expression, lookups (connected and unconnected), Mapping Parameters, Session parameters, Mapping Variables and Session Variables.
- Responsible for studying the existing data warehouse and also working on migrating existing PL/SQL packages, stored procedures, triggers and functions to Informatica Power Center . Fine-tuned ETL processes by considering mapping and session performance issues.
- Responsible for Creating workflows and Worklets . Created Session, Event, Command, Control, Decision and Email tasks in Workflow Manager. Maintained the proper communication between other teams and client.
- Effectively understood session error logs and used debugger to test mapping and fixed bugs in DEV in following change procedures and validation.
- Raised change requests, analyzed and coordinated resolution of program flaws and fixed them in DEV and Pre-Production environments, during the subsequent runs and PROD.
- Perform analysis profiling on existing data and identify root causes for data inaccuracies, Impact Analysis and recommendation of Data Quality .
- Precisely documented mappings to ETL Technical Specification document for all stages for future reference. Scheduled jobs for running daily, weekly and monthly loads through Control-M for each workflow in a sequence with command and event tasks.
Environment: Informatica Power Center 10.1, SQL, PL/SQL, UNIX, Shell Scripting, SQL Server 2008, Sybase, Oracle 11g, DB2, Control-M, Cognos8.4.
Confidential, Chicago, IL
ETL Developer
Responsibilities:
- Analyzed business documents and created system requirement specification.
- Installed and configured PowerCenter 9.6.1 on windows platform.
- Extensively used Informatica PowerCenter for ETL (Extraction, Transformation and Loading), data from relational tables and flat files.
- Extensively worked on complex mappings, mapplets and workflow to meet the business needs and ensured they are reusable transformation to avoid duplications
- Designed and developed Star schema, Snowflake schema and created fact tables and dimension tables for the warehouse and data marts using Erwin.
- Identifying and tracking slowly changing dimensions and created complex mappings by using the SCD.
- Extensively used Informatica Client tools - Source Analyzer , Warehouse Designer, Mapping Designer , Mapplet Designer , Transformation Developer Informatica Repository Manage r and Informatica Workflow Manager.
- Used Informatica PowerCenter Workflow manager to create sessions, workflows and batches to run with the logic embedded in the mappings.
- Created procedures to truncate data in the target before the session run. Prepared SQL Queries to validate the data in both source and target databases. Extensively used Informatica Debugger to figure out the problems in mapping. Also, involved in troubleshooting existing ETL bugs.
- Extensively worked on Mapping Variables, Mapping Parameters and Session Parameters.
- Created the ETL exception reports and validation reports after the data is loaded into the warehouse database. Implemented Join, Expressions, Aggregator, Rank, Lookup, Update Strategy, Filter and Router transformations in mappings.
- Used Repository manager to create folders, which is used to organize and store all metadata in the repository. Responsible for developing, support and maintenance for the ETL processes using Informatica PowerCenter.
- Responsible for providing comments for user stories within an AGILE software development SCRUM environment. Created sessions and batches and tuned performance of Informatica sessions for large data files by increasing the block size, data cache size and target based commit interval.
- Created configured and scheduled the sessions and Batches for different mappings using workflow manager and using UNIX scripts. Informatica tool IDQ of latest versions 9.1.0 and 9.5.1.
- Involved in migration of the mappings from IDQ to PowerCenter. Applied the rules and profiled the source and target table's data using IDQ . Developed the mappings, applied rules and transformation logics as per the source and target system requirements.
- Extensively used PL / SQL programming in backend and front-end functions, procedures to implement business rules
- Involved in Unit testing, System testing to check whether the data loads into target are accurate, which was extracted from different source systems as per the user requirements
Environment: Informatica PowerCenter 9.5.1, Informatica Data Quality, oracle 11, Toad, Shell Scripts,
Confidential
ETL/SQL Developer
Responsibilities :
- Initial analysis of Raw Data received from business Users. Data use to differs from County to county and State to state.
- Worked on SQL * Loader to load the data from flat files obtained from various vendors. Wrote SQL and PL/SQL programs to retrieve required information from the database.
- Created Indexes on the table for faster retrieval of the data to improve database performance.
- Created database objects like tables, views, materialized views, procedures and packages using oracle tools like TOAD, SQ L Developer and SQL* Plus.
- Involved in ETL in order to meet the requirements for extraction, transformation, cleansing, and loading from source to target.
- Involved in ETL process from development to testing and production environments.
- Extracted data from various sources and loaded it into target database using Informatica Power Center 7.1.
- Tuned mapping and SQL queries for better performance and efficiency. Performed unit testing and validated the Data.
- Provided Weekly status report to manager on the process and timeliness. Performed performance tuning of the process at the mapping level, session level, source level and the target level.
Environment : Informatica 7.1/8.6, Oracle, SQL, PLSQL, Unix, SQL Developer, SQL*Loader.