We provide IT Staff Augmentation Services!

Sr. Etl/ibm Datastagedeveloper Resume

4.00/5 (Submit Your Rating)

Chicago, IL

SUMMARY:

  • Having overall 8+ years of IT experience with special emphasis on system analysis, design, development and implementation of ETL methodologies in all phases of Data warehousing life cycle and Relational databases using IBM InfoSphereDataStage 11.5/11.3/9.1/8.5/8.1.
  • Extensive experience as an ETL developer and working with IBM InfoSphereInformation Server.DataStage (Versions 11.5,11.3, 9.1,8.5, 8.1, 8.0.1) and AscentialDataStage 7.5.2 Enterprise Edition (Parallel Extender) and Server Edition.
  • Hands - on experience on foundation tools like Fast Track, Metadata Work Bench, DataStage and Quality Stage, Information Analyzer etc.
  • Strong knowledge of data warehouse architecture and designing star schema, snowflake schema, FACT and Dimensional Tables, Physical and Logical Data modeling using Erwin.
  • Extensively used Informatica Transformation like Router, Filter, Lookup, Joiner, Aggregator, Sorter, Rank, Stored Procedure Transformation, Java Transformation, Mapplets etc. and all transformation properties.
  • Created ETL guidelines document which involves coding standards, Naming conventions for Development and troubleshooting of DataStage jobs.
  • Solid experience with Informatica PowerCenter Data Validation client for Unit testing ETL mappings and transformations.
  • Experience on IBM Info sphere (Data Stage, Quality Stage) / Information Analyzer.
  • Experience in integration of various data sources like Oracle, Teradata, DB2, Sybase, SQL server, MS Access and non-relational sources like Flat files and XML files into staging area.
  • Widely used different features of Teradata such as BTEQ, Fastload, Multiload, FastExport, TPT, Tpump, SQL Assistant, DDL and DML commands and very good understanding of Teradata UPI and NUPI, secondary indexes and join indexes.
  • Developed medium to complex level informatica mapping and tuning the mappings and workflows for optimum performance.
  • Extensively created and used various Teradata Set Tables, Multi-Set table, global tables, volatile tables, temp tables.
  • Extensively worked on Data Integration and Data Management.
  • Proficient in creating Indexed Views, complex Stored Procedures, effective functions, and appropriate Triggers to facilitate efficient data manipulation and data consistency.
  • Extensive experience ETL tool using IBM InfoSphereDataStage.
  • Expertise in analyzing and understanding data dependencies in database tables using the corresponding metadata stored in the DataStage repository.
  • Experience in migrating jobs from DataStage 7.5.x version to 8.x version.
  • Worked and extracted data from various database sources like Oracle, MS SQL, DB2, Teradata, Netezza, Sequential files and Flat files.
  • Excellent knowledge in creating Databases, Tables, Stored Procedures, DDL/DML Triggers, Views, User defined data types, Cursors and Indexes.
  • Involved in designing, developing, testing and rolling out of complex enterprise applications to completion in terms of Database as well as frontend, with different project development model like Waterfall, Agile, SCRUM, etc.
  • Performed troubleshooting of Data Stage jobs and addressing production issues like performance tuning and enhancement.
  • Experience in providing Logging, Error handling by using Event Handler, and Custom Logging for SSIS Packages.
  • Experience in Performance Tuning in SSIS packages by using Row Transformations, Block and Unblock Transformations.
  • Strong SQL experience in Teradata from developing the ETL with Complex tuned queries including analytical functions and BTEQ scripts.
  • Written data stage routines for File validations involving date check, detail check and row count check.
  • Extensively worked on Viewpoint for Teradata to look at performance Monitoring and performance tuning.
  • Strong experience in providing Quality Assurance by conducting Unit testing, System integration testing, Process scenario testing, User acceptance testing and Operation readiness testing.
  • Experience in writing Unix Shell Scripts wherever necessary while developing ETL jobs.
  • Involved in writing PL/SQL, Bteq, shell scripts for extracting required data from the source tables and loading them to the target files.
  • Good experience in designing, Implementation of Data warehousing and Business Intelligence solutions using ETL tool Informatica Power Center.
  • Gained experience in creating and updating data tables and table structures as an SQL developer.
  • Participated in discussions with the Project Managers, Team Lead and Team Members on technical and or business requirements.
  • Good working knowledge on Cloud computing with AWS tools and Hadoop Big Data Concepts.
  • Experience with industry standard methodologies like Agile and Scrum methodology within the Software Development Life Cycle (SDLC).

TECHNICAL SKILLS:

ETL Tools: IBMDatastage 11.5/11.3/9.1/ 8.7/8.5/8.0 , Qualitystage 8.7/8.0, Parallel Extender, Informatica Powercenter 9.6.1/9.6/9/8

Relational Databases: MS SQL Server 2014/2012/2008/2005/2000 , Oracle 11g/10g/9i, Teradata, DB2, MS Access, Netezza, Greenplum

NoSQL Databases: MongoDB, Cassandra

Dimensional Data Modeling: Data Modeling, Star Schema Modeling, Snow-Flake Modeling, FACT and Dimensions tables, physical and logical data modeling, Erwin and Oracle Designer

Teradata Utilities: BTEQ, FastLoad, MultiLoad, TPT, TPump, SQL Assistant, Teradata Manager, Teradata Viewpoint

BI Tools: SQL, SQL Server Integration Services (SSIS 2005/2008/2012 ), SQL Server Reporting Services (SSRS 2005/2008/2012 ) SQL Server Analytical Services (SSAS 2005/2008/2012 ), Data Transformation Services (DTS), Visual Studio, BIDS, Power BI, Tableau.

Programming Languages: C/C++, C#, Java, UNIX shell scripting, JavaScript, SQL, PL/SQL

Operating Systems: UNIX, LINUX, Windows 7/2003/XP/2000/NT/98/95

DB Utilities: Toad, SQL Plus, SQL Developer, SQL Assistant

Scheduling Tools: Autosys, Control-M, Tidal

Business Management Tools: MS Office, MS Excel, MS Visio

PROFESSIONAL EXPERIENCE:

Confidential, Chicago, IL

Sr. ETL/IBM DatastageDeveloper

Responsibilities:

  • Worked on IBM InfoSphereDataStage 11.5 to develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database
  • Designing ETL jobs incorporating complex transform methodologies using Data Stage tool resulting in development of efficient interfaces between source and target systems.
  • Implementing Industry ETL standards and best practices, performance tuning during designing the Datastage Jobs.
  • Using IBM InfoSphereDatastage software, extracting data from DB2, Oracle and Flat File and Load to target tables.
  • Extensively used Informatica Data Validation tool to build and test unit test cases.
  • Implemented data extraction, transformation and load processes in a parallel framework.
  • Used stages like Transformer, sequential, Aggregator, Data Set, File Set, CFF, Remove Duplicates, Sort, Join, Merge, Lookup, Funnel, Copy, Modify, Filter, Change Data Capture, Change Apply, Head, Tail, Sample, Surrogate Key, External Source, External Target, Compare, Teradata Connector
  • Developed/ Modified the JIL(Job Information Language) Jobs in Autosys for scheduling the batch process.
  • Worked with widely used stages like Flat File, Lookup, Join, Pivot, Transformer, Sort, Aggregator, Merge, Row Generator, and Column Generator, FTP and also trouble shooted the designed jobs and tested the jobs for all logical errors.
  • Used Catalyst to migrate pl/sql code between environments
  • Worked on several Technical Issues & Defects that are identified during the batch process or as per any missing business requirements.
  • Demonstrated expertise utilizing ETL tools: Talend Data Integration, SQL Server Integration Services (SSIS), Development slowly changing dimension (SCD) mapping using Type-I, Type-II, and Type-III methods.
  • Customizing the Data stage Parallel jobs as per current business enhancements.
  • Worked on UNIX scripts for running and validating the job.
  • Worked on DataStage V11.3 to develop ETL jobs that loads the data from staging to target tables in Teradata server as database.
  • Developed WSDLs, XSDs,used XSLT, XPath and XQuery for Transformation in data power.
  • Performed data manipulations using various Informatica Transformations like Aggregate, Filter, Update Strategy, and Sequence Generator etc.
  • Used Quality Stage for various data cleansing stages to get complete visibility of the actual condition of data, to reformat data from multiple systems to ensure that the data has the correct specified content and format, and to ensure that the best available data survives and is correctly prepared for the target
  • Involve in Data validating, Data integrity, performances related to DB, Field size validation, check Constraints and Data Manipulation and updates by using SQL.
  • Involved in Performance and Tuning the Parallel Extender jobs to the maximum extent and achieved the best performance by reducing the Loading Time
  • Used different Parallel Extender Partitioning techniques in the stages to facilitate the best parallelism in the Parallel Extender jobs.
  • Developing and implementing user stories end-to-end in all the technologies such as Informatica, Oracle, WebSphere Transformation Extender (WTX) andUNIX .
  • Developed multiple MapReduce jobs in Java for data cleaning.
  • Developed ETL mappings and populated EDW tables from ODS, as required by business.
  • Designed, developed and implemented a C# CSOM Visual Studio 2017 migration tool to automate projects creation and migrated projects and data from Plan View and Excel to Azure SQL and Project Online.
  • Developed, tested and implemented Datastage Jobs, JIL Jobs, Ksh scripts for several projects in an Operational Data Store.
  • Migrated the DS server jobs to Parallel jobs by using the IBM InfoSphere Connector Migration tool.
  • Extensively worked with Job sequences using Job Activity, Email Notification, Sequencer, Wait for File activities to control and execute the Data stage Parallel jobs.
  • Done WTX (Web Transformation Extender) Migration.
  • Involved in performance tuning of the Data Stage jobs and queries
  • Experience in BI Development and Deployment of DTS, SSIS packages from MS-Access, Excel, DB2 and Oracle.
  • Involved in unit testing and validating the jobs before & after deployment of the codes.
  • Used director to run various different loads into the warehouse and also involved in working with various issues occurred in this process

Environment: IBM InfoSphere DataStage11.5 (Designer, Administrator, Director),Quality Stage, Teradata Server, Teradata SQL Assistant, WTX, Windows 7,SSIS/SSRS, IBM Rational Quest,Java,C#,Autosys, Agile/Scrum,Unix Shell Scripting.

Confidential - Tampa, FL

ETL Infosphere Datastage Developer

Responsibilities:

  • Involved in gathering Business Requirements from Business users. Analyzed all jobs in the project and prepared ADS document for the impacted jobs.
  • Made the required changes in the job according to the Business requirements.
  • Well experienced in developing EDI solution using WTX/Mercator as EAI tool to process the data.
  • Transformations from JSON files to XML and XML to JSON using WTX design studio and created custom message model.
  • Involved in peer code reviews and testing of ETL flows. Performed Unit testing and Data validation testing using Informatica Data Validation tool.
  • Used SQL and PL/SQL explain plan in Query man, SQL Developer to fine tune the SQL codes which were used to extract the data in database stages
  • Created several WebSphere Transformation Extender Maps and Type Trees for various computations and Data to connect to DB2, and Web Services.
  • Designed, developed and tested the DataStage jobs using Designer and Director based on business requirements and business rules to load data from source to target tables.
  • Modified the existing job with new functionality in the code.
  • Prepared the test cases for system test.
  • Monitor the InfoSphere suite (Data Stage/Quality Stage/Information Analyzer) servers.
  • Excellent with PL/SQL, T-SQL, Stored Procedures, Database Triggers and SQL * Loader.
  • Used several stages like Sequential file, Hash file, Aggregator, Funnel, Change Capture, Change Apply, Row Generator, Peek, Remove Duplicates, Copy, Lookup, Join, Merge, Filter, Datasets during the development process of the DataStage jobs.
  • Also employed C# for Developing Business Objects and Data Objects.
  • Created and scheduled SSIS packages to pull data from SQL Server and sent out to Excel Spreadsheets and vice versa. Also used SSIS to Import information into the framework utilizing various sources.
  • Extensively used Mapping Variables, Mapping Parameters, and Parameter Files for the capturing delta loads.
  • Worked on standing up the Performance Environment by creating Value Files, Parameter Sets, Unix Shell Scripts, running one time PL-SQL scripts for inserting/updating values in the various tables.
  • Development of XSLT's, Restful and SOAP based web services. Developed various ETL jobs including Data Extractions,TX, Transformations rules based on business requirements using IBM InfosphereDatastage 9.1.
  • Deploying the code into all other test environments and making sure QA to pass all their test cases.
  • Resolving the defects which have been raised by QA.
  • Established best practices for DataStage jobs to ensure optimal performance, reusability, and restartability.
  • Involved in developing the Cognos reports by writing complex SQL queries
  • Used Autosys to schedule, run and monitor Datastage jobs.
  • Extracted the data from the DB2 database and loading into downstream Mainframe files for generating the reports.

Environment: IBMDataStage9.1/8.5, Quality Stage, UNIX, AIX, WTX, DB2, Java, SSIS/SSRS,Mainframe files, CA7, Job control, Agile/Scrum,Unix shell Scripting,C#,SVN.

Confidential, NJ

ETL Datastage Developer

Responsibilities:

  • Involved in building an Enterprise Data-warehouse for the company with all the Retail and product details needed for Business Intelligence.
  • Extensively used DataStage Designer to develop various jobs to extract, cleanse, transform, integrate and load data into Data mart.
  • Extensively worked on Parallel Jobs using various stages like Join, Lookup, Filter, Funnel, Copy, Slowly changing dimension, Change Data Capture (CDC), Sequential File, Oracle Enterprise, DB2/UDB, Merge, transformer etc.
  • Designed, developed, debug, tested and promoted Java/ETL code into various environments from DEV through to PROD.
  • Created Data Validation document, Unit Test Case Document, Technical Design Document, Informatica Migration Request Document and Knowledge Transfer Document.
  • Importing and exporting repositories across the projects, Datastage Components and table definitions are done using Datastage Designer.
  • Designed MS SSIS Packages to extract data from various OLTP sources to MS SQL Server .
  • Worked on daily atomic, monthly atomic and Monthly aggregations of the reporting data mart.
  • Extensively used Parallel Stages like Aggregator, Join, Lookup, Filter, Modify, Copy, Sort, Change Capture, Remove Duplicates, Surrogate key Generator, Row generator, Column Generator and Peek for Processing, Development and De-bugging purposes
  • Designed Re-Usable jobs in DataStage which saved testing and designing time and can bring down the Development time.
  • Involved in developing applications in C# to meet the business requirements using Visual Studio.
  • Created jobs using the stages like Change-Capture stage in comparing the data between the two sources and capture this onto a file for further analysis.
  • Performed Job tuning which helps in reducing the production time for the daily job runs.
  • Worked with DataStage Manager to import/export metadata, jobs and routines from repository and also created data elements.
  • Mapped Data Items from Source Systems to the Target System.
  • Involved in source data analysis and data cleansing.
  • Performed file manipulation in UNIX.
  • Created Batches (DS job controls) and Sequencers to control set of DataStage jobs.
  • Created automated Load jobs using Autosys Scheduler.
  • Participated in discussions with Team leader, Group Members and Technical Manager regarding any technical Business Requirement issues.

Environment: Datastage8.1, Oracle 9.x, Erwin, C#,SQL, DB2, SQL*Plus, SQL Navigator,SSIS/SSRS,Agile, MS SQL Server 2000, Windows XP/2000.

Confidential, Maryland

ETL Developer

Responsibilities:

  • Migrating Informatica flows to IBM DataStage.
  • Created migration documents
  • Reviews existing data dictionaries and source to target mappings
  • Participate in Data modeling discussions, exchange thoughts to come up with a best model to efficiently serve both ETL teams and reporting teams
  • Extracted data using SSIS (ETL) tool utilized for the migration of data from source server to the destination server that enabled other to have data in a usable form to make decisions and plan better.
  • Designed complex DataStage mappings and re-usable transformations to facilitate Initial, Incremental and CDC data loads and parameterize to source from multiple systems
  • ETL migration and administration
  • Extensive Experience in writing SQL, PL/SQL queries, stored procedures, functions, packages and database triggers, exception handlers.

Environment: IBM Info sphere Datastage, Information analyzer, Informatica Power center8.6,UNIX, Shell scripting, control M, Erwin, Teradata, Oracle, PL/SQL, SQL*plus, SQL* Loader.

We'd love your feedback!