We provide IT Staff Augmentation Services!

Ibm Datastage Developer/administrator Resume

Loveland, CO

OBJECTIVE:

Seeking a challenging career in a growth oriented position to utilize my skills and knowledge in the areas of Application Development, Data warehousing Management System and Software Engineering.

SUMMARY:

  • 9+ Years of IT experience in all phases of software development life cycle which includes analysis, designing, implementation and testing in various domains like insurance, retail, banking and health care.
  • Expert in designing Parallel jobs using various stages like Join, Merge, Lookup, Remove duplicates, Filter, Dataset, Lookup file set, Complex flat file, Modify, Aggregator, XML.
  • Expert in designing Server jobs using various types of stages like Sequential file, ODBC, Hashed file, Aggregator, Transformer, Sort, Link Partitioner and Link Collector..
  • Proven track record in troubleshooting of Datastage jobs and addressing production issues like performance tuning and enhancement.
  • Excellent Experience in Designing, Developing, Documenting, Testing of ETL jobs and mappings in Server and Parallel jobs using Datastage to populate tables in Data Warehouse and Data marts..
  • Extensive Data warehousing experience using IBM Info sphere Master Data Management MDM, Information Analyzer,Datastage 11.3/9.1/8.x/7.x (Datastage designer, manager, director and administrator).
  • Experience indata warehousingincludingbusiness intelligence tools - DTS, SSIS and SSRS.
  • Designed both server and parallel using various stages like ODBC, CDC, transformer, join, merge, look up, funnel, aggregator, copy, and filter.
  • Good understanding of the Glossary taxonomy concepts such as Categories, Terms, defining relationships between assets, External Assets/mappings and well versed with maintaining Business Glossary and Taxonomy.
  • Experienced in using advance datastage plug in stages like XML input and XML output.
  • Experienced with Quality stage for data profiling, standardization, matching and survivorship.
  • Strong skills in Master Data Management (MDM) like data collection and data transformation.
  • Expertise in all the phases of System development life Cycle (SDLC) using different methodologies like Agile, Waterfall.
  • Extensive experience in IBM DB2 UDB 9.7/9.0/8.0, Oracle 10g/9i/8i, Microsoft SQL Server 2005/2000, Teradata, Netezza databases.
  • Understanding of Data Assets and Data Flows in order to represent Data Lineage, Data Relationships, and linkages.
  • Strong experience in coding using SQL, SQL*plus, PL/SQL stored procedure/functions, triggers and packages.
  • Strong hands on experience usingTeradata utilities (SQL, B-TEQ, Fast Load, MultiLoad, FastExport, Tpump, Visual Explain, Query man), Teradata parallel support.
  • Good Experience in integrating with IBM Netezza (PureData System for Analytics) for ETL using DataStage.
  • Proficient in coding of optimizedTeradata batch processing scriptsfor data transformation, aggregation and load usingBTEQ.
  • Experience working with XML based canonical models.
  • Extensively used C:D,MoveIT and BIX rules for data pulling method from financial systems like Accounting records,Banking,Global finance systems.
  • Good Working knowledge of LDAP, Active Directory, SSSD, Kerberos and Samba.
  • Strong Experience in integrating with IBM iSeries AS400 for ETL using CDC.
  • Experience installing and configuring IBM InfoSphere Change Data Capture, IBM WebSphere MQfor data replication subscriptions.
  • Sound Knowledge ofData Warehousing concepts,E-R model&Dimensional modeling(3NF) likeStar Schema, Snowflake Schemaand database architecture forOLTPandOLAP applications, Data Analysis and ETL processes.
  • Extensively ImplementedError Handling Concepts, Testing, Debuggingskills and Performance tuning of targets, sources, transformation logics.
  • Involved in Huge data migrations, transfers using utilities like Data Transformation Services (DTS), and SSIS, Bulk Copy Program (BCP) and Bulk Insert.
  • Experience in BI Development and Deployment of DTS, SSIS packages from MS-Access, Excel, Oracle.
  • Designing and Deployment of Reports for the End-User requests using Web Interface & SSRS.
  • Extensive experience in controlling the User Privileges, Monitoring the Security and Audit issues as per Standards.
  • Experience in solving Real Time issues with Index fragmentation, DBCC checks, Query Tuning, Error and Event Handling.
  • Involved in understanding Business Process and coordinating with Business-users to get specific user requirements. Involved in source data analysis and identified business rules for data migration and for developing data warehouse data marts.
  • Strong planning, organizational, interpersonal, written and verbal communications skills.
  • Willing to be on call supporting the ETL environment.

TECHNICAL SKILLS:

ETL: IBM IIS Master Data Management MDM/DataStage/Quality Stage V 11.3/9.1/8.7/8.5/8.0.1 (Administrator, Designer, Director), Fast Track, Information Analyzer, DataStage EE 7.5x2/7.0 (EE), IBM MDM (Mata Data Management), IBM Data mirror/CDC SQL Server Data Transformation Services (DTS), SSIS.Talend.

Programming Lang.: C,C ++,SQL, PL/SQL,Python,Transact SQL, XML, UNIX Shell Scripting.

Modeling Tools.: MS SQl 2014, SSIS, SSSRS, SSAS,Erwin, ER Studio, Power Designer, Microsoft Visio.

Reporting Tools.: Cognos, Business Objects, EXCEL Reporting, Crystal Reports.

Databases and Tools.: RDBMS,Oracle 11g/10g/9i/8i,DB2 UDB 9.0/9.7, Teradata V2R3/V2R4.1/ V2R5/V2R6, MS SQL Server 2008/2005/2000 , Netezza, Toad, Rapid SQL, i2b2 v1.4.

Specialized Tools.: SQL*Loader, MS-Office, VMware ESX.

Operating systems.: Windows 7/XP/NT, Unix (AIX/HP-UX/Sun Solaris), Linux.

Version control/Scheduling.: PVCS, DS Version Control, ESP, UC4, AutoSys,Tivoli,Control-M,Crontab.

PROFESSIONAL EXPERIENCE:

Confidential, Loveland, CO

IBM Datastage Developer/Administrator

Responsibilities:

  • Optimized the existing jobs for better performance and implemented new business logic for the production environment.
  • Installed and created the dataquality logic usic AVI,Stadardization stage.survivorship ..etc..
  • Performed Installation, Implementation and Support using IBM Infosphere Data Mirror/Change Data Capture and Change Data Delivery.
  • Involved in migrating from DataStage 8.7 to DataStage 11.x.
  • Good experience working with IBM Infosphere CDC data replication tool
  • Worked with Orchestrate environment for parallel processing at Job & lookup stage.
  • Worked with business analysts & key technology partners to identify solutions to develop new reports.
  • Sound knowledge and experience working with standard data constructs such as XML, XSD, JSON, 3NF..
  • Used QualityStage to coordinate the delivery, consistency, removing data anomalies and spelling errors of the source information.
  • Used Quality stage Web service for update or send the messages to upstream MDM Server, ISM (International Stadard Matching),AVI (Address verification interface) and WSDL.
  • Worked directly with the larger Legal Data Warehouse team to maintain and correct dimensional or fact data that impacts report accuracy and availability.
  • Assisting in the definition of the database requirements; analyze existing models and reports looking for opportunities to improve their efficiency.
  • Worked closely with data modeler and database administrator to understand the business process and participated in gathering of business requirements to load the data warehouse which is designed on the Star schema.
  • Used the ABAP Extract stage to generate an ABAP program and uploads it to the SAP system and Used IDoc Extract Connector stage to browse SAP IDoc metadata.
  • Extensively Configuring the IBM Information server suite including Information Analyzer, FastTrack, Business Glossary and Metadata Workbench.
  • Done the impact assessment in terms of schedule changes, dependency impact, code changes for various change requests on the existingData Warehouseapplications that running in a production environment.
  • Provided quick productionfixesand proactively involved in fixing production support issues.
  • Delivered MDM stewardship and datagovernance program. Data monitoring &Notification processes are designed.
  • Good experience working with IBM Business Process Management (BPM) tool.
  • Expertise in integrating Business Glossary with XML based models.
  • Defined, developed and enabled workflows to ensure appropriate Data Governance.
  • Configured the IBM Information server suite including Information Analyzer, FastTrack, Business Glossary and Metadata Workbench.
  • Experience with Information Server High Availability implementations and architectures such as clustering and Information Server Grid
  • Created shell script to run data stage jobs from UNIX and then schedule this script to run data stage jobs through scheduling tool.
  • Modified existing UNIX shell script to run Job sequencer from the mainframe job.

Environment: IBM InfoSphere MDM 11.5,IBM InfoSphere DataStage/QualityStage 11.3/11.5,IBM MQ,IBM Data Mirror(CDC),IBM Mainframe S390, Hive, Talend,Pig and Hadoop Streaming, MapReduce,Telematics,IOT, Oracle 11g, IBM DB2 9.1, Autosys, TOAD, Rapid Sql, Oracle 10g,Shell Scripts, AIX6.0, Windows XP.

Confidential, Rochester, MN

IBM Datastage Developer/Administrator

Responsibilities:

  • Analysis, design and implement the Conversion Activities: Extraction, Copy Build, Log Apply, Record Counts, Transformation, and Verification.
  • . Involved in IA Administration to create the IA Projects, adding of Data sources to the projects, imported the metadata of the tables to the IA Projects and giving the IA permissions to the Users to profile the data.
  • Used QualityStage stages such as investigate, standardize, match, AVI and survive for data quality and data profiling issues during the designing
  • Created re-usable components using shared containers for local use or shared use. worked with standard data constructs such as XML, XSD, JSON, 3NF.
  • Performed Installation, Implementation and Support using IBM Infosphere Data Mirror/Change Data Capture and Change Data Delivery.
  • Worked with Orchestrate environment for parallel processing at Job & lookup stage.
  • Worked with business analysts & key technology partners to identify solutions to develop new reports.
  • Worked with operational reporting team and business partners to automate or simplify existing processes, ensure data quality & consistency.
  • Used QualityStage to coordinate the delivery, consistency, removing data anomalies and spelling errors of the source information.
  • Worked directly with the larger Legal Data Warehouse team to maintain and correct dimensional or fact data that impacts report accuracy and availability.
  • Assisting in the definition of the database requirements; analyze existing models and reports looking for opportunities to improve their efficiency.
  • Worked closely with data modeler and database administrator to understand the business process and participated in gathering of business requirements to load the data warehouse which is designed on the Star schema.
  • Used the ABAP Extract stage to generate an ABAP program and uploads it to the SAP system and Used IDoc Extract Connector stage to browse SAP IDoc metadata.
  • Extensively Configuring the IBM Information server suite including Information Analyzer, FastTrack, Business Glossary and Metadata Workbench.
  • Done the impact assessment in terms of schedule changes, dependency impact, code changes for various change requests on the existingData Warehouseapplications that running in a production environment.
  • Provided quick productionfixesand proactively involved in fixing production support issues.
  • Configured the IBM Information server suite including Information Analyzer, FastTrack, Business Glossary and Metadata Workbench.
  • Experience with Information Server High Availability implementations and architectures such as clustering and Information Server Grid
  • Expert in systems integration and Strong experience with Agile Scrum methodology.
  • Modified existing UNIX shell script to run Job sequencer from the mainframe job.

Environment: IBM InfoSphere DataStage/QualityStage 11.3/11.5,IBM MQ,IBM Data Mirror(CDC),IBM Mainframe S390, Hive, Talend,Pig and Hadoop Streaming, MapReduce, Oracle 11g, IBM DB2 9.1, Autosys, TOAD, Rapid Sql, Sql Server 2012, SSIS, SSRS, SSAS, Connected Car,Oracle 10g,Shell Scripts, AIX6.0, Windows XP.

Confidential, Dodgeville, Wi

IBM Datastage Developer/Administrator

Responsibilities:

  • Worked closely with data modeler and database administrator to understand the business process and participated in gathering of business requirements to load the data warehouse which is designed on the Star schema.
  • Professional experience with designing and developing applications on DB2 DB.
  • Good experience working with IBM Business Process Management (BPM) tool.
  • Configured MDM Server, reconfigured domain setting, re-coded and re-engineered the dataflow based on IBM out-of-box functionalities Built test scripts for unit testing of customized MDM code
  • Extensively Configuring the IBM Information server suite including Information Analyzer, FastTrack, Business Glossary and Metadata Workbench.
  • Worked on theTeradata stored proceduresand functions to confirm the data and have load it on the table.
  • Extensively worked with CDC and CDD state identify the changes and transmission process for the data.
  • Worked on optimizing and tuning theDB2views andSQL’sto improve the performance of batch and response time of data for users.
  • Performance Tuning of sources, Targets, mappings and SQL queries in transformations.
  • Provided support during thesystem test, Product IntegrationTesting andUAT.
  • Done the impact assessment in terms of schedule changes, dependency impact, code changes for various change requests on the existingData Warehouseapplications that running in a production environment.
  • Provided quick productionfixesand proactively involved in fixing production support issues.
  • Developed Parallel jobs, which maintains Surrogate key generation in multiple run.
  • Extracting/Loading Data from/into Database tables using DB2 stage.
  • Files (Fixed Width) & XML files to staging database & from staging to target Data Warehouse database.
  • Developed Sequence jobs for Data Separation, History Processing, Load and Post Process Routine.
  • A conduit for the transmission of legacy data to a message queue.
  • Participated in Daily stand-up meetings with project manager, Team Lead, co-developers, communicated with testers and resolved trackers.
  • Create parameter set to assign a value to job at run time.
  • Expert in systems integration and Strong experience with Agile Scrum methodology..
  • Checking of data in live as part of post implementation support.

Environment: IBM DataStage and QualityStage 11.5,Talend,IBM MQ,IBM Mainframe, Netezza 7.1, IBM DB2 9.1, Autosys, Erwin, TOAD, SQL Server 2012, PVCS, MS Visio Business Objects, Telematics,Shell Scripts, AIX6.0, Windows XP.

Confidential, New York City, NY

IBM MDM/Datastage Developer/Admin.

Responsibilities:

  • Developed Network Data Mover/Connect: Direct scripts to transfer Data files to and fro from Mainframe data source and other originating feeder systems.
  • Extensively worked on DataStage jobs for splitting bulk data into subsets and to dynamically distribute to all available processors to achieve best job performance.
  • Performed Unit testing and System Integration testing by developing and documenting test cases in Quality Center.
  • MDM Data additions, Data extensions, Behavior extensions, Query extensions, Entity subtypes, MDM metadata specs, Product type hierarchy models.
  • Responsibility forintegrating variety of data systems, andgeographically fragmented customer information and Architected MDM solution for customerinformation across various source systems.
  • Used DataStage Netezza Enterprise stage to load data, utilizing the available processors to achieve job performance, configuration management of system resources in Orchestrate environment.
  • Extensively used Lookup, Join, Merge stages for joining various information and also used Parallel Transformer, Column Generator, Funnel, Filter,IDOC connector Stage,XML I/O Stage,Java Integration Stage,ABAP Extract Stage, Switch, Modify, Pivot, Row Generator.
  • Implemented Quality Stage for data cleansing, data standardization and matching process..
  • Worked on optimizing and tuning theTeradataviews andSQL’sto improve the performance of batch and response time of data for users.
  • Used Quality Stage to check the data quality of the source system prior to ETL process.
  • Worked on optimizing and tuning theDB2views andSQL’sto improve the performance of batch and response time of data for users.
  • Collaborated with data management team andconducted large data management workshop.
  • Good experience working with IBM Business Process Management (BPM) tool.
  • Used Web sphere MQ explorer for data transfer between different platforms.

Environment: IBM InfoSphere Information Server V8.7 Suite DataStage, QualityStage, IBM InfoSphere MDM/MQ/CDC/DataStage and QualityStage 9.1/11.3,Pega,Netezza 7.1,IOT, SQL Server 2012, Db2, Linux, Tivoli, Windows XP.

Confidential, Lower Manhattan, NY

Sr. Datastage Developer

Responsibilities:

  • Developed ETL procedures to ensure conformity, compliance with Confidential standards and to translate business rules and functionality requirements into ETL procedures.
  • Performed Installation, Implementation and Support using Change Data Capture and Change Data Delivery.
  • Administered and Designed ETL jobs for Claims, Membership Coverage and Member Status Tracking Jobs Using Ascential DataStage EE (7.5)/Information Server (8.5).
  • Used the ABAP Extract stage to generate an ABAP program and uploads it to the SAP system and Used IDoc Extract Connector stage to browse SAP IDoc metadata.
  • Worked with advanced PL/SQL concepts PL/SQL objects and records used them in building procedures and functions.
  • Implemented Complex Designs using parallel Stages like Join, Lookup, Pivot, Change Capture and Surrogate Key, IDOC connector Stage,XML I/O Stage,Java Integration Stage,ABAP Extract Stage.
  • Parameterized the Server/Parallel Jobs using Environmental variables, Parameter Sets and Job Parameters.
  • Created the Environmental Variables and Set up the default values in DataStage Administrator.
  • Designed Jobs involving Complex Flat File (CFF) Stage to extract Data from Mainframes (Cobol Copybooks),SOAP API and load it to Oracle Tables.
  • Handled the Retro Member records using Current to Previous Row Comparison using Stage variables along with PL/SQL Code.
  • Used IBM MQ as an intermediary between applications, transforming messages as they are sent between programs.
  • Involved as primary on-site technical lead during the analysis, planning, design, development, and implementation stages of projects using IBM Web Sphere software (QualityStage v8, Information Analyzer, Profile Stage).
  • Extensively worked in UNIX, writing Shell Scripts for data cleansing and scheduling.
  • Worked on data export and import wizard to transfer data between different schemas in oracle using TOAD..

Environment: IBM Info sphere MDM/DataStage and QualityStage 9.1, IBM MQ, Erwin, Oracle 11g, IBM DB2 9.1, PL/SQL, Sql Server 2012,T-SQL, TOAD, UNIX, IPSwitch WS FTP Professional,Telematics, Shell Scripting, AIX6.0, HP Quality Center.

Confidential, Boston

Sr. DataStage Developer

Responsibilities:

  • Designing, Developing, Documenting and Testing the Different Jobs according to Business Requirements (ETL Specification)
  • Developed Server Jobs which loads Dimension Tables and maintains Surrogate key generation in multiple run
  • Migration of data from Staging Area into Marketing and Sales Data Marts to store reliable data for decision support system using DataStage as ETL tool.
  • Identified business priorities MDM subject areas. Translated business requirements to tech implementation.
  • Familiar with import/export of DataStage Components (Jobs, DSRoutines, DSTransforms, and Table Definitions) between DataStage Projects.
  • Created mappings according to the specification using various transformations like Aggregator, Lookup, IDOC connector Stage,XML I/O Stage,Java Integration Stage,ABAP Extract Stage,Update strategy transformation etc.
  • Created Workflows using various tasks like session, timer, control, event wait, event raise tasks etc.
  • Used Shared container for simplifying design and maintenance
  • Used DataStage Director to unlock jobs (Recourses clean up), monitoring jobs and managing logs. worked on IBM WebSphere MQ Explorer to test the Queue Depth, dead letter queue and number of messages.
  • Created DDL, DML and Transaction queries in SQL
  • Extensively worked with CDC state identify the changes in the data.
  • Worked on optimizing and tuning theDB2views andSQL’sto improve the performance of batch and response time of data for users.
  • Documented the development process and performed knowledge transfer to Business Intelligence team
  • Documented every job (proper Naming convention, Annotation etc.) as per DataStage Design standard set by NYCHA.
  • Developed Packages and customized functions and Triggers based upon the business logics.
  • Involved in Performance tuning of complex queries.
  • Developing Oracle PL/SQL stored procedures, Functions, Packages, SQL scripts to facilitate the functionality for various modules.

Environment: IBM Infosphere Datastage & QualityStage V8.7,IBM Mainframe, Netezza 7.1, SQL Server 2008/2008r2, Db2, Linux, Control-M, Windows Xp.

Confidential

Sr. DataStage Developer

Responsibilities:

  • Worked on a team to help Build and Upgrade multiple processes using DataStage/QualityStage to Extract Transform Standardize Match and Load several existing SQL applications used in the pre closing closing and post closing processes for Deposits Loans and Claims.
  • Developed and supported the Extraction, Transformation and Load process (ETL) for a data warehouse from various data sources using DataStage Designer.
  • Performed Installation, Implementation and Support using Change Data Capture and Change Data Delivery.
  • Used DataStage Designer for importing the source and target database schemas, importing and exporting jobs/projects, creating new job categories and table definitions.
  • Designed and developed the Routines and Job Sequence for the ETL jobs
  • Developed Network Data Mover/Connect: Direct scripts to transfer Data files to and fro from Mainframe data source and other originating feeder systems.
  • Responsible for running jobs using Job Sequencers, Job Batches.
  • Developed Parallel jobs using various stages like Join, Merge, Funnel, Lookup, Sort, IDOC connector Stage,XML I/O Stage,Java Integration Stage,ABAP Extract Stage, Transformer, Copy, Remove Duplicate, Filter, Peek, Column Generator, Pivot and Aggregator stages for grouping and summarizing on key performance indicators used in decision support systems
  • Extensively worked on Teradata MLoad, Teradata Enterprise Stage, and Teradata API Stage to extract, transform and load data.
  • WebSphere MQ Stage to read messages from the Queues and also worked on IBM WebSphere MQ Explorer to test the Queue Depth, dead letter queue and number of messages.
  • Extensively used Reject Link, Job Parameters, and Stage Variables in developing jobs
  • Involved as primary on-site technical lead during the analysis, planning, design, development, and implementation stages of projects using IBM Web Sphere software (QualityStage v8, Information Analyzer, Profile Stage).
  • Developed Packages and customized functions and Triggers based upon the business logics.
  • Developing Oracle PL/SQL stored procedures, Functions, Packages, SQL scripts to facilitate the functionality for various modules.

Environment: IBM InfoSphere Information Server V8.1.1 Suite, DataStage, QualityStage IBM Info Sphere DataStage/Quality Stage 8.5 (Designer, Director and Administrator), Teradata V2R12, AIX 5.3, SQL Server, SQL Assistant, Windows XP, Visio, Erwin.

Confidential

DataStage Consultant

Responsibilities:

  • Involvement in drafting the ADS (Application Design Specifications) and PGS (Program Specification) of the existing Jobs in the Project CBOR such as Member Number Reassignment, Pricing Extract, SOBI Extract, Developed Test Scripts, Test Procedures, and testing standards for DataStage Jobs.
  • Developed and Executed SQL and UNIX generated test.
  • Involved in gathering the business requirements and preparation of Technical design specs for ETL projects.
  • Prepared mapping documents, conceptual design, and testing documents for ETL jobs.
  • Developed various Unix Shell scripts for the checking the "status of claims", "Job run scripts", fix of the existing scripts and designing various validation jobs. Involved in Designing Regressive Testing and production support for DataStage jobs in various projects involving in load the source data to the staging area, created the update strategy, transformation, lookup IDOC connector Stage,CDC,CDD,XML I/O Stage,Java Integration Stage,ABAP Extract Stage, column export filter and slowly changing Dimensions,
  • Designed and developed Procedures, Functions, Routines and Sequence for business logic as required.
  • Review of Unit test cases, Integration test cases of all the assigned modules.
  • Review of Unit test cases, Integration test cases of all the assigned modules.
  • Created jobs sequences, Batch Jobs, Developed DataStage Custom routines.
  • Performance Tuned DataStage jobs to significantly reduce the run time.
  • Developing the Job Sequences and batch jobs run & control set of jobs and also used looping functionality for mail generation.
  • Working on writing Procedures and Packages in PL/SQL.
  • Knowledge of Built-in, Plug-in and Custom Stages in DataStage.
  • Performance tuning (SQL and PL/SQL) critical queries with procedures, create Tables, Indexes, Views, triggers and programs.

Environment: IBM DataStage 7.5x2, IBM InfoSphere Information Server V8.1.1 Suite DataStage, QualityStage, Oracle 9i,Mainframe ACF2,TWS, XML files, PL/SQL, AIX 5.3, Windows 2000, Microsoft Office, Toad.

Hire Now