Sr. Datastage Developer Resume
Dublin, OH
SUMMARY:
- 10 + years of IT experience in the System Analysis, Design, Development, Implementation, Testing and Production support of Database, Data warehousing, Client/ Server/Legacy applications for various industries, using Data Modeling, Data Extraction, Data Transformation, Data Loading and Data Analysis.
- Experience in ETL & Business Intelligence using Confidential WebSphere Datastage 11.5/8.5/8.1 , Ascential Data Stage 7.5 (Data Stage Manager, DataStage Designer, DataStage Director, Datastage Administrator and Version Control).
- Excellent technical and analytical skills with clear understanding of design goals of ER modeling for OLTP and dimension modeling for OLAP
- Expertise in data warehousing techniques for implementing slowly Changing Dimension phenomenon.
- Experience in identification of Business Data requirements and converting them into conceptual and data models.
- Developed DB Triggers, PL/SQL Procedures, and Functions and Packages as per specifications.
- Good Understanding in design and implementation of Star schema, Snowflake schema and multi - dimensional model
- Involved in designing logical data models based on functional requirements and load strategy specifications to capture source data, data consolidation mechanisms and integration scenarios for reporting purposes.
- Worked as a Technical team lead for the Data stage team for production support, testing and development environments
- Experience in using Confidential InfoSphere Information Server Suite, such as QualityStage, Information Analyzer, and Master Data Management.
- Experience in standardizing addresses using investigate and standardize stage in Quality stage
- Worked with various databases in Oracle, DB2, MS Access, Sybase and SQL Server Teradata, MySQL.
- Experience with high-end programming experience using PL/SQL, SQL*Loader, ODBC, SQL Navigator, Toad, Korn Shell, Unix Shell Scripting, Perl Scripting.
- Experience in integrating complex data file formats such as XML and Mainframes JCL /Cobal data (EBCIDIC).
- Experience in using SVN repository for auto check in and checkout of DataStage jobs. Experience in third party scheduler Autosys, Control M for defining, scheduling and monitoring jobs.
- Experience in using WebSphere DataStage Pack for SAP BW and for SAP R/3 systems.
- Experience in working with offshore /onsite teams.
- Excellent analytical, problem solving, communication and interpersonal skills, with ability to interact with individuals at all levels.
- Performed and documented unit test plan and test case scenarios of developed code
- Mentored the developers on Datastage naming standards and involved in performance review and tuning of the jobs done by offshore team.
TECHNICAL SKILLS:
ETL Tools: DATA STAGE- Confidential InfoSphere Information Server Datastage and QualityStage 11.5, 9.1, 8.0, Ascential DataStage / 7.5.2/5.1/6.0 Profile Stage 7.0, Informatica Power Center 9.x/8.x/7., PowerMart 4.7/5.0, SSIS (SQL server 2012, 2008), Talend 4.1, DTS (SQL Server 2000), and Data Integrator.
Business Intelligence tools: Business Objects, Brio, SSRS, Tableau, Cognos
Data Modeling tools: Erwin 3.5/4.0/7.3/ 9.1.
Databases: Teradata V2R6, Oracle 11g/10g/9i/8i/7.x, DB2-UDB, Netezza, MySQL, SQL SERVER 2005/2008/2012 & MS Access.
Testing Tools: Auto Tester, Test Director, Lotus Notes.
Web Server: MS IIS 4.0, Apache Server 1.3, Tomcat.
Operating System: Unix Sun Solaris 2.6/2.7, HP-UX, Confidential AIX 4.2/4. 3/6.1, Windows NT and Windows 2000/98/95, MVS XE390
Programming Languages: PL/SQL, SQL*Loader, Shell Scripts
SAP: ABAP 4.7, BW 3.5, SAP Pack 5.2
J D Edwards: JDE 8.10, JDE 8.12
WORK EXPERINECE:
Confidential, Dublin, OH
Sr. DataStage Developer
Responsibilities:
- Gather requirements to enhance the existing data warehouse and document the need to have an enhanced 3NF Atomic data model based on the Confidential Banking and Finance Markets Data Warehouse model (FSDIM).
- Worked with Data modelers and data mappers to review the mapping documents, Logical data model and the physical data model.
- Prepared Logical and Physical Data integration documents.
- Review the Logical and Physical Data integration documents with Business and obtain Approvals.
- Design RWA (Risk weighted Assets) calculation engine in DataStage.
- Design Unified Data layouts for source data from the bank Subsidiary systems
- Created UNIX shell scripts for process UDL files and wrote a logic for conditional and unconditional window to process correction files.
- Worked with business team and created flow diagram for Enterprise Attribution.
- As part of Data Governance team, involved in validating active rules and verified data quality.
- Developed parallel jobs using stages like Aggregator, Change Data Capture, Transformer and
- Created Error Handling and audit process common modules to use across the project.
- Created shell scripts to support batch processing and to trigger data stage jobs.
- Responsible for performance tuning, code review, setting up the design standards and coordinating work with off shore team.
- Worked with SIT team to do end-to- end Regression testing.
- Used HPQC tool to update and close defects.
- Supported business Acceptance testing by providing standard data extracts.
Environment: : DataStage 11.5, SQL Server 2008/2012, Oracle 12c, PL/SQL, UNIX (AIX), Confidential Tivoli workload scheduler, Confidential Cognos 11.0, Perforce/Urban Code
Confidential, Philadelphia, PA
Sr. DataStage Developer
Responsibilities:
- Involved in Business requirement gathering sessions and created High-level scope documents.
- Responsible for creating Functional and ETL design documents based on business requirements and system architecture/design.
- Developed parallel jobs using stages like Aggregator, Change Data Capture, Transformer and Teradata Connectors etc.
- Worked on designing and developing the Confidential InfoSphere Information Server Quality stage
- Data profiling experience on Confidential InfoSphere Information Analyzer.
- Supported applications for Architecture and Data modelling activities; supported and maintained the project Data Models at multiple levels of detail and functionality (conceptual, logical, normalized, relational, dimensional, application-level, subject-level, etc.)
- Created Error Handling and audit process common modules to use across the project.
- Created shell scripts to support batch processing and to trigger data stage jobs.
- Wrote data mover scripts and SFTP scripts to receive/send files to external vendors.
- Used SVN repository for auto check in and checkout of DataStage jobs.
- Responsible for performance tuning, code review, setting up the design standards
- Designed Quality Stage stages in 9.0 for data cleansing & data standardization Process. Implemented Survive stage & Match Stage for data patterns & data definitions.
- Involved in creating indexes, materialized views and analyzing stats on base tables in Oracle for faster reporting.
- Implemented Type 2 SCD using Change data capture stage
- Using Key Management Functions Surrogate Keys were generated for composite attributes while loading the data into Data Warehouse.
- Used Datastage Director for validating, execution, monitoring jobs and check the log files for errors
- Involved in data conversion Process for converting data from legacy systems to new maintenance systems.
- Involved in writing Test Plans, Test Scenarios, Test Cases and Test Scripts and performed the Unit, Integration, system testing and User Acceptance Testing
Environment: : Data Stage 11.3/9.1, SQL Server 2008/2012, Oracle11g, Teradata 13, PL/SQL, UNIX (AIX), Tableau 10.0, Control M
Confidential, Naperville, IL
Sr. DataStage Developer/Data Stage TX Developer
Responsibilities:
- Involved in developing Technical Design specification documents for different financial interfaces which are integrated to JD Edwards.
- Involved in developing and enhancements for different interfaces Fuel Quest to JD Edwards Interface, Telephone Exchange Management (TEM) to JD Edwards Interface, Procurement Card (P-Card) to JD Edwards Interface and Vehicle Management System (VMS) to JD Edwards Interface.
- Integrating various financial and maintenance applications data in the organization into data warehouse.
- Used Datastage Designer to develop jobs for extracting, cleaning, transforming and loading data into data warehouse.
- Developed several jobs to improve performance by reducing runtime using different partitioning techniques.
- Used different stages of Datastage Designer like Lookup, Join, Merge, Funnel, Filter, Copy, Aggregator, and Sort etc.
- Used to read complex flat files from mainframe machine buy using Complex Flat File Stage.
- Sequential File, Aggregator, ODBC, Transformer, Hashed-File, Oracle OCI, XML, Folder, FTP Plug-in Stages were extensively used to develop the server jobs.
- Worked on Complex data coming from Mainframes (EBCIDIC files) and knowledge of Job Control Language (JCL).
- Parsed the complex Electronic Data Interchange (EDI) data coming from different organizations.
- Created new TX maps per company business rules.
- Successfully parsed the EDI data such as EDI 850 (Purchase order), EDI 855(Purchase order Acknowledgement), EDI 860(Purchase order Change), EDI 865 (Purchase Order Change Acknowledgement), EDI 869(Order status inquiry), and EDI 870 (Order status report).
- Used Cobol Copy books to import the Metadata information from mainframes.
- Used Investigation stage in QualityStage to discover trends and potential anomalies in the data.
- Used stage variables for source validations, to capture rejects and used Job Parameters for Automation of jobs.
- Used several stages in Sequencer like Abort Job, Wait for Job, Nested Condition and Mail Notification stages to build an overall main Sequencer and to accomplish Re-startability.
- Used Autosys for scheduling and automation of DataStage Jobs.
- Created Job definitions by using Autosys Graphical User Interface (GUI) and Autosys Job Information language (JIL).
- Used Datastage Manager for importing metadata into repository and used for Importing and exporting jobs into different projects.
- Performed debugging and unit testing and System Integrated testing of the jobs.
- Created shell scripts to perform validations and run jobs on different instances (DEV, TEST and PROD).
Environment: Data Stage 8.1(PX), SQL Server 2000/2005, Oracle10g, Sybase, PL/SQL Toad, UNIX (HP-UX), JD Edwards 8.10, JD Edwards 8.12, Autosys 4.5 and Windows NT, Business objects, Autosys
Confidential, Atlanta, GA
Sr. DataStage Developer
Responsibilities:
- Involved in developing Technical Design specification documents for different interfaces.
- Involved in integration of non-SAP data into SAP business Information Warehouse.
- Followed Star schema for the methodology to organize the data in the data warehouse.
- Developed several Server and Parallel jobs to improve performance by reducing runtime using different partitioning techniques.
- Used different stages of Datastage Designer like Lookup, Join, Merge, Funnel, Filter, Copy, Aggregator, and Sort etc
- Used search criteria, job comparisons and used reusable parameters sets to cut down development time.
- Used Information Analyzer for column analysis and for profiling of data.
- Used stage variables for source validations, to capture rejects and used Job Parameters for Automation of jobs.
- Designed and developed jobs using both Server jobs and Parallel Extender.
- Created jobs in DataStage to import data from heterogeneous data sources like Sybase, Oracle 10g, Text files and MS SQL Server.
- Used Datastage Designer to develop jobs for extracting, cleaning, transforming and loading data into data warehouse.
- Used Datastage Director for validating, execution, monitoring jobs and check the log files for errors.
- Used SAP Packs (ABAP EXTRACT, IDOC EXTRACT, and BAPI EXTRACT) to extract data from SAP Systems.
- Used all stages like Sequential files, Hash files, Lookup hash, Join, Funnel, Filter, OCI9i Transformer stage and Sequence Jobs using Job Activity and Mail Notification to send mail notifying the admin about the success or failure of the jobs
- Involved in development of Common Error Management process at Project level.
- Developed user defined routines for several jobs.
- Used several stages in Sequencer like Abort Job, Wait for Job, Nested Condition and Mail Notification stages to build an overall main Sequencer and to accomplish Re-start ability.
- Developed the jobs and combined all the jobs into one job to send it to Frictionless database
- Created Ksh scripts to perform validations and run jobs on different instances (DEV, TEST and PROD).
- Used ETL Timestamp job to have a single time for all the jobs when the job runs from day 2 to day 11 every month and as and when required.
- Used DataStage Manager for importing metadata into repository, for importing and exporting jobs into different projects.
- Used CRON in UNIX for Job scheduling.
- Wrote stored procedures, functions and packages using TOAD to handle complex business logic and to delete data during the Unit and Functional Testing.
- Performed unit testing of all monitoring jobs manually and monitored the data to see whether the data is matched, if matched send it to the frictionless database otherwise reject and created migration of documents.
Environment: Confidential WebSphere Data stage and Quality Stage 8.0, Oracle9i, PL/SQL, Toad, SQL Server, DB2UDB, Kshell Script, UNIX (Solaris), SAP BW 3.5, Cognos BI
Confidential, Kansas City, MO
Sr. DataStage Developer
Responsibilities:
- Worked on the logical and physical design of the Data warehouse. Identified sources/targets and analyzed source data for dimensional modeling.
- Good knowledge on Voluntary Insurance plans to employers to offer total Insurance packages.
- Worked in design of Voluntary Disability, Voluntary Dental and Voluntary Life of data marts.
- Good knowledge on policy and claims processing
- Designed and developed jobs for extracting, transforming, integrating, and loading data into data mart using DataStage Designer, used Data Stage manager for importing metadata from repository, new job categories and creating new data elements
- Worked with EBCIDIC files to extract data in required format.
- DataStage jobs were scheduled, monitored, performance of individual stages was analyzed and multiple instances of a job were run using DataStage Director.
- Sequential File, Aggregator, ODBC, Transformer, Hashed-File, Sort, DB2 API, Oracle OCI, XML, FTP, Pivot, Hashed file, Link Partitoner, Link Collector and Plug-ins Stages were extensively used to develop the server jobs
- Used Parallel Extender for splitting the data into subsets, utilized Lookup, Sort, Merge and other stages to achieve job performance
- Using Key Management Functions Surrogate Keys were generated for composite attributes while loading the data into Data Warehouse.
- Developed user defined Routines and Transformations for implementing Complex business logic.
- Extensively used Shared Containers and Job Sequencer to make complex jobs simple and to run the jobs in sequence
- Involved in the preparation of ETL documentation by following the business rule, procedures and naming conventions.
- Created reports for various Portfolios using the Universes as the main Data Providers.
Environment: Confidential Web Sphere DataStage 7.5, Metastage 7.0, Business Objects 6.5, Oracle 9i, PL/SQL, SQL * Plus, UNIX Shell Scripts, Windows 2000/NT 4.0, ERWIN 4.1
