Sr Datastage Developer Resume
MO
SUMMARY
- Over 8 years of IT experience in Data Analysis, Design, Development, Implementation and Testing of Database/Data warehousing/Client/Server/Legacy applications
- Experience in working with Banking/Financial, Insurance and Retail Industries.
- Extensively worked with Parallel Extender /Server to improve job performance while working with data sources
- Over 6 years of experience in building data warehouse/data marts with extraction transformation and loading (ETL) processes using IBM InfoSphere Information Server - Data Stage versions 8.1/7.x/6. x.
- Extensively used ETL methodology for supporting Data Extraction, Transformations and Loading processing, in a corporate-wide-ETL solutions using Data stage.
- Experience in System Analysis, Design and Development and implementation of Relational Database (OLTP) and Data Warehousing Systems (OLAP) using Data Stage 7.X/8x and 9.X/11.X (Parallel Extender).
- Managing the overall SDLC process and deliver project deliverables within the scheduled time.
- Proficient in Data analysis, Data modeling, Database design and Data migration.
- Expert in dimensional modeling, Star Schema modeling, Snowflake modeling, fact and dimension table design, physical and logical Data modeling using Erwin.
- Worked on various operating systems like UNIX, Sun Solaris and Windows.
- Good experience with databases like SQL Server 2000/7.0, Oracle 10g/9i/8i/7.x, SQL*Plus, DB2 UDB 8.x, Teradata, DB2/400 and MS Access 2000/97/7.0, database programming using PL/SQL.
- Familiar with parallel processing database like Teradataand the Netezza
- Proficiency in data warehousing techniques for data cleansing, Slowly Changing Dimension phenomenon, surrogate key assignment and change data capture.
- Ability to work in-groups as well as independently with minimum supervision and initiative to learn new technologies and tools quickly
- Involved indimensional data modeling(star schema, snow flake schema) and fact and dimension table design, physical and logical data modeling using Erwin tool.
- Experience in Fine Tuning, Performance Enhancement, and Performance Analysis and Trouble Shooting of Data Stage jobs.
- Knowledge in Implementation of the SCD Types 1,2.
- Solid experience in Creating the Job Sequencer and Containers (shared, local)
- Creation ofjobs sequencesandjob schedulesto automate the ETL process by extracting the data from flat files, Oracle and Teradata into Data Warehouse.
- Good at Data Warehousing Concepts, ETL Concepts, UNIX Commands.
- Involved in Unit Testing and Preparing test cases.
- Excellent analytical, logical and programming skills.
- Handled large volumes of data warehouse database.
- Experience in Implementing Full Cycle Data Warehousing Projects.
- Involved in gathering Business requirement and Designing Functional specifications.
- Participated in discussions with Project Manager, Business Analysts and Team Members.
- Creating Technical Design documents (TDD).
- A Team Player with Strong analytical, problem solving skills, excellent communication and interpersonal skills.
- Experience in Import/Export Jobs from Development to Production Environment.
- Excellent strong organizational skills, excellent communication skills, dedicated Teamwork, Attention to details, very good team player and ability to work under pressure to meet competing priorities and Deadlines.
TECHNICAL SKILLS:
ETL Tools: IBM Infosphere Datastage/Ascential Datastage 9.1/8.X/7.5 Quality stage, Parallel Extender, (Parallel and Server Jobs).
Business Intelligence Tools: SSRS, SSIS, IBM Cognos 8.4, Business objectsTableau
Databases: Oracle 10g/9i/8i/7.x, SQLServer 2014/2012/2008/2005/2000 , SQL*Plus, DB2 UDB8.x, SQL/400Sybase IQ 11.0/12.0 Teradata, Netezaa MS Access
Languages: C, C++, HTML, Visual Basic 6.0, SQLPL/SQL, AGILE, SCRUM, Shell Script.
Web Technologies: XML, HTML, XSL, JavaScript, SOAP API.
Database Design Tools: Erwin 4.0 (Forward engineering, Reverse engineering), Sybase power developer
Data warehousing: Star & Snow-Flake Schema Modeling, Fact and Dimensions, Physical and Logical Data Modeling
Testing/Defect Tracing: HP Quality Center 11/10, Test Director
Operating Systems: Windows 2000/NT 4.0, AIXUNIX5.2,MSWindows95/98/2000/XP, Solaris, Mainframe (OS/390),MQ series.
PROFESSIONAL EXPERIENCE:
Confidential, MO
Sr Datastage Developer
Responsibilities:
- Involved with Application and Database Support Teams to maintain system and database which supports current data scenarios and easily adapts to changing business needs.
- Used Parallel Extender extensively by using Processing, Development/Debug, File and Real Time Stages.
- Involved in all phases including Requirement Analysis, Design, Coding, Testing, Support and Documentation
- Extensively used Datastage Designer to develop processes for extracting, transforming, integrating and loading data from various sources into the Data Warehouse database.
- Extensively used Qualitystage stages like Standardize, Match frequency, duplicate & unduplicated match and Survive stages.
- Widely Used different types of DataStage stages like modify, sequential file, Copy, Aggregator, Surrogate key, Transformer, dataset, look up, join, Remove Duplicates, CFF, sorter, Column generators, CDC, and Funnel.
- Used database stage like DB2/UDB Enterprise, DB2 bulk load, DRS, Sybase, ODBC Connector,
- Extensively Oracle Enterprise and Oracle Connector stages
- Designed and developed the process for real time data movement of reference data from Sybase to DB2 using mix of DataStage jobs.
- Developed Information service stages (WISD) for real time data movement between DB2 and Sybase.
- Worked on Integration testing of Application using Converted data to check for any discrepancies.
- Involved in Generating an SOA service of datastage Qalitystage job and deploy/Manage the services using IBM Console to receive service requests.
- Worked with Data Modelers, Technical Architects, Customer/end user, Business analysts, and Data analysts to design Technical Specification documents / Mapping documents.
- Extensively Tested all the developed jobs based on the requirements of the project and deployed the code into production environment.
- Used Quality Stage plug-in stage to call Quality Stage jobs into the DataStage Designer.
- Extensively Implemented slowly changing dimensions (SCD) TYPES.
- Created and used Shared Containers to reuse the logic in another Job.
- Developed staging and Data Mart DS jobs using Data Stage Designer on parallel environment.
- Extensively used SQL in Datastage jobs for processing data.
- Very good team player and Excellent communication skills.
Environment: IBM DataStage/Qualitystage 9.1/11.X, DB2 Z/OS, MS SQL Server 2008, Rapid SQL 8.1.1, HP Quality Center 11/10, DB2 UDB 9.7/9.1, Main Frames, Autosys, OLAP, OLTP, Hybernate, Flex, Tableau.
Confidential, NJ
Sr. Datastage Developer
Responsibilities:
- Interacted with the business users to gather the requirements and involved in data analysis.
- Designed the mappings between sources (external files and databases) to Operational staging targets.
- Extensively dealt with change capture techniques for implementing slowly changing dimensions’ process.
- Worked on setting up different environments for development, system testing, UAT testing and Production
- Created DataStage jobs to extract data from mainframe files to staging area and from staging to base database.
- Created the various complex Datastage jobs to accommodate various complex logics.
- Modeled the Data marts using Star Schema.
- Involved in Data Modeling using Dimensional Data modeling, Star Schema/Snow flake schema, Fact & Dimensions tables, Physical & logical data modeling.
- Extensively used Netezza connector and Netezza enterprise to connect to datastage.
- Completed documentation in relation to detailed Job plans, Job documents and high-level data models.
- Extensively used ETL to load data using DataStage Designer from heterogeneous source systems from Oracle and DB2 to target Oracle Database.
- Worked on the Stages like Lookup, Transformer, Join, Switch, Filter, Stored procedure and Pivot.
- Created Stage Variables, Parameter Variables and Environmental Variables
- Created reusable Containers to use in multiple Jobs.
- Extensively used various Performance Tuning Techniques to improve the session performance.
- Involved in performance tuning of the jobs while developing the Datastage jobs and also for existing jobs.
- Worked extensively to create, schedule, and monitor the Jobs and to send the notification messages to the concerned personnel in case of process failures.
- Used the Execute Command in Job Activity to run Different Commands
- Created and tested all the job run books for the release and transition to the production support team
- Extensively Involved in UAT and also supported testing team.
Environment: DataStage 8.5/9.1, Cognos 8.4, DB2, Oracle 10g, SQL Server 2000, Mainframe DB2, Windows 2000, ERWIN 7.x and UNIX AIX 5.1, Tableau, RealTime (XML, WISD, WebSphere MQ), Oracle 11g, Shell Scripting, Hadoop Stack(spark).
Confidential, Chicago, Illinois
Sr. Datastage Developer
Responsibilities:
- Worked as admin, created new project information server 8.1, set the properties, permissions, project tunable, environment variables and worked with Unix admin to create roles and passwords.
- PreparedFunctional specification documents,Process flow diagrams, Technical specification
- Used error handler process Jobs to capture look up failure, duplicates and data type errors and these errors are captured to an error log detail table.
- Extensively dealt with change capture techniques for implementing slowly changing dimensions’ process.
- Used Loop activity in sequencers for running the jobs for required number of iterations and used execute command to execute shell scripts while executing the job sequences as process of automation.
- Extensively used Data stage scheduler for scheduling the Datastage jobs and UNIX scripts
- Developed batches and sequencers in designer to run and control set of jobs.
- Involved in importing and exporting jobs category wise and maintaining the backup regularly.
- Performed the Unit testing for jobs developed to ensure that it meets the requirements
- Extracted data from SAP and loaded it into EDW, using ABAP extract stage.
- Scheduled jobs using Crontab utility based on the requirements and monitored the production for any possible errors.
- Used version Control for data stage to track the changes made to the data stage project components and for protecting jobs by making read only.
Environment: IBM WebsphereInformation Server8.1/7.5.2 (Designer, QualityStage, Manager, Administrator, Director), SQL, PL/SQL,Oracle10gR2/9i, MS Visio, Erwin 4.1,Windows NT, UNIX (AIX 4.3), Control-M
Confidential, Houston, Texas
Sr. Datastage Developer
Responsibilities:
- Used IBM Datastage Designer to develop jobs for extracting, cleaning, transforming and loading data into data marts/data warehouse.
- Used to read complex flat files from mainframe machine buy usingComplex Flat File Stage.
- Sequential File, Aggregator, ODBC, Transformer, Hashed-File, Oracle OCI,XML, Folder,FTP Plug-inStages were extensively used to develop the server jobs.
- Developed several jobs toimprove performanceby reducing runtime using different partitioning techniques.
- Used different stages of Datastage Designer likeLookup, Join, Merge, Funnel, Filter, Copy, Aggregator, and Sort etc.
- Staged the data coming from various environments in staging area before intoDataMarts.
- Involved in writingTest Plans, Test Scenarios, Test Casesand Test Scripts and performed the Unit, Integration, system testing and User Acceptance Testing.
- Used stage variables for source validations, to capture rejects and usedJob Parametersfor Automation of jobs.
- Strong knowledge in creating procedures, functions, sequences, triggers.
- Used Cobol Copy books to import the Metadata information from mainframes.
- Expertise inPLSQL/SQL.
- UsedClearCasefor Version Control and Migration of code between Development, UAT and Production environment.
- Performed debugging and unit testing and System Integrated testing of the jobs.
- WroteUNIX shell scriptaccording to the business requirements.
- Wrote mapping documents for all the ETL Jobs (interfaces, Data Warehouse and Data Conversion activities).
- Created shell scripts to perform validations and run jobs on different instances (DEV, TEST and PROD).
- Created & DeployedSSIS(SQL Server Integration Services) Projects, Schemas and Configured Report Server to generate reports through SSRS SQL Server 2005.
Environment: (IBM InfoSphere Information Server 8.1/7.5.2, Oracle10g/9i, DB2,) XML, Mercury Quality Center, Siebel Analytics 7.8.2/ oracle BIEE 10.1.3.3, Clearcase, Clearquest, Autosys 4.0, Microsoft SharePoint.
Confidential
Datastage Developer.
Responsibilities:
- Developed sql scripts to Create/Modify tables and T-parameter at source and staging levels.
- Used Control-M to schedule jobs and e-mailed the status of job to operation team.
- Used Meta data Workbench to allow users to explore, manage and analyze the metadata
- Used Universe Basic for developing user definedRoutinesand Transformations.
- Developed ETL jobs to extract data from SQL Server using ODBC Connector stage and load the data into internal datamart using oracle connector stage.
- Used XML output and XML Transformer stages to generate XML output file.
- Extracted data from mainframeby using Change Data Capture (CDC) management console.
- Developed and assisted other developers to create complex Datastage jobs using Database, Development /Debug, Processing, file and Real time stages.
- Used Shared container for simplifying design and maintenance. Extensively dealt with Performance tuning of the jobs.
- Tuned data stage jobs to improve the performance and to reduce the load on database. Compiled technical documents as per the client standards.
- Prepared the deployment packages for the code and checking in code to repository.
- Involved in Writing Shell scripts to automate the ETL Process
Environment: IBM Information Server 8.X, Oracle 10G, Linux 2.6, SourceSafe, SQL, PL/SQL, Control-M, Microsoft SQL Server 2005, Meta data Workbench and Metadata Server, XML, VSS, 24X7 Scheduler, Shell Scripting
Confidential
Datastage Developer
Responsibilities:
- Developed SQL Scripts for extracts and upload data into Education department website when ED Dept request the data in different levels/states
- Developed Spreadsheet to update all data every week when they send new files and load new updated data into database
- Developed several Parallel and Server jobs in Datastage Designer.
- Involved in data analysis and assisted business users in UAT.
- Used Administrator Client for updating of project properties.
- Responsible for identifying the failure process and reporting to concern developer.
- Interacted with Unix Admin to setup Project Structure, estimate space required for the project.
- Built prototype jobs for different environments for in-house developers to reference when developing new jobs as well as mentor and guide in-house developers.
- Used DataStage Administrator to assign privileges to users or user groups to control purging of Repository and DataStage client applications or jobs they run, move, and rename projects.
- Worked as a datastage admin to assign a username/passwords and maintain ODBC connections, all datastage admin issues.
Environment: (DataStage7.5.2, Quality Stage, Autosys, Oracle10gR2/9i, Flat Files, XML, SQL Server 2005, Windows 2003, Teradata V2R6