Datastage Developer Resume
Eden Prairie, MN
SUMMARY:
- Seven years of IT experience in Analysis, Design, Development, Testing and Implementation of DataWarehouses and Data marts with ETL tool Datastage 7.5(PX)/8.5/11.3 and Informatica Power Center 8.6.
- Experience in working with Banking/Financial, Insurance and Retail Industries.
- Having experience in Data Warehousing technologies concentrating on the DataStage, Oracle 11g, Teradata V12, AWS Redshift, Informatica and autosys.
- Strong Experience in writing complex SQL Queries, PL/SQL stored procedures, triggers, creating Tables, Indexes, Views and Materialized Views.
- Strong working knowledge with Teradata v12, Oracle 11g, Redshift databases with strong SQL scripting and extensive experience in using Database tools such as Toad, SQL Workbench, Oracle SQL Developer and Teradata SQL assistant.
- Optimized query performance on Redshift DB and used Datastage to extract and load the data.
- Experience with Star schema and Snowflake Schema, Fact and Dimensional Tables, Data modeling and Slowly Changing Dimensions.
- Extensive experience working with Datastage Designer and DataStage Director to run, debug and validate DataStage Jobs.
- Designed Parallel jobs using various stages like join, merge, lookup, remove duplicates, filter, dataset, sequential file, modify, aggregator, Transformer and Change Data Capture stage.
- Working experience in interacting with Business Analysts to analyze the user requirements, functional specifications and system specifications.
- Experienced on various operational sources like Teradata, Oracle, DB2, Flat files, XML, Mainframe and excel files.
- Ensuring that all the deliverables by our team must follow defined architecture, coding standards and best practices are followed.
- Experience in working on operating system like Aix with Shell Scripting.
- Expertise in all phases of the Software Development Life Cycle (SDLC) including analysis, design, code development, testing, implementation, maintenance and used agile model for the same.
- Strong hands on experience using Teradata utilities (FastLoad, MultiLoad, and Tpump) and Bteq scripts.
- Created mapping and workflows on informatica 8.6 concentrating on Power centre designer, Workflow monitor and workflow manager.
- Checked in the ETL code in tortoiseSVN to maintain different versions in different stages of project life cycle.
- Have ability leading a team, work in a team as team member and can work independently as Individual contributor and Worked as Technical Business Analyst.
- Knowledge and Trained on Hadoop,Ibm MDM, NetezzaandDataVault modeling.
- Experienced in onshore - offshore development model.
- Excellent communication, interpersonal, analytical skills and ability to perform as part of a team.
TECHNICAL SKILLS:
Data Warehousing: IBM Infosphere DataStage/Ascential Data Stage 8.x/7.x/6.x/5.x (Designer, Director, manager, Administrator), PX, Quality stage, Integrity, MetaRecon, MetaStage, MetaBrokers, Data Mining, Data mart, Metadata, OLAP, OLTP.
Databases: Oracle 10g/9i/8i/8.0/7.0, Sybase IQ 11.0/12.0,MS SQL Server 6.5/7.0/2000/2005, Teradata 5.0/6.0,DB2UDB, MS Access 7.0/ 97/2000.MYSQL,POSTGRESSQL,Teradata 14.0
Tools: Erwin 4.1/3.5, Data Reports, Seagate Crystal Reports 6.x/5.x/4.x/3.x, SQR 3.x, SQL*Loader, Developer 2000 (Forms 4.5/5.0, Reports 2.5/3.0), MS Access Reports, TOAD
Programming: SQL, PL/SQL, ANSI SQL, Transact SQL, SQL*Plus 3.3/8.0, TOAD, C, C++, Unix Shell ScriptingOthers: HTML 4.0, ASP 3.0/2.0, DHTML, MS Excel, MS Office, MS-Project.
Environment: Sun Solaris 2.6/2.7/2.8, HP-UX, IBM AIX 4.2/4.3, MS DOS 6.22, Win 3.x/95/98/2000, Win NT 4.0, SCO Unix.
PROFESSIONAL EXPERIENCE:
Confidential, Eden Prairie, MN
DataStage Developer
Responsibilities:
- Monthly data collections are captured and processed correctly into UDW for further analysis.
- Involved in gathering business requirements for existing jobs and for the new development processes.
- Created the jobs in data stage designer & performed unit testing.
- Worked with various parallel stages like look-up, join, transformer, modify, Datasets, Teradata Connector etc.
- Imported and Exported Jobs, table definitions and migrated successfully to SIT &UAT.
- Worked with DataStage Director to run, schedule, monitor and view logs for jobs and to full fill the test requirements.
- Supervised and carried out successful monthly enhancements to the existing system.
- Reporting involved regular weekly and monthly reports and reflects change to the existing reports according to the business need.
- Involved in creating TWS for Scheduling the Job dependencies and Timings.
Environment: DataStage 8.5, Teradata 14.0, SQL Server, Shell Scripts, Tivoli, SVN
Confidential, Rockville, M D
DataStage Developer
Responsibilities:- Used the DataStage Designer to develop processes for extracting, cleansing, transforming and loading data into the sequential files.
- Worked with different Stages, which includes Sequential File, Dataset, XML Input, XML Output, Copy, Lookup, Join, Transformer, Sort, Aggregator, Remove Duplicate, Filter, Column Export, SCD, CDC, Funnel, Oracle OCI, and RDBMS Stages.
- Designed jobs which populated the tables using column generator, surrogate key, join, Oracle enterprise stage and Peek Stage for debugging purpose.
- Creation of Shared containers so that it can be used by other modules of the plan.
- Exporting the jobs to Testing Environment from Development and then to Production.
- Worked closely with Project lead/Manager, Architects, and Data Modelers, System Analyst to understand the business process and functional requirements.
- Using the stages like Change-Capture, Modify, Look-up, Slowly changing Dimension, Remove Duplicate, filter, Sort in modifying the jobs already developed to improve the performance and to meet the requirements.
- Developed DataStage job sequences used the User Activity Variables, Job Activity, Wait for File stages.
- Extensively used IBM Information Server Director for scheduling the job to run in batch, emailing and online production support for troubleshooting from LOG files.
- Worked extensively with reading data from different feeds; flat files, Oracle 9i, DB2 and loading the data into Oracle 10g Data mart.
- Exported and imported the Data stage jobs between the production and the development servers
- Involved in S.I.T (System Integration and Testing) and U.A.T (User Acceptance Testing).
- Used quality stage jobs to validate the quality of output data generated.
- Extensively used SQL coding for overriding the generated SQL in DataStage and also tested the data loaded into the data base.
- Used Shell scripts for automating data load process and for scheduling DS jobs.
- Involved in writing Shell scripts for reading parameters from files, invoking DataStage jobs, and FTP files to specific locations.
- Implemented complex logics in Transformer stage like date validation, use of stage variables.
- Involved in release process, which include exporting jobs, preparing release notes, uploading the code to Rational Clear case, importing jobs to test environment and compiling using multi job compiling option in the DS Manager.
- Involved in troubleshooting, Performance tuning and Performance monitoring.
- Effectively worked with tuning SQL queries and PL/SQL in order to improve the performance of the jobs
- Worked with IBM support to fix various bugs by applying the patches in the DataStage Client machines.
- Extensively worked in bug fixing with various issues during Integration and User Acceptance Testing and worked for on call support to provide immediate fixes.
- Participated in Daily &Weekly status meetings, and conducting internal and external reviews as well as formal walkthroughs among various teams, and documenting the proceedings.
Environment: IBM Information Server Websphere DataStage 8.01/EE 7.5.2(Ascential DataStage), Parallel Extender, Oracle 10g/11g, Toad 9.1,DB2, Flat Files, XML, SQL, PL/SQL, Rational Clear Case &Clear Quest, Sun Solaris 5.10
Confidential, Franklin Lakes, NJ
ETL Developer
Responsibilities:
- Used the IBM InfoSphere DataStage and QualityStage 8.7 to develop processes for extracting, cleansing, Transforming, integrating, and loading data into data warehouse database.
- Used DataStage Parallel Extender parallel jobs for improving the performance of jobs.
- Implementing Industry ETL standards and best practices, performance tuning during designing the Datastage Jobs.
- Developed Parallel jobs using Parallel stages like: Dataset, Sequential file, Funnel, Filter, Modify, Merge, Join, Lookup, Transformer and External Source Stage.
- Extensively used processing stages like the Lookup stage to perform lookup operations based on the various target tables, Modify stage to alter the record schema of the input data set.
- Modified the Data stage jobs to increase performance using various performance tuning techniques.
- Involved in code migration and code review sessions as part of migration plans.
- Involved in migration process from DEV to Test and then to PRD.
- Used director to run various different loads into the warehouse and also involved in working with various issued occurred in this process.
- Responsible for knowledge transfer to the operations team.
Environment: IBM Info Sphere DataStage 8.7/8.1 (DataStage and Quality Stage), Oracle 10g/9i, SQL, PL/SQL, SQL Developer.
Confidential, Louisville, KY
ETL Consultant
Responsibilities:
- Used the IBM Info Sphere DataStage 8.5 to develop processes for extracting, cleansing,
- Transforming, integrating, and loading data into data warehouse database.
- Used DataStage Parallel Extender parallel jobs for improving the performance of jobs.
- Implementing Industry ETL standards and standard practices, performance tuning during designing the DataStage Jobs.
- Developed Parallel jobs using Parallel stages like: Dataset, Sequential file, Funnel, Filter, Modify, Merge, Join, Lookup, Transformer and External Source Stage.
- Extensively used processing stages like the Lookup stage to perform lookup operations based on the various target tables, Modify stage to alter the record schema of the input data set.
- Extensively Worked on IBM InfoSphere Classic Federation Server which provides SQL access to mainframe databases and files without mainframes programming.
- Mapped Logical relational table structures to existing physical mainframes databases and files.
- Used DataStage Director to validate schedule run and monitor the data stage jobs.
- Created Sequence jobs to control the flow of jobs and their dependencies
- Used the Data Stage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions.
- Designed Job Documentation and Installation and Back out Documentation.
- Done data validations for the reports generated and hands on experience with Extract Transform and Load jobs to move data between various RDBMS.
Environment: IBM InfoSphere DataStage 8.5(Datastage and Quality stage), Sql Server 2008 R2, IBM DB2 9.1, SQL, PL/SQL, IBM InfoSphere Classic Federation Server
Confidential
ETL Data stage Developer
Responsibilities:
- Data Warehouse is implemented using sequential files from various Source Systems.
- Meeting with Source system users & Business Users to create data share agreements and BI requirements.
- Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
- Involved in Designing Parallel Extender Jobs .
- DataStage Jobs version control and Migration using Version management & DS-Manager tools.
- Perform data manipulation using BASIC functions and DataStage transforms
- Define reference lookups and aggregations.
- Define constraints and derivations.
- Create master controlling sequencer jobs using the DataStage Job Sequencer
- Create and use DataStage Shared Containers, Local Containers for DS jobs and retrieving Error log information.
- Design, build, and manage complex data integration and load process
- Developed UNIX scripts to automate the Data Load processes to the target Data warehouse.
- Involved in creating Control M for scheduling the Job dependencies and Timings.
Environment: Ascential DataStage 7.0/7.5 (Parallel Extender & Server), Oracle 9i, DB2 UDB, Teradata, PL/SQL, AutoSys, Erwin 4.2, SQL Developer, Business objects 5.1, Shell Scripts,, HP Unix, Windows XP
Confidential
Oracle Developer
Responsibilities:
- Responsible for creating the database tables, indexes, constraints in Oracle8i.
- Played active role in tuning the oracle database queries using indexes, e xplain p lan, tkprof and o ptimizer hints.
- Design & development of user interface using oracle forms.
- Developed packages, stored procedures, functions, triggers, views and cursors using PL/SQL.
- Created test specification & test servers to simulate large transactions.
Environment: Oracle 8i, SQL, PL/SQL, Unix, Windows NT.
Confidential
Responsibilities:
- Performed analysis, database design and development.
- Provided back-end support for customized forms like customer and supplier maintenance, bill, receipt, letter of credit, invoice, debit and credit notes.
- Developed PL/SQL packages to monitor revenue earnings and expenses and to maintain the general ledger of the organization.
- Developed stored procedures and functions using PL/SQL for complex updates and audit trails.
- Wrote database triggers for audit and data validation.
- Designed the entity-relationship model and normalized database.
- Conducted re-sizing of data files, managed table spaces and data files.
Environment: Oracle 8i, SQL, PL/SQL, Unix and Windows NT.
