Sr. Datastage Developer Resume
Chicago, IL
SUMMARY:
- I have ten years of experience with ETL DataStage development, Data mapping and unit testing code.
- He has strong experience extracting data from heterogeneous sources like SQL Server, T - SQL, Oracle, DB2 and Teradata.
- Confidential has worked extensively with various versions of DataStage and has also worked on two upgrade projects.
- He has excellent experience working with Unix Shell Scripting, Data warehouse, OLAP, Star Schema, Snowflake Schema, Dimensional and flat tables.
- He was technically evaluated and he has been recommended for senior DataStage role.
- He has good communications, interpersonal and leadership skills.
- He is local to IL and is available for an immediate interview.
- Strong understanding of the principles of DW using Fact tables, Dimension tables, Star and Snowflake Schema modeling.
- Detailed and problem-solving approach in DataStage, jobs and addressing production issues such as performance tuning and enhancement.
- Diverse knowledge of data dependencies using metadata of DataStage and preparing job sequences for existing jobs to facilitate scheduling of multiple jobs.
- Proficient with impact analysis, process analysis on metadata available in metastage repository to investigate history of data and potential impact of changing data.
TECHNICAL SKILLS:
Data Warehousing: IBM WebSphere DataStage 11.5/9.5/8.5/8.18.0.1/7.5/7.0 (Manager, Designer, Director, Administrator), QualityStage 8.1/8.0,IBM Metadata Workbench 8.5/Ascential MetaStage 7.5, Information Analyzer 8.5/8.1.1, Cognos 7.0/6.0/5.X, Data Mining, OLAP, OLTP, SQL*Plus, SQL*Loader
Data Modeling: ERwin 4.0/3.5.2/3. x, SQL Server Management Studio 2008, Oracle Designer
Reporting Tools: Data Reports, Crystal Reports 7.0/6.x/5.x/4.x/3.x, Cognos, Developer 2000 (Forms 4.5/5.0, Reports 2.5/3.0), Business Objects 6.5
Databases: Teradata, Oracle 10g/9i/8i/8.0/7.3, UDB DB2 LUW 9.7/9.5/9.1, Sybase, SQL Server 2008, MS Access, Excel
UNIX Tools: C Shell, K Shell, Bourne Shell, Osh Shell
GUI: Developer 2000, Forms 6i, Reports 6i, Visual Basic 6.0/5.0/4.0/3.0 , FrontPage 97/98/ 2000, MS Access 97/2000, Excel, PowerPoint, Visual Interdev 6.5/6.0, Visual Age 3.5
Languages: C/C++, C#, VB, ASP, VB Script, JAVA Script, UML, HTML, XML, SQL, T-SQL, PL/SQL
Others: Crystal Reports 8.5/8.0/7.0/4.5/5.0 , Siebel, MS Access Reports 97/7.0, TCP/IP
EXPERIENCE:
Confidential, Chicago, IL
Sr. Datastage Developer
Responsibilities:
- Create Data Integration Jobs in Data stage including sequence and parallel jobs using different stages like Transformer, Aggregator, Lookup, Lookup Sets, Join, Sort, Copy, Merge, Funnel, Modify, Checksum, Filter, defining Parameter Sets and connectors for Database and flat files etc
- Analyzing the data generated by the business process, defining the granularity, source to target mapping of the data elements, creating Indexes and Aggregate tables for the data warehouse design and development.
- Write and debug UNIX Korn/Bash shell scripts and handle FTP, SFTP processes.
- Utilized DataStage director and job score to monitor, view log, handle unwanted warning messages, analyze performance of individual stages and run jobs.
- Monitoring and scheduling ETL Datastage Jobs using Tivoli Work Scheduler and UNIX wrapper scripts.
- Conducted performance tuning of ETL jobs via SQL queries, data connections, configuration files, job parameters and environment variables.
- Work on System Enhancements, Change Request Tickets and provide Production Support.
- Developed version control to maintain version and history of jobs and scripts using GIThub migration tool.
- Work in the Scrum team and delivered the task on time every sprint.
IT Environment: IBM DataStage 11.5, DB2, SQL, Oracle, UNIX Shell Scripts, GITHUB, Rally, Tivoli scheduler
Confidential, Chicago, IL
Sr. Datastage Lead Analyst
Responsibilities:
- Avoka is a project where the process involved in servicing and verifying suspect revolving credit applications via digital device.
- Analyzed user requirements from business standpoint and defined functional specifications and source to target mapping documents.
- Parsed and transformed XML, Json input data from HDW center and loaded data in database.
- Used new Hierarchical stage with assembly editor for converting XML, Json data coming has inputs.
- Extensively worked with Join, Look up (Normal and Sparse) and CDC stages.
- Extensively worked with sequential file, dataset, file set and look up file set stages.
- Extensively used Parallel Stages like Row Generator, Column Generator, Head, and Peek for development and de-bugging purposes.
- Developed UNIX shell scripts for validating and archiving the source files.
- Tuned the DataStage repository and jobs for optimum performance and Parameterized DataStage jobs to allow portability and flexibility during runtime
- Performed Impact Analysis for the existing systems when changes are planned.
- Responsible for creation of UAT and deployment plans of the deliverables.
- Utilized Control-M scheduler to schedule jobs based on different dependency checks such as incoming file and previous job runs
- Managing the team onsite/offshore model.
- Effectively managing and delivering the ETL solutions in Agile model.
IT Environment: IBM DataStage 11.5, DB2, SQL, Oracle, UNIX Shell Scripts, Control-M.
Confidential, Albany, NY
Sr. Datastage Developer
Responsibilities:
- Performed the entire project life cycle from Analysis, Development, Testing, Production and end user support, worked closely with business users and Platform Team while gathering requirements.
- Responsible for the architectural ETL design and obtaining sign off from the business.
- Followed design and Naming Standards to ensure consistency throughout the project.
- Worked on Eligibility, Enrollment, and Effectuation and Application line of business.
- Experienced in development and debugging of jobs using stages like Peek, Head & Tail Stage, Row generator stage, Column generator stage, Sample Stage
- Generated Surrogate Keys for composite attributes while loading the data into the data warehouse.
- Imported Metadata from the source database. Imported metadata definitions into the repository. Exported and imported Data Stage components.
- Extracted data from multiple sources like DB2 and from Flat files, Oracle etc. Made the required transformations as per business and loaded the data into target which is Oracle.
- Developed Job Sequences and batches/routines, edited the job control to have jobs run in sequence.
- Performed troubleshooting and tuning of Data Stage Jobs for better performance.
- Implemented the CDC logic using change capture stage to maintain the history of customers.
- Incorporated environment variables and parameter set in all DataStage PX jobs to maintain consistency across different environment (development, test and production).
- Developed UNIX shell scripts to validate the source files.
- Carried out unit testing of all ETL jobs and migrated to test and production environment.
IT Environment: IBM DataStage PX, DB2, SQL, Oracle, UNIX Shell Scripts, Serena.
Confidential
Sr. DataStage Developer
Responsibilities:
- Enterprise pharmacy Data Storage project is to load the ADW database to create an integrated data resource for pharmacy analytics, Enhance the extract of data from EDW for MedeAnalytics to include additional data on pharmacy claims.
- Designed mappings using DataStage designer from source to staging and staging to data warehouse.
- Created complex ETL jobs to implement the business logic based on requirements.
- Implemented the CDC logic using change capture stage to maintain the history of customers.
- Incorporated environment variables and parameter set in all DataStage PX jobs to maintain consistency across different environment (development, test and production).
- Developed UNIX shell scripts to validate the source files.
- Utilized DataStage director and job score to monitor, view log, handle unwanted warning messages, analyze performance of individual stages and run jobs.
- Developed version control to maintain version and history of jobs and scripts using Serena migration tool.
- Carried out unit testing of all ETL jobs and migrated to test and production environment.
- Utilized Zena scheduler to schedule jobs based on different dependency checks such as incoming file and previous job runs.
- Performed knowledge transfer to client team members and led the whole project in all phases.
- Set up run books to capture job frequency information.
IT Environment: IBM DataStage PX, DB2, SQL, Teradata, UNIX Shell Scripts, Serena, Zena scheduler.
Confidential
Sr. DataStage Developer
Responsibilities:
- Design mappings using DataStage designer from source to staging and staging to data warehouse.
- Migrate existing jobs using the IBM Infosphere connector migration tool and modify based on the requirement.
- Integrate data from various sources such as flat files, SQL and Teradata database sources.
- Improve performance using correct partitioning method.
- Create sequence jobs for batch processing.
- Utilize DataStage director and job score to monitor, view log, handle unwanted warning messages, analyze performance of individual stages and run jobs.
- Establish complex ETL jobs to implement the business logic based on requirements.
- Carry out unit testing of all ETL jobs and migrate to test and production environment.
- Perform design review and code review for approvals.
- Work with Tivoli scheduler to schedule jobs based on different dependency checks such as incoming file and previous job runs.
IT Environment: IBM DataStage V 8.7, IBM Infosphere, SQL Server, TeraData, UNIX Shell Scripts, Tivoli
Confidential
Senior DataStage Developer
Responsibilities:
- Designed mappings using DataStage designer from source to staging and staging to data warehouse.
- Created complex ETL jobs to implement the business logic based on requirements.
- Implemented the CDC logic using change capture stage to maintain the history of customers.
- Established the horizontal pivot logic for moving of data with a row to multiple rows.
- Incorporated environment variables and parameter set in all DataStage PX jobs to maintain consistency across different environment (development, test and production).
- Configured UNIX shell scripts to run jobs using dsjob utility.
- Utilized DataStage director and job score to monitor, view log, handle unwanted warning messages, analyze performance of individual stages and run jobs.
- Carried out unit testing of all ETL jobs and migrated to test and production environment.
- Utilized Tivoli scheduler to schedule jobs based on different dependency checks such as incoming file and previous job runs.
- Performed knowledge transfer to client team members and led the whole project in all phases.
- Set up run books to capture job frequency information.
IT Environment: IBM DataStage PX, DB2, VB script, UNIX Shell Scripts, Windows XP
Confidential
Senior DataStage Developer
Responsibilities:
- Provided design of mappings using DataStage designer from source to staging and staging to data warehouse.
- Utilized DataStage to extract, transform and load from different input sources such as flat files, DB2 and XML files into DB2 database.
- Developed job templates, shared components and DSfunction to reduce the level of effort for future development.
- Designed DataStage master sequence using job activities stages in job sequencer to call DataStage PX jobs to maximize performance.
- Worked with DataStage director and job score to monitor, view log, handle unwanted warning messages, analyze performance of individual stages and run jobs.
- Created complex ETL jobs to implement the business logic based on requirements.
- Incorporated environment variables ($PROJDEF) in all DataStage PX jobs to maintain consistency across different environments (development, test and production).
- Established shared containers to make common components available throughout the project.
- Implemented the CDC logic using transformer stage to maintain the history of customers.
- Improved performance of jobs by using correct partition method.
- Prepared unit test cases to validate all business rule scenarios in DataSatge PX jobs.
IT Environment: IBM DataStage V8.7/8.5, DB2, Infosphere Optim, XML Spy, VB script, Shell Scripts, Windows XP, Sun-Solaris 9
Confidential
Senior DataStage Developer
Responsibilities:
- Provided design of mappings using DataStage Designer from source to staging and staging to data warehouse.
- Integrated data from various sources such as flat files and database sources.
- Improved performance using correct partitioning method.
- Created sequence jobs for batch processing.
- Utilized DataStage Director and job score to monitor, view log, handle unwanted warning messages, analyze performance of individual stages and run jobs.
- Designed complex ETL jobs to implement the business logic based on requirements.
- Established UNIX shell scripts to run jobs using dsjob utility.
- Worked with QualityStage to standardize address data, area data, name data for different countries based on the rule sets being used.
- Discovered duplicates and unique records using UnDuplicate match stage.
- Investigated the source data using investigate stage.
- Survived the best of breed records using survive stage in QualityStage.
- Analyzed source data files and tables using information analyzer column analysis.
- Generated column summary and column properties in pdf format using information analyzer tool.
- Moved assets from one environment to other using istool utility.
- Conducted performance tuning of ETL jobs via SQL queries, data connections, configuration files, job parameters and environment variables.
- Performed knowledge transfer to client team members and led the whole project in all phases.
- Utilized the Tivoli scheduler to schedule jobs based on different dependency checks such as incoming file and previous job runs.
- Set up run books to capture job frequency information.
IT Environment: IBM DataStage V8.5/8.1.1,QualityStage 8.5, Information Analyzer 8.5/8.1.1 Oracle10g, WAS 6.5, Shell Scripts, Windows XP, Sun-Solaris 9
Confidential
Senior DataStage Developer
Responsibilities:
- Analyzed data quality criteria for different objects such as routing, rate routing, SKF and TCP.
- Upgraded the DataStage 7.5 server and parallel jobs to DataStage 8.0 jobs for SAP ECC 6.0.
- Designed the simple and complex ETL & Quality Stage jobs to validate the Data Quality criteria’s.
- Utilized multiple stages such as SAP ABAP R/3 extract, sequential file, transformer, aggregator, join, lookup, sort and filter during ETL data quality development.
- Resolved performance issues while extracting data from SAP and loading data into sequential file and SQL Server database tables.
- Managed repository Metadata from DataStage manager.
- Executed criteria on general ledger and finance controlling objects such as vendor tolerance, customer tolerance, reversals, exchange rate types, profit center and cost center.
- Performed US address standardization using QualityStage standardize stage and US address and area rule sets.
- Identified duplicate matches by creating proper match specification and using that in QualityStage unduplicate stage.
- Investigated source data using QualityStage investigate stage.
- Devised different module result tables in SQL Server database to capture data quality errors using QualityStage investigate stage.
- Worked with DataStage director in running the solution, testing and debugging its components and monitoring resulting executables.
- Established and maintained sequencer jobs.
- Set up business objects data quality report using Crystal Reports for statistical key figure object and vendor daily object.
- Utilized VSS version control system to check the dsx code frequently based on a weekly frequency or an on demand basis frequency.
- Worked with LDAP registration to create a special group such as data quality developer that was assigned to an operating system group with access to DataStage server folders, database roles with access to source and target SQL Server tables and access to DataStage and QualityStage tool.
- Executed quality criteria testing on result tables and related tables using SQL Server business intelligence studio.
- Carried out unit testing and integration on the server.
IT Environment: Information Server 8.0, 7.5 X2 (Administrator, Designer, Manager, Director), QualityStage 8.0, VSS, SAP ECC 6.0, SAP R/3 4.7, LDAP, SQL Server 2005, Business Objects XI, Windows 2003
