Sr. Stage Developer, Resume
Michigan, MI
SUMMARY
- Over 9 + years of experience in System Analysis, Design and Development In the fields of Warehousing, Integration, Migration and Developing Client server application.
- 9 years of strong experience on Extraction, Transformation and Loading (ETL) processes from various sources into Warehouse/Marts using InfoSphere stage and Qualitystage 11.3/9.1/8.7/8.5/8.1/7.5.2 using components such as stage Designer, stage Manager, Dstage Director and Dstage Administrator clients.
- Experienced in FastTrack and Information Analyzer, Metad Workbench
- Certified Solution Developer - - Web sphere Stage Enterprise Edition V8.0.1
- Expertise in Administration of InfoSphere/Websphere Information Server Tools like Stage, QualityStage, Balanced Optimization and Information Server Manager.
- Experience in profiling with the Information analyzer.
- Strong experience in designing of Server jobs, Parallel jobs, Job Sequencers and Batch Jobs.
- Experienced in Modeling, Star Schema/Snowflake Schema modeling, Fact & Dimensions tables.
- Expertise in forward/ reverse engineering, using tools Erwin.
- Worked on Mapping Specifications using Fast Track - Foundation Tools from InfoSphere Information Server
- Experience in designing jobs by using XML stages and loading XML Schema Definitions (XSD).
- Resolving bottlenecks while developing the Source-Target Mapping for the Dimensions and Fact Tables.
- Extensively used Parallel Extender to load into warehouse with different techniques like Pipeline and Partition in MPP environment.
- Experience in UNIX Shell scripting
- Hands on experience in writing, testing and implementation of the Functions, Procedures, Triggers, Packages at base level using PL/SQL.
- Having experience calling Stored Procedures and shell scripts in D Stage jobs.
- Experience in Performance Tuning and Optimization of Parallel Jobs and Server Jobs.
- Experienced with Quality stage using Investigation, standardization, matching and survivorship stages.
- Involved in Creating and verifying Quality stage jobs for Match and un duplication
- Experience in integration of various d sources like Oracle, SQL Server, Sybase, Terad, and DB2/UDB
- Strong knowledge in OLTP/OLAP Systems and ODS models.
- Experienced in job scheduling tool like Autosys, contol-m and cron tab
- Experience working on multiple platforms such as Windows NT/2000, UNIX (Sun Solaris, AIX, HP), LINUX.
- Possess strong ability to quickly adapt to new applications and having Excellent interpersonal and communication skills.
- Able to Work under pressure to meet job requirements and deadlines highly driven and self-motivated with sound business judgment and strong work ethics.
TECHNICAL SKILLS
- ETL: Info sphere Dstage and Qualitystage 11.3/9.1/ 8.7/8.1/8.0.1 , Ascential D stage EE 7.5.2/7.5.1/7.0 ( Web sphere), Quality stage, Information Analyzer, SSIS,
- Base/RDBMS: Oracle 11g/10g/9i/8i, SQL Server 2008/2012,DB2/UDB, Terad,
- Languages: SQL, PL/SQL, Unix Shell scripting,
- Tools: DB Visualizer 9.2.4, studio version 3.1.1,Toad, Brio Query Explorer 6.5.2, Erwin, Visio, MS Office products,
- OLAP/Reporting: Business Objects X1,Cognos,
- Web Technology: HTML, XML,Webservices,
- Methodologies: Dimensional Modeling, E-R Modeling,
- Environment: UNIX AIX 4.2, LINUX, Windows 2000/NT/XP, MS-DOS,
PROFESSIONAL EXPERIENCE
Sr. stage developer,Michigan, MI,
Responsibilities:
- Involved in requirement gathering, analysis and study of existing relationship between Multiple Agencies and SIGMA systems.
- Extensively using Stage designer for designing Parallel jobs and performed complex mappings, Transformations and Aggregate based on user specifications.
- Designed jobs using different processing stages like Transformer, Aggregator, lookup, funnel, filter.
- Extensively used the Debugging stages Row generator, column generator, peek stages for unit testing.
- Used the Schema Library Manager to import and update XSD schemas.
- Worked the xml hierarchical stage to generate XML files.
- Designed the schema and validation jobs for I/O XML files.
- Applied performance tuning techniques to handle large XML files
- Developed the automation jobs by using the Job Sequences.
- Written the sftp scripts and incorporated in the Master sequences to move the generated and validated files to client locations.
- Added, deleted and setupStage projects and managed users from stage administrator
- Used Stage Administrator for setting the Environment variables and parameters.
- Designed and customized models for warehouse supporting from multiple sources on real time
- Worked on developing DDL’s and created stage tables to maintain the Source .
- Designed and developed ETL processes using Stage designer to load from Oracle, Sybase, Flat Files and XML files to staging base and from staging to the XML files.
- Involved in bug fixing for the existing stage codes.
- Prepared High level and Low level Design documents to be reviewed by client.
- Created unit test cases and documented them for approvals.
- Worked on a Migration of the projects from Development to System Testing Environment.
- Prepared migration process documents to move the jobs from development to system testing and then to production.
Environment: InfoSphere Stage and QualityStage 11.3, Information analyzer, InfoSphere Information Governance Clog, Oracle 11g, SQL Server, Sybase, Terad, LINUX, Shell scripting.
Sr. Lead Programmer,Confidential, PA,
Responsibilities:
- Worked with Quest Customers to gather products details and enter in to APEX application (Tracking informatics Product System)
- Worked on stage Server and Parallel jobs using Sequential file, Hash file, Lookup file set, xml i/p, xml o/p file stages, Transformer, Sort, filter, Oracle OCI and oracle connector stages.
- Worked on developing job sequences.
- Created parameter sets to group Stage job parameters and store default values in files to make sequence jobs
- Developed ETL batch jobs by adding dsjobs and job sequences from the director client.
- Worked on editing the scripts and added new jobs that has to be run
- Scheduled the run scripts on a daily, weekly and monthly basis through Crontab.
Environment: InfoSphere Stage and QualityStage 9.1, Oracle 11g, linux, APEX.
Lead/Sr. ETL Developer,Confidential, CA
Responsibilities:
- The department’s responsibilities range from providing UCOP desktop and voice support services to developing and maintaining major UC business systems, to leading University IT policy development.
- Worked on multiple projects in all the student and Employee subject areas.
- Involved with Business users and Architects from different teams to implement ETL Frame Work using Stage Server/PX combination of jobs.
- Involved in understanding the Business Process and Coordinating with Business users, Modelers and DB A's to create Dimension and Fact tables based on the existing Warehouse design.
- Upgraded from Websphere Information Server 8.0.1 to Infosphere Information Server 9.1 on DEV, SIT and PROD.
- Installation and configuration of Information Server version 9.1 on DEV, SIT and PROD servers.
- Installation of Information Server Patches for Service, Engine and Client Tiers.
- Configured Infosphere stage and Qualitystage, created users, groups, credential mappings and assigned administrator and user roles, privileges in different environments.
- Configured Environment variables, security, and connectivity. Tuned the deployment for performance, and backed up the
- Added, deleted and setup Stage projects from stage administrator...
- Worked on QualityStage stages such as investigate, standardize, match and survive for quality and profiling issues during the designing.
- Used QualityStage to ensure consistency, removing anomalies and spelling errors of the source information before being delivered for further processing.
- Sourced from various sources like DB2 UDB, XML Files,Flat Files, cobol and CSV files and loaded to target DB2 UDB ( Confidential Warehouse).
- Extracted flat files using sequential file stage, handled Main frame Cobol files with Complex Flat file stage and xml’s with the Hierarchical stage.
- Created Configuration files to increase parallelism of Stage jobs. worked on Installation of Information Server Patches for Service, Engine and Client Tiers
- Configured Infosphere stage and Qualitystage, created users, groups, credential mappings and assigned administrator and user roles, privileges in different environments.
- Worked on Meta Asset Manager to import metad from various base sources and published them to centralized repository.
- Designed jobs using different parallel job stages such as sequential,complex flat file, Join, Merge, Lookup, Remove Duplicates, Filter, set, Lookup File Set, Change Capture, Switch, Modify, and Aggregator, Funnel, FTP, Sort, Transformer, DB2 Enterprise, DB2 API, Sybase OC stages and oracle and db2 connectors.
- Extensively designed, developed and implemented Parallel Extender jobs using Parallel Processing (Pipeline and partition parallelism), Restart ability techniques to improve job performance while working with bulk sources.
- Worked on Real time stages (XML i/o stages)
- Used Information Analyzer for Column Analysis, Primary Key Analysis and Foreign Key Analysis.
- Analyzed the existing informational sources and methods using Information Analyzer to identify problem areas and make recommendations for improvement. This required a detailed understanding of the sources and researching possible solutions.
- Developed Job Sequencers with restart capability for the designed jobs using Job Activity, Exec Command, E-Mail Notification Activities and Triggers.
- Scheduled the Master sequence jobs using control-m
- Worked on SCP techniques to transfer files in between DS servers.
- Prepared the Implementation plan for the code migration to QA/Production.
- Supported through Production for successful execution and on call support .
- Extensively used Stage Director to Monitor and check the run statistics of the Jobs.
- Performed SQL tuning techniques to improve the base read performance through Stage Jobs and used Frame Work approach to improve transformation and loading steps.
- Worked closely with Quality Analysts and Business Users for accuracy and consistency after table loads.
Environment: InfoSphere Stage and QualityStage 9.1/8.0.1, Information Analyzer, Meta Workbench, DB2, SQL Server, Sybase, LINUX, BO XI 3.0, DbVisualizer 8.0 stage Developer,
Confidential, Charlotte, NC
Responsibilities:
- Involved in the design and development of Warehouse
- Involved in jobs and analyzing scope of application, defining relationship within & between groups of star schema, snow flake etc.
- Worked closely with database administrator to understand the business process of the warehouse model.
- Extensively worked with DB2 source systems.
- Involved in writing UNIX shell Scripts for file validation and scheduling Stage jobs.
- Worked closely with base architect during the design and development of ETL technical specification document
- Developed Stage jobs for extraction transformation and loading of the from source systems
- Extensively worked with Parallel Extender using Parallel Processing (Pipeline and partition parallelism) techniques to improve job performance while working with bulk sources
- Developed and reviewed the Standardization, Scrubbing, Matching and Survivorship rules in order to get best of the breed record.
- Extensively used Sequential, Hashed, Join, Merge, Look up, Transformer , Aggregator and DB2 UDB Stages during ETL development
- Having experience in designing jobs by using XML stages
- Having experience in loading XML Schema Definitions (XSD).
- Experience in using PL/SQL Functions, stored procedures to load the into marts.
- Used Information Analyzer for column analysis, primary key analysis and foreign key analysis.
- Used Stage Administrator to create Repository, User groups, Users and managed users by setting up their profiles and privileges.
- Used Stage Designer to develop processes for extracting, cleansing, transforming, integrating and loading into Data Warehouse database.
- Performed Import and Export of Stage components and table definitions.
- Used Stage Director to Run and Monitor the Jobs performed, automation of Job Control using Batch logic to execute and schedule various Stage jobs
- Performed the Unit testing for jobs developed to ensure that it meets the requirements and documented unit test plan and test case scenarios of developed code.
- Documented the Warehouse development process and performed knowledge transfer to Business Intelligence developer
Environment: DataStage 8.1/7.5.2, Quality stage, DB2/UDB, Oracle9i/10g, Windows XP, XML, XSD, AIX, Brio Query Explorer 6.5.2.1,SQL,PL/SQL, C shell, UNIX shell scripts.