We provide IT Staff Augmentation Services!

Senior Infosphere Data Governance Architect Resume

4.00/5 (Submit Your Rating)

SUMMARY

  • IBM Certified Solution Developer with over 10 years of experience performing various roles with IBM InfoSphere Suite tools in India, Australia and USA.
  • Awarded “Champion of 2009” in IBM for outstanding performance in the year 2009.
  • Expertise in end to end IBM InfoSphere suite solution design and implementation including but not limited to Profiling/Rulesets using Profile Stage/Information Analyzer, ETL using DataStage, Data Quality using QualityStage, Business Glossary, Data Lineage/Business Lineage using Metadata Workbench, Information Governance Catalog, etc
  • Worked in various roles in variety of projects like Data Governance, Data Quality, Data Warehousing, Data Integration, Data Migration, Data Quality, Production Support, SAP Migration using DataStage R3 plugins,etc
  • Implemented an end to end Governance solution and established Data Quality Standards and Metrics across the Enterprise.
  • Sound conceptual understanding of relational database internals and working experience with Oracle, MS SQL Server, SAP R/3, and query languages.
  • Published documents in IBM Knowledge Portal on using SAP R3 packs and addressing challenges.
  • Created an automated Data Quality solution using Information Analyzer, DataStage, and Xmeta which improved performance by 600 times.
  • Knowledge of ETL best practices and industry standards, extensive working knowledge of DataStage Director, and expertise in DataStage issue resolution, debugging, and application performance tuning.
  • Experience in developing QualityStage jobs on DataStage 8.5/8.1 Enterprise Edition.
  • Trained internal/external clients on IBM DataStage, Information Analyzer & SAP R/3 packs.
  • Adept in resolving data transformation issues, creating and implementing custom operators, build operators, and wrappers, designing server and parallel routines, and extensive knowledge of shared containers and re - usable components in DataStage, with expertise in developing and using scripts in DataStage job-control and command line operators through Orchestrate shell.
  • Broad understanding of dimensional data modeling such as star schema, snow flake schema, fact, and dimension table design, and experience with ERWIN Data Modelling Tool and InfoSphere Data Architect.
  • Expertise in all material master transactions on SAP related to products domain and can effectively communicate between DataStage and SAP.

TECHNICAL SKILLS

OPERATING SYSTEMS: Unix, SCO Unix, IBM AIX 5.2/6.1 RedHat Linux 8, MS DOS, Windows 95/ 98/ 2000/ XP/ 2003/ 2008

ERPs: SAP R/3 4.7 EE/ ECC 6.0, SAP R/3 6.0/ ECC 7.0.

LANG/ TECH: C, SQL, PL/SQL.

DATABASES: Oracle 10g/9i/ 8i, MS SQL Server 2008/2005/2000 , Teradata, DB 2 8.0./9.1/9.5 , Informix 11.7.

TOOLS: IBM InfoSphere Information Server DataStage 11.3/9.1/8.7/8.5/8.1/8.0/7.51 A/7.5, Information Governance Catalog 11.3, QualityStage 9.1/8.5/8.1/8.0 , Information Analyzer 11.3.1/ 9.1/8.5/8.1/8.0 , ProfileStage 7.5, Metadata Workbench 9.1/8.5/8.1,Business Glossary 9.1/8.5/8.1,FastTrack 8.5, Business Objects XI, SQL*Loader, Import/Export, Erwin Data Modeler, IBM Cognos Data Manager 8, HP Application Lifecycle Management 11.0.

Scheduling Tools: CA Autosys.

SAP PACKS: SAP R/3 PACKS 4.7/5.0/6.0, RTL Components SAP R/3 7.0

XML PACKS: Xml pack in InfoSphere 8.1

PROFESSIONAL EXPERIENCE

Confidential

Senior InfoSphere Data Governance Architect

Responsibilities:

  • Installed and Configured of the IIS suite with all components as part of the POC.
  • Responsible for running rollups and fix packs for known product defects.
  • Configured connections to DashDB and other legacy systems.
  • Created connection between IDA and Business Glossary for near real time updates of glossary contents into IDA using Eclipse plugin.
  • Responsible for the administration of the entire suite including DataStage, Information Analyzer, Information Governance Catalog.
  • Responsible for profiling and creating data rules for validation of data quality.
  • Responsible for entire IGC management including Business Glossary and Asset management for Data Lineage.
  • Imported Industry banking model into IDA and created Physical model from Logical model.
  • Assigned Business Vocabulary to the Logical and Physical Model.
  • Imported Industry models into metadata asset manager for linking glossary to metadata assets.
  • Linked Information Analyzer rules with Business Glossary and database columns for an end to end solution lineage.
  • Defined and developed Data Quality standards and set metrics to reach Organization’s goals.
  • Successfully delivered an End to End solution.

Environment: IBM Information Server 11.3.1 (Administrator, Designer, Director, Web Console), Information Analyzer 11.3.1, Information Governance Catalog 11.3.1, InfoSphere Data Architect 11.3.1, DashDB, Linux.

Confidential

Sr. ETL Architect

Responsibilities:

  • Confidential is the world’s largest manufacturer of machinery and equipment focused solely on the agriculture industry.
  • Worked on developing master data objects like Customer Master, Material Master and transactional objects like Sales Pricing, Class, GRIR, Pricing Variant Condition, Pricing Discounts and Accruals, Non Configured Sales Orders, Vendor Codes and Vendor classification.
  • Built a common framework to be used across the project for reconciliation and error handling to be used for multiple country rollout.
  • Built Audit mechanism for making an audit entry for every job running within the project for transparency in operation.
  • Lead a team of 6 resources including work allocation and time management for meeting the deliverables on time.
  • Worked on IDOC Extract and IDOC load stages for posting of Idocs from and to SAP.
  • Migrated IBIS system from AS400 to SAP ECC systems using DataStage RTL methodology.
  • Worked on BAPI Stage in extracting master data from SAP tables for delta load purposes.
  • Worked with the SAP team in loading of the data from DataStage into SAP using LSMW.
  • Configured odbc connections in AIX for new Legacy Databases to be added to DataStage.
  • Improved performance of high volume job with 150 million records by reducing runtime from 8 hours to 25 minutes.
  • Created DataStage development standards and naming standards for the project.
  • Profiled Legacy systems using Information Analyzer for data profiling and Data Quality validations.
  • Created rule sets in Information Analyzer and set Data Quality benchmark for Legacy systems for continuation of Standards in Data Quality.
  • Used Quality Stage for standardization of the description data from the Legacy Systems for Vendor Codes.
  • Created a Data Lineage report from Legacy systems till Golden copy to be loaded to SAP using metadata workbench.
  • Linked AS400 legacy systems, DB2 staging area along with Operational Metadata captured during DataStage job runs and created a impact analysis report to estimate impact for changes done at different levels of the project.
  • Trained internal team on InfoSphere Information Analyzer and on Data concepts for effective Data Quality and Data Governance implementations.

Environment: IBM Information Server 9.1.2 (Administrator, Designer, Director, Web Console), Information Analyzer 9.1.2, RTL Components SAP R/3 7.0 DataStage packs, LDAP, AS400 DB2, DB2 UDB, AIX, SAP ECC.

Confidential

Data/ETL Architect

Responsibilities:

  • United Guaranty’s primary product is private mortgage insurance. United Guaranty provides innovative, quality risk solutions that fulfill the needs of our customers to remain competitive and generate a profitable, yet responsible book of business for their stakeholders.
  • Recommended the best topology based on the resources they have for different environments.
  • Configured the IBM Information Server Suite 9.1.2 tools to work properly.
  • Validated the tools by creating jobs, mapping specifications, categories etc. after the configuration is being done.
  • Configured the Information Analyzer 9.1.2 connection and logs for the project.
  • Worked as Data Quality Lead as part of Data Governance.
  • Created terms and categories using Information Governance Catalog 11.3.
  • Assigned Stewards to the terms using Information Governance Catalog.
  • Profiled legacy systems and ran Data Quality checks by creating Rule Sets.
  • Executed data governance and data management processes as part of an enterprise application deployment
  • Established business data lineage to create trusted information that supports data governance and compliance efforts
  • Created business glossary terms, categories, hierarchies, policies, rules as well as processes and work flows
  • Using Information Analyzer found lot of data discrepancies in the Source data like invalid formats, different patterns of data etc which helped the client in a great way to make them aware of their source system to get cleansed and come up with different business rules.
  • Created Automated DQ solution and improved the performance by 600 times.
  • Automated Data Quality Scorecards by creating scripts to enable the capability of Database loading and Data Quality trending graphs.
  • Integrated Information Analyzer functionality within DataStage 9.1 for parallel processing capability to IA jobs using Unified Architecture.
  • Imported assets into the Information Server Repository using Metadata asset manager.
  • Established Data Lineage across AS400 & Oracle databases with DataStage jobs using IBM Metadata Workbench 9.1.
  • Loaded glossary Categories & Terms into Business Glossary 9.1.
  • Created DSN’s to establish connection between database and InfoSphere Suit tools.
  • Lead ETL team in converting SAS programs to DataStage jobs.
  • Trained team members on InfoSphere Information Analyzer 9.1.
  • Created DataStage jobs using multiple PX stages and used xml stages for capturing operational metadata onto database tables.
  • Assisted with InfoSphere Suit Admin activities including user management and Metadata management.

Environment: IBM Information Server 11.3/9.1.2 (Administrator, Designer, Director, Web Console), Information Analyzer 9.1.2, Business Glossary 9.1.2, Fast Track 9.1.2, RTL Components SAP R/3 7.0 DataStage packs, LDAP, AS400 DB2, Oracle 10g, AIX 6.5.

Confidential

Sr. IBM InfoSphere Architect/Lead

Responsibilities:

  • Interacted with different teams from Business, Technical, Data owners at Confidential to understand their sales objects.
  • Guiding the team properly in executing the project successfully.
  • Involved in the process flow of data across different layers to the target Mosaic Teradata database like landing, atomic and semantic.
  • Involved in building the tables across different layers, change requests and defect issues related to the project.
  • Involved in designing ETL framework with Auditing/Reconciliation capabilities.
  • Involved in designing the simple to complex DataStage jobs.
  • Perform the unit testing and implemented the best practices in DataStage.
  • Mentoring the team on ETL designing.
  • Using multiple stages like Teradata connector stage, sequential file, dataset, sort, merge, join, lookup, filter, transformer, aggregator etc. during ETL development.
  • Configured the user credentials in web console for different InfoSphere users.
  • Migrated the Information Server DataStage code across different environments.
  • Performed code unit testing by stimulating various business cases.
  • Parameterized DataStage jobs to allow portability and flexibility during runtime.
  • Used DataStage Director to run and monitor the jobs performed.
  • Created the crontab scripts to schedule the DataStage jobs.
  • Complex queries are written to facilitate the supply of data to other teams.

Environment: IBM InfoSphere DataStage 8.7, Teradata 13, Linux 2.6.

Confidential

Senior IBM InfoSphere DataStage Developer/Admin

Responsibilities:

  • The Gorgon project is implementing changes to the JD Edwards (JDE) system and deploying the Engineering Data Warehouse (EDW)
  • The JDE system is an existing ERP (Enterprise Resource Planning) application in use by multiple SBU’s across Confidential . Enhancements and new functionality for JDE is implemented as part of the Gorgon project.
  • A data migration activity is expected to occur as part of the ERP and EDW projects to provide these systems with an initial data load of master reference data.
  • Worked in developing Interfaces required for Data Migration.
  • Created Batch processing jobs for Orchestration.
  • Created Parallel, Server and Sequential jobs for migrating data into JD Edwards
  • Worked on HP ALM on Defect Management for testing purposes.
  • Extensively worked on creating server/parallel shared containers to be used across the project for error handling and reconciliation.
  • Extensively used Job Activity, Command Activity, Routine Activity, Start Loop, End Loop, Notification Activity, Sequencer and User Variables Activity stages while developing sequencer jobs for Batch Orchestration.
  • Resolved data issues while loading data into J.D. Edwards ERP system.
  • Worked on analysis of the data on SQL Server 2012 and Oracle databases.
  • Created polling and SFTP process in UNIX using shell script for pull and push of the files from/to legacy systems.
  • Performed the Metadata workbench administration tasks related to running the automated services, configuring the connections to import metadata from different sources like Database, Data modeling tools, BI reports etc. and mapping different databases used in DataStage.
  • Create & ran queries on Metadata workbench.
  • Performed data lineage using Metadata workbench.
  • Used InfoSphere command line interface istool to migrate code from Metadata workbench across environments.
  • Extensively used connector stages like ODBC Connector to read and load data into SQL Server and Oracle Connector to read/write into Oracle Database.
  • Responsible for migrating and testing entire DataStage 8.1 code onto DataStage 8.7
  • Created project plan for the DataStage 8.7 upgrade for the project including over 500 jobs.
  • Resolved issues related to the compatibility of the code with DataStage 8.7 and Redhat Linux server 6.
  • Internally trained resources on IBM InfoSphere DataStage 8.1

Environment: IBM InfoSphere DataStage 8.1/8.7, Metadata Workbench 8.7, Oracle 10g, SQL Server 2008, HP Application Lifecycle Management.

Confidential

Senior IBM InfoSphere DataStage Developer

Responsibilities:

  • BI Test Team has been established to provide BI stakeholders with relevant information about the product risk profile and risk mitigation activities of BI projects for Confidential ABU.
  • BI Test Team is responsible for providing information earlier in CPDEP phases, documenting processes that analyze the system under test, lowering the number of production issues, risk mitigation plans to be established before product goes live.
  • Created documents for different processes in ETL Testing.
  • Created test requirement documents from information requirement documents.
  • Created template test case for tester’s reference.
  • Created ETL Testing Methodology documents explaining test scenarios and approach.
  • Created ETL Code Promotion Templates and ETL checklist for testers.
  • Migrated the code from DataStage to different environments.
  • Created and configured different odbc dsn’s in .odbc.ini file on the server to establish connection with different databases from DataStage.
  • Created the parameter sets and their values catering to different environments.
  • Created testing tracker template and Issue Log Template.
  • Created Requirements in HP Application Lifecycle Management.
  • Created Test Plan in HP Application Lifecycle Management.
  • Worked on Test Lab in creating test cases and assigning the test cases to Requirements in HP Application Lifecycle Management.

Environment: IBM InfoSphere DataStage 8.5, Oracle 10g, HP Application Lifecycle Management.

Confidential

Information Server Suite Administrator/Architect

Responsibilities:

  • Bankwest, previously known as The Bank of Western Australia is a full-service bank based in Perth, Western Australia. Formerly a wholly owned subsidiary of HBOS plc, it was sold in October 2008 to the Commonwealth Bank of Australia for A$2.1 billion but continues to operate independently from its parent company.
  • Recommended the best topology based on the resources they have for different environment.
  • Configured the IBM Information Server Suite 8.5 tools to work properly.
  • Validated the tools by creating jobs, mapping specifications, categories etc. after the configuration is being done.
  • Configured the Information Analyzer connection and logs for the project.
  • Implemented the error handling logic to report the data errors to the Data Owners.
  • Successfully integrated the LDAP with Information Server 8.5 from WebSphere Administration console by applying & following different properties & running few commands.
  • Added and assigned proper privileges to different LDAP groups from Information Server web console Administration settings so that LDAP users can directly work with their domain logon users to log in to InfoSphere tools like DataStage, QualityStage, and Information Analyzer etc.

Environment: IBM Information Server 8.5 (Administrator, Designer, Director, Web Console), Metadata Workbench 8.5, Information Analyzer 8.5, Business Glossary 8.5, Fast Track 8.5, LDAP.

Confidential

IBM Cognos Data Manager Developer

Responsibilities:

  • Pronto Cognos Accelerator is an internal initiative by CSG Limited to build a prototype that showcases how businesses and its users could easily build or afford for a BI platform that is specially customized to their operating models. This BI platform would provide the business a deep insight that helps in many ways.
  • Pronto Cognos Accelerator addresses the imminent problem of customized reports, integration of ‘n’ number of systems in addition to Pronto to provide a single view of the business. A Data Warehouse is a much needed solution for any growing enterprise and in order to grow substantially in the market a holistic view of the business is required. PCA showcases how Pronto is used to build a data warehouse that has a greater deal of flexibility for the business to integrate data from other systems seamlessly.
  • Worked as technical lead for the project and also as senior developer for the development.
  • Responsible for the Analysis, Design and Development of this package which can be used as a plug and play BI solution.
  • Extensively worked on IBM Cognos Data Manager in Development of ETL packages.
  • Extensive work experience in using Fact Build Wizard and Dimension Build Wizard.
  • Created Templates for dimensional load which require lookup’s and also for SID generation.
  • Created a star schema for the module “sales” using Ralph Kimball bottom up approach.
  • Scheduled the job streams from Cognos Data Movement Task.
  • Successfully Designed, Developed and Tested a Sales BI Package which can be imported into any Clients environment using Pronto as ERP and can use the BI capabilities right away.
  • Optimized the code using Pipeline Parallelism and decreased the runtime of the package.
  • Created SQL package when installed will deploy star schema data model on the database along with procedures loading some dimensions like “Date Dimension”.
  • Responsible for implementing reconciliation and control table for auditing.
  • Trained BI team on IBM Cognos Data Manager 8.

Environment: IBM Cognos Data Manager 8, IBM Cognos Enterprise Edition, IBM Informix 11.7, Windows server 2008, Pronto ERP.

Confidential

Senior IBM InfoSphere Information Server Developer

Responsibilities:

  • Blue Harmony is an initiative by IBM to do business on one name and on one platform worldwide instead of multiple businesses on multiple systems and multiple platforms.
  • Blue Harmony is “The Biggest” SAP implementation project in the world with over 700 resources working worldwide.
  • This project is in the phase of migration from legacy systems onto SAP ECC 7.0.
  • Worked as a lead for 6 people working on 3 objects and offshore co coordinator for 7 objects apart from working as a senior developer.
  • Trained IBM IGA team on IBM InfoSphere DataStage 8.0 and best practices.
  • Trained IBM Business Analytics and Optimization team on Information Analyzer in a classroom training
  • Maintained Rosters of the attendees on a daily basis during trainings.
  • Conducted an advanced training for DataStage Developers on SAP R/3 packs enabling users to design parallel jobs thatare robust, less subject to errors, reusable, and optimized for better performance transferring data from/to SAP.
  • Involved in creating SDMS entry for the objects and assigning hours.
  • Involved in maintaining the timesheets for the resources against the objects.
  • Involved in the design of architecture for the IDD load process.
  • Created Data Model with snowflake schema using Erwin Data Modeler.
  • Involved in designing technical documents from the functional documents.
  • Imported the different BH Erwin data models from different databases like Mainframe DB2 and Oracle from different environments like dev, test, prod using Import/Export Manager tool into the metadata repository to capture the metadata based on the BH requirement.
  • Generated different reports like Impact analysis, data lineage and Business lineage in Metadata workbench.
  • Assisted and proposed the team with different solutions to import the Erwin Data model into metadata workbench.
  • Ran different queries in Metadata workbench to capture and save the results related to the metadata columns/tables in csv format.
  • Resolved the issues related to editing the Database name/schema name, remove unwanted databases being created in Metadata workbench with the help of other IBM foundation tools.
  • Ran different schema comparison, table comparison, column comparison reports in repository management to see whether all the environments dev, test, prod metadata is consistent for few data models.
  • Created BH Business categories, terms, stewards into the Business Glossary.
  • Created and configured the user roles and privileges for all the IA, Business Glossary and Metadata workbench users.
  • Generated jobs from FastTrack into DataStage for validation of the tool after installation & configuration.
  • Created mapping specification in FastTrack tool.
  • Created the FastTrack mapping specification template to establish relationship between Business Glossary terms with the Physical IT assets being imported using Metadata workbench.
  • Established the relationship between IT assets like columns being imported into Metadata repository with Business Glossary Terms in FastTrack by generating the job and publishing the relationships
  • Participated in the discussions related to installation of the Information Server Suite which includes DataStage, QualityStage, Information Analyzer, Metadata Workbench and Business Glossary.
  • Resolved the performance issues while extracting and loading data into or from SAP using IDOC EXTRACT & IDOC LOAD.
  • Actively involved in fixing majority of data cleansing issues like line feeders, character feeders, database nulls from legacy systems, fixed width character issues, dirty data, date issues etc.
  • Involved in creating UTP and UTR’s.
  • Trained and Mentored the BH staff on the IBM InfoSphere foundation tools on Information Server Implementation/Issue Resolution, Information Analyzer, Metadata workbench, Business Glossary, FastTrack, and SAP Packs etc.
  • Created the text file dsn in odbc.ini file to establish connection in Information Analyzer.
  • Using Information Analyzer found lot of data discrepancies in the Source data like primary key issues, different patterns of date etc which helped the client in a great way to make them aware of their source system to get cleansed and come up with different business rules.
  • Blocked the fields in QualityStage Match Specification Stage to find the duplicates in the source file which needs to be cleansed before ETL process.
  • Involved in creating DDL’s for creation and maintenance of the tables in the database.
  • Involved totally in performance tuning of the DataStage-SAP R/3 Pack jobs and was successful in improving the performance by 70% using different methodologies like parallel generators, cpic user as server group, batch processing and packet size.
  • Involved in testing the new 64 bit server and also in upgradation of server from 32bit to 64bit.
  • Worked on the SAP system in maintaining, deleting, assigning PARTNER PROFILE’S to IDocs.
  • Worked on DS SAP Administrator in assigning Idocs to the server and also in the configuration of SAP R/3.
  • Created many documents and shared among the team on R/3 packs and their best methods.

Environment: IBM Information Server DataStage 8.5/8.1 (Administrator, Designer, Director, Web Console), IBM Information Analyzer 8.5/8.1, IBM FastTrack 8.5/8.1,IBM Business Glossary 8.5/8.1,IBM Metadata Workbench 8.5/8.1, Erwin Data Modeler, DB2 UDB 8.1/9.1/9.5, SAP R/3 6.0, ECC 7.0,IBM AIX 6.1,XML packs, MQ Connector.

Confidential

Senior IBM InfoSphere DataStage Developer

Responsibilities:

  • Confidential 's businesses provide a unique variety of products and services that assure opportunity, security and peace of mind for customers.
  • Confidential 's strategy is to manage a select portfolio of specialty businesses that are leaders in their markets.
  • This project is in the phase of production maintenance and major enhancement.
  • Involved in Scheduling the jobs using Autosys
  • Involved in Analyzing business and enhancing jobs with the business updates.
  • Involved in performance tuning of the jobs.
  • Used DataStage Director to Run and Monitor the Jobs performed.
  • Worked on providing support for the production run failures.
  • Using multiple stages like Sequential File, Dataset, Sort, Merge, Join, Lookup, Filter, Transformer, and Aggregator during ETL development
  • Worked as a single point of contact for all the failures occurring during daily load and monthly load of enterprise data warehouse.
  • Using Business Glossary imported the Business categories and terms into the glossary.
  • Using the FastTrack created/imported the mapping specification to connect the IT assets/fields to the Business terms.
  • Imported the Erwin Data model to import the ECC tables into the metadata repository.
  • Created the scripts
  • Resolved the coding issues related to QualityStage jobs.
  • Removed the unwanted characters which are part of the Data Quality processing files.
  • Mentored the team on designing DataStage/QualityStage jobs and passing parameters dynamically from job/project parameters.
  • Implemented the check point restartability on sequence jobs to make the code efficient as per the client requirement.
  • Performance tuning of SQL queries used in Sparse Lookup in Oracle Enterprise Stage.
  • Decreased the run time of existing jobs from almost 22 hours to 30 minutes by applying performance tuning strategies.
  • Involved in monitoring and finding abends in MAINFRAME systems.

Environment: IBM Information Server DataStage 8.0, IBM Information Analyzer 8.0, IBM Business Glossary 8.0, IBM Metadata Workbench 8.0, IBM AIX 5.2, Oracle 9i, CA Autosys, Rational ClearQuest, Mainframes.

Confidential

Senior IBM InfoSphere DataStage Developer

Responsibilities:

  • AMC entertainment Inc. is one of the world’s leading theatrical exhibition companies with interests in approximately 360 theatres with 5,128 screens. AMC is in the process of replacing its Point-of-Sale system.
  • AMC wants to replace its current legacy data warehouse with a new Enterprise Data Warehouse (EDW) and associated Business Intelligence (BI) capabilities that will better support business user information requirements and assist AMC in driving the business toward its strategic objectives.
  • This project is the first requirements definition phase in the overall EDW delivery initiative.
  • Involved in development of Interfaces for Enterprise Data Warehouse.
  • Involved in development of Dimensions and Facts. Extensive working knowledge on Dimension and Fact load.
  • Involved in handling Late Arriving Dimensions.
  • Involved in creating P490S for different dimensions.
  • Used multiple stages like Sequential File, Transformer, Filter, Change Capture Stage, Column Export and Funnel during ETL development.
  • Used multiple SQL stages like SQL Server read, SQL Server write and SQL Server lookup during ETL development.
  • Involved in creating jobs using SCD Stage for SCD 2 implementation.
  • Implemented the complete life cycle of Information Analyzer.
  • Created the text file dsn in odbc.ini file to establish connection in Information Analyzer.
  • Created the QETXT.ini file to define metadata in Information Analyzer.
  • Performed the column analysis using Information Analyzer jobs.
  • Reviewed the properties of the analysis results for each column like formats, valid data, data types etc.
  • Ran different reports in Information Analyzer like Column properties, Column all data types with Inferred data types and column frequency.
  • Quality Stage jobs have been used for error handling/reporting by finding composite primary key duplicates.
  • Found the exact matches for legacy databases primary keys using QualityStage Unduplicate Match stage by defining proper match specifications and reported those data issues to the Data Owners for cleansing the source data in their systems.
  • Blocked the fields in QualityStage Match Specification Stage to find the duplicates in the source file which needs to be cleansed before ETL process
  • Resolved the coding issues related to QualityStage jobs.
  • Removed the unwanted characters which are part of the Data Quality processing files.
  • Involved in generating Radiant files of mainframe file format.
  • Worked with DataStage Director in running the solution, testing and debugging its components and monitoring the resulting executables.
  • Resolved the performance issues while extracting data from SQL Server & loading data into SQL Server database tables.
  • Debug, and resolved the loading failures by verifying the log file.

Environment: IBM Information Server DataStage 8.0.1, IBM Information Analyzer 8.0.1, IBM QualityStage 8.0.1, SQL Server 2005, Teradata, Windows 2003.

We'd love your feedback!