Data Warehouse Architect/cloud Applications Architect Resume
St Louis, MO
SUMMARY:
- Over 18 years of professional IT experience in System analysis, design, development, architecture, Data Warehouse/Data Mart design including cloud models(Saas,Paas,Iaas) development and implementation of client server applications with strong business understanding and noledge of Financial, Marketing, Health Insurance, Consumer and inventory management projects.
- Experience in all phases of Software Development Life Cycle (SDLC). Proficient in transforming Large Volumes of data from various sources (flat files,XML,Oracle,DB2,Teradata,SAP,AS400,Mainframes) to Data warehouse, using IBM DataStage and Informatica Power center and as ETL process and experienced in Data Analysis and BI reporting for Decision making.
- Design, develop, architect, administer Data Warehousing/ERP tools and enterprise wide applications.
- Designs, develops and executes demonstrations and Proofs of Concept.
- Contribute to noledge exchange: document and share within the team acquired noledge around new solutions, project experiences, PoCs, etc.
- Install, configure, and modify ETL systems as per business requirements.
- Enhance and Implement Client Server applications, ERP and Web Applications.
- Ability to debug any problems between DataStage server and client connectivities.
- Proficient in design, development and support mappings using INFORMATICA.
- Extensive Data Warehousing ETL experience in using INFORMATICA 10.x/9.6/9.1/8.6.1/8.5/8.1/7.1 POWERCENTER Client tools - Mapping Designer, Repository manager, Workflow Manager/Monitor and Server tools, Informatica Server, Repository Server manager.
- Expertise in Data Warehouse/Data mart, ODS, OLTP and OLAP implementations teamed with project scope, Analysis, requirements gathering, data modeling, Effort Estimation, ETL Design, development, System testing, Implementation and production support.
- Extensive Experience in developing Parallel and Server Jobs using IBM DataStage
- Remarkable experience in monitoring and administrating DataStage server performance and usage.
- Design, development and support of SSIS packages for ETL solutions.
- Experience in design, development and support graphs using Ab-Initio
- Involved In Review, Design & Developing Environment (Development, Testing, Version And Production) for DataStage Processes.
- Ability to optimize the server performance and avoiding any deadlocks.
- Good understanding of Information Server Administration.
- Implemented the various process controls for management change.
- Strong Skills in Coding (Stage Variables, Derivations and Constraints) Business Logics In Transformation Stage.
- Experience In Developing Job Automation Process, To Run DataStage Jobs Using DataStage Job Control And Global Parameter File
- Used Import / Export of DataStage projects and jobs, debugging DataStage jobs
- Ability to integrate stored procedures and user defined SQL in to DataStage
- Proficient in Most of Parallel Extender Stages and Parallel Processing.
- Developed the coding and tuned both SQL and DataStage jobs for better performance
- Excellent skills in TeraData DB2, SAP DB, SQL Server and Oracle RDBMS.
- Strong in SQL, And Implementing SQL’s In DataStage For Better Performance.
- Extensively used Teradata load utilities Fastload, Multiload, Tpump, Bteq and OLELoad
- Ability to develop SQL scripts, Stored procedures and a working noledge with Oracle.
- Ability to work on AS400 systems and Mainframes.
- Working noledge of Data models and tools Erwin tool
- Involved in the complete life cycle of Data Warehouse Designing, OLAP, Performance tuning, Data Modeling, Application Development.
- Good understanding of SaaS, IaaS and PaaS Cloud Models.
- Knowledge in MS Azure and AWS cloud computing services.
- Experience working on Hadoop (Hortonworks) and BigData tools
- Performed pilot POCs for process intelligence tools like Timeline PI & DataRobot.
TECHNICAL SKILLS:
ETL Tools: IBM DataStage 11.7/9.X/8.X/7.5x.2/7.5/7.x/6.0/5.x,INFORMATICA Power Center 10.x/9/x/7.1.X, AB-INITIO, MS-SSIS
Cloud Technologies: AWS,Microsoft Azure,IBM cloud and Google Cloud.
Reporting Tools: Business Objects 6.1/5.1/SAP BO BI 4.2,Hyperion 7.x/6.5.x, ReportNet(Cognos),Tableau,SSRS, MicroStratgey
Data Modeling: ERWIN 4.x/3.5
RDBMS: Oracle 19c/18c/12c/11g/10g/9i/8i, SQL Server 2005/2000,MYSQL, DB2 UDB 6.1,Sybase, MS Access, Teradata V2R5/V2R4.PostgresSQL,RedShift
Web Tools: Websphere, JDBC, HTTP, JSP, JSTL, Servlets, Struts, HTML, XML, Stellent, JVM and WSAS
UI Tools: Dreamweaver3.0, Frontpage2000
Web Servers: Java Web Server IIS4.0/5.0/6.x
GUI: Visual Basic 6.x/5.0/4.0, VC++
Operating Systems: Windows 7/XP/2000/98/95, MS-DOS, UNIX, LINUX RHEL 7.6/6.1/5.6, AIX and SOLARIS
Programming Languages: J2EE, C#, C, C++, VB, ASP, Perl, PHP
Scheduling Tools: Autosys, Control M, Automic,UC4, Appworx,CRON
Other Tools: SAP BW ABAP. SAP BO data Services, SAP HANA, Hadoop architecture
PROFESSIONAL EXPERIENCE:
Confidential, St. Louis, MO
Data Warehouse Architect/Cloud Applications Architect
Responsibilities:
- Established data architecture and BI best practices, standards and data models; recommended data warehouse and reporting performance tuning techniques.
- 2+ years of AWS PaaS and SNOWFLAKE SaaS experience.
- Designed complete data analytics stack and workflow, from ETL to data platform design to BI and analytics tools.
- Excellent documentation and communication skills with an ability to clearly articulate complex IaaS/PaaS/SaaS concepts to people new to cloud development engineer team.
- High proficiency in requirement gathering and data modeling including design and support of various applications in Online Transactional processing (OLTP) and Online Analytical Processing (OLAP), Data Warehousing and ETL Environment.
- Strong understanding of ER Modeling, Dimensional Modeling, Star and Snowflake Schemas. Creation of Conceptual, logical and physical data models using Erwin/Power designer.
- Experienced in hot and cold data storage strategies.
- Gather and map customer’s requirements in a clear and articulated functional and non-functional requirements to business and technical stakeholders. Prepare solution presentations for internal and external customers
- Participate-in or lead analysis, pre-studies and feasibility studies of an existing or planned solution with internal and external customers. Able to work with given restrictions and constraints in order to match customer’s requirements
- Owns the technical solution during the pre-sales phase and hand it over as required to Operations. Handle scope, risks, changes and customer’s requirements and expectations.
- Collaborate with business stakeholders to develop and document policies and procedures surrounding Data Governance.
- Develop best practices, standards and methodologies to assist in the implementation and execution of Data Governance.
- Build and maintain Enterprise Data Dictionary.
- Extensive Data Warehousing ETL experience in using INFORMATICA POWERCENTER Client tools - Mapping Designer, Repository manager, Workflow Manager/Monitor and Server tools, Informatica Server, Repository Server manager.
- Extensive ETL experience using Informatica (Power Center/ Power Mart) (Designer, Workflow Manager, Workflow Monitor and Server Manager), MDM,EDC,Teradata and Business Objects. Expertise in working with relational databases such as Oracle, SQL Server,DB2,SAP HANA,MySQL,Postgres SQL, UDB, MS Access and Teradata.
- Extensively used Data Stage designer to develop Parallel jobs to extract, cleanse, transform, integrate and load data into target tables using different built-in stages.
- Developed business rules validation jobs using Aggregator, Transformer and Filter stages, Used Lookup stage to get the code values and Join stage to combine large data streams.
- Extensive experience in developing Stored Procedures, Functions, Views and Triggers, Complex SQL queries using SQL Server, TSQL and Oracle PL/SQL
- AnalyzingBusiness Intelligence Reportingrequirements and translating them into data sourcing and modeling requirements including Dimensional & Normalized data models, Facts, Dimensions, Star Schemas, Snowflake Schemas, Operational Data Stores, etc.
- Designing and implementing data warehouses and data marts using components of Kimball Methodology, like Data Warehouse Bus, ConformedFacts & Dimensions, Slowly Changing Dimensions, Surrogate Keys, Star Schema, Snowflake Schema, etc.
- Delivered BI reporting solution in BO,Power BI,Reporting services(SSRS),Tableau, Cognos and MicroStrategy.
- Developed user-defined transforms, Routines, Stage Variables and Stored Procedures.
- Develop dashboards and visualizations that empower decision makers
- Developed UNIX scripts as required for preprocessing steps and to validate input and output data elements, along with data stage routines.
- Extensive experience on Data Integration and Data Analysis with PHI Data and Claims Data. Also developed Data transformations for Patients Data including Member Claims, Pharma, Enrollment, Eligibility and Clinical data.
- Created Shared containers to increase object code reusability and to increase throughput of the system.
- Extensive Experience using the stages like Slowly Changing Dimension and Change Data Capture(CDC) and Change Apply Stage, Remove duplicates, Funnel, Filter, Copy, Modify, Oracle Connector/Enterprise, Surrogate Key, Aggregator, Transformer Stages.
- Extensive experience in troubleshooting of Data Stage jobs and addressing production issues like performance tuning and enhancement or request resource allocation as needed.
- Extensively used Oracle Connector stage, ODBC Connector Stage as source and target Database.
- Worked on custom SQL queries and PL/SQL procedures for custom coding in the jobs.
- Removed Duplicate data or filter from the source system by using Remove Duplicates, Transformer stages to enhance high quality processing of the incoming data.
- Worked on source data analysis to verify Quality of the data using Information Analyzer / DataStage QualityStage
- Worked on Performance tuning of the jobs and Oracle/SQL Server SQL(database) queries.
- Experience working on NoSQL Dbs like Cassandra, Hbase etc.
- Proficient in design, development and support mappings using INFORMATICA.
- Design, development and support of SSIS packages for ETL solutions.
- Build, customize and publish interactive reports, visualizations and dashboards using BO and Cognos
- Used Automic/UC4 to schedule and monitor job flows.
- Extensively experience in developing process flows and sub process flows using Automic/UC4.
- Created Multiple Instance Jobs thereby reducing redundancy in job design.
- Debugged front end applications supporting java based platform.
- Analyzing data using Hive QL, Pig Latin and import/export data using sqoop.
- Experience working on different data stores like Amazon EMR, S3 and HDFS.
- Experience on Cloud Databases and Data warehouses (Confidential Redshift/RDS and MS Azure).
- Strong Experience in implementing Data warehouse solutions in AWS Confidential Redshift.
- Worked on various projects to migrate data from on premise databases to AWS Confidential Redshift, RDS and S3.
- Knowledge in Python programming for Data Science solutions.
- Knowledge with AWS core services such as EC2, IAM, S3, RDS and QuickSight.
- Experience inGCP, Big Query, GCS bucket, G - cloud function, cloud dataflow, Pub/Sub cloud shell, GSUTIL, BQ command line utilities, Data Proc, Stack driver
- Experience in building and architecting multiple Data pipelines, end to end ETL and ELT process for Data ingestion and transformation in GCP and coordinate task among the team.
- To reduce the response time, aggregated the data, data conversion and cleansed the large chunks of data in the process of transformation.
- Actively participated in the Team meetings to gather the business requirements and developing the specifications and compiling BRS(BLS).
- Obtained detailed understanding of data sources, Flat files and Complex Data Schema.
- Developed star schema data model using suitable dimensions and facts.
- Successfully Integrated data across multiple and high volumes of data sources and target applications.
- Involved in creating technical documentation for source to target mapping procedures to facilitate better understanding of the process and incorporate changes as and when necessary.
- Provisioned and operationalized IPC MDM data with graph-based exploration of master data, transactional data and Hadoop to drive entity insight and analytics.
- Extensively used DataStage Director for Job Scheduling, emailing production support for troubleshooting from LOG files.
- Created UNIX shell scripts to invoke jobs and pre/post processing files.
- Used several stages while developing Parent, Child Sequencers like Start Loop, End Loop, User Variable Activity, Nested Condition, Routine Activity and Mail Notification stages.
- Complied change control methodologies while deploying the code from DEV to QA to UAT to Production.
Confidential, St. Louis, MO
Lead Administrator
Responsibilities:
- Install, configure, and modify systems as per business requirements.
- Installed and configured Nine IIS DataStage EE servers to IIS (IBM InfoSphere Information Server) 11.x
- Configured all IIS DS Client components to the business needs including new IIS Governance Catalog, IIS Enterprise Search, IIS Information Analyzer and IIS Flow Designer.
- Performed upgrades and implemented the various patches on the systems to ensure its TEMPeffective working.
- Enhance and Implement Client Server applications, ERP and Web Applications.
- Extensively worked with DataStage Administrator in project setup, general administration and routine housekeeping of DataStage.
- Installed Oracle Clients on IIS EE Servers and configured ORACLE DB Connections (tnsnames.ora, sqlnet.ora)
- Configured .odbc.ini and setup ODBC connections for different source databases like SAP HANA,SQL Server and MySQL DBS inside IIS DataStage EE servers.
- Configured $APT CONFIG FILE to run on different nodes for different projects with different space allocations on Linux file systems.
- Performed troubleshooting for IBM, opened Priority 1(SEV-1)/2 PMRs and assisted the ETL team in DataStage issues resolutions.
- Coordinated with the IT team to provide the necessary support to the DataStage environment.
- Maintained a backup of the DataStage (Projects (.dsx files ), Configurations, .odbc.ini, msghandlers, tnsnames.ora, file systems, mounts(storage team) ) in case of emergency.
- Regulated the DataStage for optimum performance at all times.
- Installed and maintained the IIS Server/WAS/ASB on the Linux RHEL 7.6 servers.
- Extensively used Data Stage designer to develop Parallel jobs to extract, cleanse, transform, integrate and load data into target tables using different built-in stages.
- Developed business rules validation jobs using Aggregator, Transformer and Filter stages, Used Lookup stage to get the code values and Join stage to combine large data streams.
- Developed user-defined transforms, Routines, Stage Variables and Stored Procedures.
- Developed UNIX scripts as required for preprocessing steps and to validate input and output data elements, along with data stage routines.
- Created Shared containers to increase object code reusability and to increase throughput of the system.
- Extensive Experience using the stages like Slowly Changing Dimension and Change Data Capture(CDC) and Change Apply Stage, Remove duplicates, Funnel, Filter, Copy, Modify, Oracle Connector/Enterprise, Surrogate Key, Aggregator, Transformer Stages.
- Extensive experience in troubleshooting of Data Stage jobs and addressing production issues like performance tuning and enhancement or request resource allocation as needed.
- Extensively used Oracle Connector stage, ODBC Connector Stage as source and target Database.
- Worked with DataStage Director to schedule running the solution, testing and debugging its components and monitoring the resulting executable versions (on adhoc or scheduled basis).
- Extensively used pre built-in DataStage transforms, functions and routines for conditioning, conversions, validation and loading, and also developed if required.
- Extensively wrote user SQL coding for overriding for generated SQL query in DataStage
- Developed user defined Routines and transformations to implement business logic and Shell scripts to automate file manipulation and data loading procedures.
- Extensively worked with Automic/UC4(Appworx) in designing, scheduling and code migration of Automic/UC4 Chains and Modules.
- Used Automic/UC4 and CRON to schedule DataStage jobs, Shell Scripts& Perl scripts
- Ensure proper security of assigned system components, and design security rules to enforce security
Environment: Informatica 10.x, IIS DataStage 11.7.0.2,SSIS,SAP BODS Citrix,Web Technology, LAWSON Business Intelligence, CVS, SVN, GIT,SAP Business Objects,SAP HANA,Cognos, Websphere, J2EE, JDBC, HTTP, JSP, JSTL, Servlet. JeStruts, HTML, XML, Stellent, JVM and WSAS, Tomcat, Apache, IIS, MS Application Center, Jenkins, Ansible,.Net/Com+,Visual Basic, VC++, DataStage TX, Web Technology, LAWSON Business Intelligence, Oracle 19c/18c/12c/11g/10g/9i/8i,MS SQL Server,MYSQL, DBMS/RDBMS, MS ACCESS, PL/SQL, CRON, Automic/UC4, APPWORX,JAMS& MS OFFICE, WINDOWS 10/7/XP,NT,AIX/UNIX and LINU RHEL 7.6(Maipo)/6.1/5.6.MS Azure. VMWare Sharepoint,Timeline PI,Data Robot,Orion,Maximo,Service Now
Confidential, St. Louis, MO
Sr. ETL Administrator/ETL Analyst
Responsibilities:
- Extensively worked with DataStage Administrator in setup, general administration and routine housekeeping of DataStage.
- Setup ODBC connections for different source databases like ORACLE, and SQL Server inside DataStage.
- Implemented extracting, cleansing, transforming, integrating and loading data into Data warehouse using DataStage Designer.
- Used DataStage Designer to develop Parallel Jobs.
- Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
- Worked with DataStage Director to schedule running the solution, testing and debugging its components and monitoring the resulting executable versions (on adhoc or scheduled basis).
- Extensively used pre built-in DataStage transforms, functions and routines for conditioning, conversions, validation and loading, and also developed if required.
- Extensively wrote user SQL coding for overriding for generated SQL query in DataStage.
- Developed user defined Routines and transformations to implement business logic and Shell scripts to automate file manipulation and data loading procedures.
- Extensively worked with Appworx in designing, scheduling and code migration of Appworx Modules and Chains.
- Used Appworx and CRON to schedule DataStage jobs, Shell Scripts& Perl scripts
Environment: IBM InfoSphere Information Server (IIS) 7.5.1A,TIBCO,Business Objects, Websphere, IIS, Oracle 11g/10g/9i, MS SQL Server 2005/2000, SQL Developer, DB VISUALIZER 6.0, CVS,SVN Stellent and Sharepoint, JSP, JSTL, Servlets, IBM AIX, Windows 7/XP/NT, CRON, UC4/Appworx.
Confidential, Chicago, IL
ETL Architect/ETL Analyst
Responsibilities:
- Involved in development phase meetings for Business Analysis and Requirements document reviews.
- Involved in the Analysis of Physical Data Model for ETL mapping and the process flow diagrams for all the business functions and designing the procedures for getting the data from all systems to Data Warehousing system.
- Designed server jobs and parallel jobs using the Standards in ETL Architecture.
- Extensively worked with all the client components of DataStage.
- Designed Mappings between sources to operational staging targets, using Star Schema, Implemented logic for Slowly Changing Dimensions.
- Created DataStage jobs, batches and job sequences and tuned them for better performance.
- Used Built-in, Plug-in and Custom Stages for extraction, transformation and loading of the data, provided derivations over DS Links.
- Extensively wrote Custom Routines and Transformations as per the business requirements.
- Developed various DataStage Job Sequencers to schedule Jobs on UC4.
- Involved in unit testing, system testing and integrity testing.
Environment: DataStage 8.0/7.5.1, Informatica PowerCenter, ERWIN, Cognos, Business Objects, Oracle 10g/9i, Sybase, AS400, SAP R/3, Manugistics, ERWIN, Cognos, Business Objects, Rapid SQL, DBVisualizer 6.0,J2EE, JSTL, Servlet, Struts, HTML, XML, JSF, Apache, Tomcat, IIS,WINDOWS XP/NT, HP-UNIX, Linux, Windows, UC4,CRON.
Confidential, Chicago, IL
LEAD ETL DEVELOPER
Responsibilities:
- Involved in development phase meetings for Business Analysis and Requirements document reviews.
- Used DataStage Manager to define Table definitions, Custom Routines and Custom Transformations.
- Extensively worked with DataStage - Designer to Pull data from flat files, Sybase and Oracle to PeopleSoft EPM target databases.
- Used DataStage Designer to develop Server Jobs.
- Developed jobs using the Standard PeopleSoft ETL Architecture.
- Created DataStage jobs, batches and job sequences and tuned tan for better performance.
- Extensively used Link Partitioner and Link collector in improving the performance.
- Extensively worked on the source data from Flat file source systems, Oracle source systems, SAP DB systems and DB2 source systems.
- Used Built-in, Plug-in and Custom Stages for extraction, transformation and loading of the data, provided derivations over DS Links.
- Extensively wrote Custom Routines and Transformations as per the business requirements.
- Developed various jobs using ODBC, Hashed file, Aggregator, Sequential file stages.
- Extensively used Sort, Merge, Aggregator, DB2 and Remove Duplicates stages.
- Created shared containers to use in multiple jobs.
- Extensively worked on DataStage Job Sequencer to Schedule Jobs to run jobs in Sequence.
- Used debugger to test the data flow and fix jobs.
Environment: IBM DataStage7.5.1,Cognos ReportNet, MicroStrategy, SQL*plus, RapidSQL, PeopleSoft EPM, PL/SQL, CVS,SVN Stellent and Sharepoint, J2EE,C++, Sybase, Apache, TOMCAT, IIS,WINDOWS XP/NT Windows NT,AUTOSYS, CRON.
Confidential, New York
PROGRAMMER ANALYST
Responsibilities:
- Involved in the Analysis of Physical Data Model for ETL mapping and the process flow diagrams for all the business functions and involved in designing the procedures for getting the data from all systems to Data Warehousing system.
- Involved in designing the procedures using IBM Integrity for data cleansing, used pre-built procedures for cleansing the address data of customer for inturnal business analytical purposes, The data was standardized to store various business units in tables.
- Implemented extracting, cleansing, transforming, integrating and loading data into Data warehouse using DataStage Designer.
- Used DataStage Designer to develop Parallel Jobs.
- Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
- Worked with DataStage Director to schedule running the solution, testing and debugging its components and monitoring the resulting executable versions (on adhoc or scheduled basis).
- Extensively used pre built-in DataStage transforms, functions and routines for conditioning, conversions, validation and loading, and also developed if required.
- Extensively wrote user SQL coding for overriding for generated SQL query in DataStage.
- Developed user defined Routines and transformations to implement business logic and Shell scripts to automate file manipulation and data loading procedures
Environment: DataStage 7.5x.2, Informatica Powercenter, Erwin 4.0, Business Objects, WEBI, Oracle 10g/9i/8, DB2 UDB, Informix, MS SQL Server 2000, J2EE JSP, JSTL, Servlets, Struts, JDBC,HTTP plugin, SFTP/SCP/FTP, HTML, XML, JVM and WSAS Dreamweaver 3.0,Frontpage2000,Stellent, Java Web Server 2.0,IIS 4.0/5.0,Tomcat, Apache, Netezza, MS ACCESS,PL/SQL, SQL Navigator, Windows NT, HP-UNIX,.
Confidential, Mc.Lean, VA
Sr. ETL Developer
Responsibilities:
- Implemented extracting, cleansing, transforming, integrating and loading data into Data warehouse using DataStage Designer.
- Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
- Worked with DataStage Director to schedule running the solution, testing and debugging its components and monitoring the resulting executable versions (on adhoc or scheduled basis).
- Used DataStage Designer to develop Server and Parallel Jobs.
- Used Shell Script to run and schedule Data Stage jobs on Unix server. Scheduler used AUTOSYS on Unix.
- Involved in development phase meetings for Business Analysis and Requirements document reviews.
- Extensively worked on the source data from Flat file source systems, Oracle source systems, and DB2 source systems.
- Used Built-in, Plug-in and Custom Stages for extraction, transformation and loading of the data, provided derivations over DS Links.
- Extensively wrote Custom Routines and Transformations as per the business requirements.
- Involved in unit testing, system testing and integrity testing.
- Designed Mappings between sources to operational staging targets, using Star Schema, Implemented logic for Slowly Changing Dimensions.
- Participated in the review of Technical, Business Transformation Requirements Document.
Environment: meBM DataStage 7.5/7.1, Informatica Powercenter 6.1/5.1,Powermart, Business Objects, Hyperion/Micro Strategy, Erwin, Brio, Web Technology, Oracle 9i/8i, J2EE JSP, JSTL, JDBC,JSF,Servlets, HTML, HTTP/FTP, JAVA, C++, IIS, Tomcat, .Net/Com+, Visual Basic, Power Analyzer PL/SQL, DB2, AIX,UNIX, SQL*plus, RapidSQL, Cognos(ReportNet),DBVisualizer 5.0,Windows XP/ NT. AIX,LINUX HP- UNIX,SOLARIS Mainframes, AUTOSYS,CRON and CONTROL M.
Confidential, Indianapolis, IN
ETL Developer
Responsibilities:
- Involved in development phase meetings for Business Analysis and Requirements document reviews.
- Used DataStage Manager to define Table definitions, Custom Routines and Custom Transformations.
- Extensively worked with DataStage - Designer to pull data from flat files, DB2 and Oracle to Teradata target databases.
- Used DataStage Designer to develop Server Jobs.
- Created DataStage jobs, batches and job sequences and tuned tan for better performance.
- Extensively used Link Partitioner and Link collector in improving the performance.
- Extensively worked on the source data from Flat file source systems, Oracle source systems, SAP DB systems and DB2 source systems.
- Used Built-in, Plug-in and Custom Stages for extraction, transformation and loading of the data, provided derivations over DS Links.
- Extensively wrote Custom Routines and Transformations as per the business requirements.
- Developed various jobs using ODBC, Hashed file, Aggregator, Sequential file stages.
- Extensively used Sort, Merge, Aggregator, DB2 and Remove Duplicates stages.
- Created shared containers to use in multiple jobs.
- Extensively worked on DataStage Job Sequencer to Schedule Jobs to run jobs in Sequence.
- Used debugger to test the data flow and fix jobs.
- Used IBM Integrity for cleansing the source data coming heterogeneous sources such as ANSI X12 (fixed width flat files), CSV files, and COBOL files and also loaded using DataStage jobs
- Extensively used DataStage Designer to develop various jobs to extract, cleanse, transform, integrate and load data into Datamart.
- Used DataStage Designer to develop Parallel Jobs.
- Worked with DataStage Manager to import/export metadata, jobs, and routines from repository, and also created data elements.
- Scheduled the server jobs using DataStage Director, which controlled by DataStage engine and also for monitoring and performance statistics of each stage.
- Used plug-in stages such as FTP, Merge and Pivot and also various stages like Sequential, Hashed, ODBC, Oracle 9i, Aggregator, Links Practitioner/Link collector, and Inter-Process.
- Created Batches (DS job controls) and Sequencers to control set of DataStage jobs.
- Extensively used pre built-in DataStage transforms, functions and routines for conditioning, conversions, validation and loading, and also developed if required
- Developed Stored Procedures for complex jobs
- Extensively wrote user SQL coding for overriding for generated SQL query in DataStage.
- Created of different types of reports, such as: Master/Detail, Cross Tab and Chart (for trend analysis).
- Scheduled BO reports using Broad Cast Agent and monitored them through Broad Cast Agent console
- Involved in unit testing, system testing and integrity testing.
- Designed Mappings between sources to operational staging targets, using Star Schema, Implemented logic for Slowly Changing Dimensions.
- Participated in the review of Technical, Business Transformation Requirements Document.
- Participated in discussions with Team leader, Group Members and Technical Manager regarding any technical and/or Business Requirement issues.
Environment: IBM DataStage 7.0/6.0XE,CVS, BO/MicroStrategy WebSphere, J2EE JSP, JDBC, JSF, Java RMI/CORBA, HTML, HTTP, JAVA,C++, IIS, Tomcat, .Net/Com+, Visual Basic, Power Analyzer, Erwin, Informatica Powercenter 5.x,DataStage, Brio, Web Technology and Oracle 8i/7x,SQL Server 2000,DB2,AUTOSYS,CRON & MS OFFICE WINDOWS XP,2000,2003,NT,UNIX and LINUX and IBM MVS OS/390.