Data Stage Developer Resume
3.00/5 (Submit Your Rating)
CA
SUMMARY:
- 6 Years of overall IT experience in Analyzing, Designing, Developing, Testing, Implementing and Maintaining client/server business systems over six years of experience with ) to implement ETL solutions and Data Warehousing projects
- Good experience in using NO - SQL databases like Cassandra/HBASE through Data Stage
- Very good knowledge on running Data Stage jobs on Hadoop or big data systems.
- Experience in Data warehousing and Data migration.
- Used both Pipeline and Partition Parallelism for improving performance.
- Developed Parallel jobs using various stages like Join, Merge, Lookup, Surrogate key, SCD, Funnel, Sort, Transformer, Copy, Remove Duplicate, Filter, Pivot and Aggregator stages for grouping and summarizing on key performance indicators used in decision support systems.
- Frequently used Peek, Row Generator and Column Generator stages to debug.
- Expertise in performing Data Migration from various legacy systems to target database.
- Expertise in Data Modeling, OLAP/ OLTP Systems, generation of Surrogate Keys, Data Modeling experience using Ralph-Kimball methodology and Bill-Inmon methodology, implementing Star Schema, Snowflake Schema, using Data Modeling tool Erwin.
- In Depth knowledge in Data Warehousing and Business Intelligence concepts with emphasis on ETL and Life Cycle Development including requirement Analysis, Design, Development, Testing and Implementation.
- Having knowledge on java applications which integrates with Datastage ETL
- Experience in implementing Netezza, Sybase, DB2, DB2/UDB, Oracle 10.2/ 9i/ 8i, SQL Server, PL/SQL, and SQL *PLUS database applications.
- Having knowledge on adaptive to Cloud Strategies based on AWS (Amazon Web Services).
- Participated Actively in Server Upgrade and Data Stage Version Upgrade.
- Migrating jobs from DataStage 7.5.1 to DataStage 8.1 Enterprise Edition, 8.5 to 11.5, Server jobs to parallel jobs migration.
TECHNICAL SKILLS:
Databases: Netezza, Oracle 10g/9i, DB2, Teradata Bteq
Tools: IBM Info Sphere / WebSphere Data Stage 11.5/9.1 /8.7 , (Designer, Director, Administrator and Manager).
Languages: Java, SQL, UNIX Shell Script, XML.
Reporting Tools: Business Objects
PROFESSIONAL EXPERIENCE:
Data Stage DeveloperConfidential, CA
- Involved in the creation of dimensional schema design including dimension tables, fact tables and aggregate tables
- Involved in the high-level and detailed design of the project
- Created ETL IBM-DataStage parallel jobs to extract and reformat the source data so it can be loaded into the new data warehouse schema
- Working on Data profiling for different data models.
Confidential, PA
- Working on POC upgrading existing Datastage 8.7 version to Datastage 11.7 Version
- Responsible for database management, database administration, data modeling and developing scripts for enhancing existing financial reporting and compliance. Designed database model to support various rate calculation submission and store DoD and Civilian data distinctly for timely filing process. This process is to comply with regulations on a monthly basis.
- Analyzed and resolved testing and production issues by determining their validity, identifying causes, developing various courses of action to address business requirements, and implementing them
- Performed system analysis, design, coding, testing and implementation for the entire systems development cycle
- Performed review and analysis of the detailed system specifications related to the DataStage ETL and related applications to ensure they appropriately address the business requirements
- Evaluated impact of proposed changes on existing DataStage ETL applications, processes and configurations
- Worked on parallel extender
- Designed and developed the generic ETL utility to load data from MySQL database
- Infosphere DataStage 8.7 to 11.7 upgrade.
Confidential, Michigan
Responsibilities:
- Identifying data gaps between old (PeopleSoft) and new (workday)ERP Systems.
- Involved in data modeling session, developed technical design documents
- Involved in data discovery in profiling different source data.
- Created Functional and Technical specs to load data into Teradata warehouse.
- Designed Parallel jobs using various stages like Join, Merge, Remove Duplicates, Filter, Lookup, Modify, Aggregator and Funnel stage.
- Developed Parallel Jobs using various Development / Debug Stages (Peek Stage, Row generator stage, Column generator stage, Sample stage) and Processing Stages (Aggregator, Change Capture, Change Apply, Filter, Sort and Merge, Funnel Remove Duplicate Stage).
- Created a technical proof of concept for implementing the D3.js using the feed generated by Data Stage. This is done as an alternate to the Cognos active reports .
- Used Explains to optimize Teradata Bteq SQL queries for better performance
- Creation of unit test case documents
- Used PIG, Hive and Hbase to move data extraction and processing logic to Hadoop systems.
- Developed shell scripts and updated the log for the backups.
- Involved in performance tuning of long running jobs.
- Involved in volume testing and quality testing.
- Involved in performance tuning of long running jobs.
- Involved in volume testing and quality testing.
- Creating the scheduling plan, job execution timings and sharing with scheduling team (Control-M)
- Modifying the existing (Re-Usable) Job if required.
- Involved in Retrofitting legacy jobs to Data Stage 11.5 .
- Used Data Stage Designer for developing various jobs to extract, cleansing, transforming, integrating and loading data into Data Warehouse.
- Involved In Data Stage upgrade from 9.1 to 11.5.
Environment: Data Stage 9.1/11.5,Netezza, Oracle 10g/9i, DB2, Hadoop 2.2.0, Terradata Bteq.
ETL Developer
Confidential
Responsibilities:
- Worked with users & analysts to understand requirements
- Participated in client meetings to review Integrated Data approaches and to interpret results
- Closely involved in gathering requirement, design, development and implementation of the project
- Worked with Development Team to draft the Development Checklist and Plan for Iteration Releases.
- Developed Parallel jobs using various stages like Join, Merge, Lookup, Surrogate key, SCD, Funnel, Sort, Transformer, Copy, Remove Duplicate, Filter, Pivot and Aggregator stages for grouping and summarizing on key performance indicators used in decision support systems.
- Involved in Regression, Functional, Integration, System Testing and User Acceptance Testing
- Performed database validation according to the business logic by comparing the source to the target in Spreadsheet
- Work with source system personnel on source data delivery issues. Interacted with DBA for setting up test environment
- Created the test environment for Staging area, loading the Staging area with data from multiple sources.
- Extraction of test data from tables and loading of data into SQL tables
- Review test specifications, cases and performed manual testing
- Involved in Backend Database testing in Oracle using SQL.
- Followed State Street defined ETL Standards and Best Practices
Environment: QC, QTP, Clear Quest, Clear Case,DataStage 7.5, Oracle 10g, UNIX, SQL*plus, Windows NT and Autosys