Datastage Developer Resume
SUMMARY
- DW & BI Professional with around 12 years of experience in Design & Delivering Data Warehouse & ETL solutions
- Experienced in Data Architecture, design, implementation and maintenance of OLAP Systems
- Extensive experience in development and maintenance of ETL integrations using Datastage, Pentaho, Talend
- Hands - on experience in various RDBMS platforms Teradata, DB2, Oracle, PostgreSQL, SQL Server
- Involved in Project Planning, Functional Specification, Design specification, Impact analysis, System test plan, User training, High and Low level documentation.
- Keen understanding of Data Warehouse Architecture and Concepts
- Strong Online Analytical Processing (OLAP) Data Warehousing Design and techniques: snowflake and star schemas design for the integration of fact and dimension tables.
- Having good knowledge of end-to-end project flow from gathering requirements to till transition
- Experience in loading Geospatial data into Postgis spatial database using Pentaho Kettle(PDI)
- Experience in Code Optimization and performance tuning of SQL queries including Re-indexing, Updating Statistics, Recompiling Stored Procedures and other maintenance tasks
- Working Knowledge in Teradata load utilities including Fastload, MultiLoad and BTEQ
- Hands-on expertise in SQL, ETL Control mechanism and database design
- Worked extensively in UNIX client/server environment and have good exposure in shell scripting.
- Worked on the Sqoop, Hive and HDFS file system for Hadoop archival from Teradata.
- Sound experience in load monitoring and scheduling tool (Control-M Desktop and Enterprise Manager)
- Have Domain Knowledge in Healthcare, Retail and, Telecom
- Sound experience in Change management tools (HPSD Server Desk) and dimension tools like (PVCS dimensions and Teamprise).
- Good understanding of Agile Practices with working experience in agile model
- Excellent problem solving, analytical, Customer Interaction skills
- Good team player, strong interpersonal and communication skills
TECHNICAL SKILLS
ETL Tools: Data Stage(Server and PX), Pentaho, Talend
Hadoop Technologies: Sqoop, Hive, HDFS
Database: Teradata, Oracle, DB2, PostgreSQL, SQL Server
Programming Languages: SQL, BTEQ and UNIX Shell programming
Scheduling Tool: Control-M Desktop/Enterprise Manager and Crontab
Operating Systems: UNIX, WINDOWS XP, AWS Cloud based systems
Reporting Tool: Crystal Reports 10
Data Modeling: Erwin, pgModeler
PROFESSIONAL EXPERIENCE
Datastage developer
Confidential
Responsibilities:
- Involved in Requirements Analysis, Pre-scoping, Data profiling activities to understand the requirements and system design
- Used Datastage as an ETL tool to extract data from sources systems, loaded the data into PostgreSQL and Dynamic CRM database.
- Analyzing the existing system process and functionality and designing ETL strategy for the new system with the respective appropriate functioning techniques.
- Driving Coordination meeting for onsite-offshore calls related to the functional and technical issues.
- Created DataStage jobs using different stages like Transformer, Aggregator, Sort, Join, Lookup, Data Set, Funnel, Remove Duplicates, Copy, Modify, Filter etc
- Loading data from various sources like OLEDB, flat files to PostgreSQL database Using Datastage jobs.
- Documented ETL design document, test cases and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.
- Created shell script to run data stage jobs from UNIX and then schedule this script to run data stage jobs through Control-M scheduling tool
Datastage developer
Confidential
Responsibilities:
- Played primary ETL Architect role, from Requirement gathering to End delivery of Data-Integration layer for analytical models
- Taken the responsibility of designing of creating common data store from flat files into FH’s Datastage/DB2 platform
- Responsible for Architecting ETL Strategy for new systems, designing the Integration layer using Datastage ETL tool
- Taken primary role in gathering the initial requirements by working closely with the Business Analysts and transitioning the requirement back to development team.
- Created DataStage jobs using different stages like Transformer, Aggregator, Sort, Join, Lookup, Data Set, Funnel, Remove Duplicates, Copy, Modify, Filter etc
- Responsible for analyzing SAS code related to Members, Claims, Eligibility and converting into ETL transformation using Datastage to store in DB2 data store.
- Developed UNIX shell scripting as per requirement
- Extensively used Control-M to prepare the project flow
- Closely worked with testing and data quality team from onsite to resolve the issues during SIT/UAT
- Providing design and technical guidance to team members during development
- Documented ETL design document, test cases and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.
- Driving Coordination meeting for onsite-offshore calls related to the functional and technical issues.
- Responsible for reviewing the code, developed by the team members
- Handled all the defects raised during the SIT/UAT phases and resolved defects within the planned window time.
- Effectively Used Team Foundation Server to maintain the code Version control
- Post implementation support after deployment.
Lead BI Engineer
Confidential
Responsibilities:
- Taken the End-to-End delivery responsibility of Architecting, designing of migrating ODS, GDM and SSA warehouse subject areas from legacy IBM DB2/DataStage to Confidential -ADW Teradata platform.
- Responsible for Designing, Architecting ETL Strategy for new systems, designing the Integration layer for DataStage & Teradata platforms.
- Developed BTEQ, Fastload, MultiLoad scripts to load the data into Teradata warehouse
- Providing design and technical guidance to team members during migrating/development
- Driving Coordination meeting for onsite-offshore calls related to the functional and technical issues.
- Responsible for reviewing the code, developed by the team members
- Handled all the defects raised during the SIT/UAT phases and resolved defects within the planned window time.
- Collaborated with all the teams for environmental readiness for the SIT and UAT phases
- Involved in Migration of the objects into the Test Environment and Client Environment
- Core team member in the creation of Implementation Plan
- Handled all the issues and post production defects raised during the Implementation phase
- Involved in support for the developed jobs in PROD environment until it gets signed-off
- Co-ordinate with support teams for Knowledge transition.
Datastage developer
Confidential
Responsibilities:
- Taken primary role in gathering the initial requirements by working closely with the Business Analysts and transitioning the requirement back to offshore.
- Prepared the high-level process flows diagram.
- Closely worked with the Business Partners, testing and Business data quality team from onsite to resolve the issues during SIT/UAT
- Reviewing the implementation plan to make sure all the back out strategies/steps in implementation plan is in proper shape and getting it approved from the gatekeeper.
- Worked closely with the support team members in giving them transition related to the program.
Datastage developer
Confidential
Responsibilities:
- Analyzing the existing system process and functionality and designing the new system with the respective appropriate functioning techniques.
- Used DataStage as an ETL tool to extract data from sources systems, loaded the data into DB2 database.
- Designed and Developed DataStage Jobs to Extract data from heterogeneous sources, Applied transform logics to extracted data and Loaded into Data Warehouse Databases.
- Created DataStage jobs using different stages like Transformer, Aggregator, Sort, Join, Merge, Lookup, Data Set, Funnel, Remove Duplicates, Copy, Modify, Filter, Etc
- Extensively worked with Join, Look up (Normal and Sparse), sequential file, dataset,file set and look up file set stages.
- Used my extensive knowledge on ADW to discuss with Domain partner about analysis on multiple applications and to clarify their questions on the same
- Created shell script to run data stage jobs from UNIX and then schedule this script to run data stage jobs through Control-M scheduling tool.
- Coordinate with team members and administer all onsite and offshore work packages.
- Performed performance tuning of the jobs by interpreting performance statistics of the jobs developed.
- Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.
- Involved in support for the developed jobs in PROD environment until it gets signed-off
- Co-ordinate with support teams for Knowledge transition.
Datastage developer
Confidential
Responsibilities:
- Worked as lead developer and taken prime role in gathering the initial requirements
- Prepared detail design document as per business requirements.
- Played a key role for the project in developing source to Confidential mapping document
- Developed DataStage Parallel Jobs and UNIX shell scripting as per requirement
- Extensively used Control-M to prepare the project flow
- Fixed the Issues raised during the UAT and SIT in QC
- Taken lead to deploy the codes to production by using tools WBSD package creation