Etl Datastage Developer Resume
5.00/5 (Submit Your Rating)
Plano, TX
SUMMARY
- 5+ years of Data Warehousing experience in the areas of ETL design and development.
- Involved in complete Software Development life - cycle (SDLC) of various projects, including requirement gathering, system designing, data modeling, application development, enhancement development, maintenance and production support.
- Extensive knowledge in Development, Analysis and Design of ETL methodologies in all the phases of Agile Scrum and Waterfall Spiral Data Warehousing life cycle.
- Proficient in C++, Java, C#, SPARC Assembly and UNIX Scripting
- Expertise in IBM Information Server using DataStage Client components like DataStage Administrator, Manager, Designer, Director and Web-Sphere in Data Warehouse development
- Extensively used, Sequential files, data sets, XML, Web-Services for data extraction and target loads.
- Experience in troubleshooting of jobs and addressing Production Support related issues like performance tuning, enhancement and finding Root Cause Analysis to troubleshoot problems.
- Created various Parameters and Parameter Sets for multi-instance jobs and environmental variables to be used across various projects and across various parallel jobs by leveraging DataStage Administrator
- Great grasp on problem solving skills required for Production Support and doing Route Cause Analysis
- DataStage 8.5, 9.3 and 11.3
- Converted SQR’s into DataStage jobs for Peoplesoft 9.2 HCM upgrade project
- Creating Stages in IBM Info-sphere Data Stage 11.3 according to Business Requirements which were converted into Technical Requirements to populate tables in Vertical Data Domain (VDD)
- Create JIL scripts and Stealing for FTP and automating ETL jobs through JIL scripts leveraging CA’s Autosys Job scheduler via Unix and Web Interface
- Creating complex stages in Designer Client using stages like Join, Lookup, Filter stage, Modify, Copy, CDC, Join, Row Generator and many other stages in accomplishing the ETL Coding
- ETL Process designed as Source to Target from: Database to Database, Database to flat-file and flat-file to flat-file stage processing
- Informatica ETL Training
- Undergoing Informatica Training from informatica University
- Exposure to Informatica Power Center 9.6
- Understanding of Informatica and its role towards ETL and Data Management
- Hadoop Hortonworks HDP 2.3.2
- Data ingestion- Using Hadoop HDFS using file system shell using FLUME
- Data transformation- executing PIG scripts and PIG relation with HIVE table
- Data analysis- Running HIVE queries using Tez and Vectorization
- SQL/NoSQL: PL/SQLConstruct SQL queries to retrieve dataUnderstanding of NoSQL databases that allows for high-performance, agile processing
- Good understanding of the power of PL SQL and able to write complex SQL commands
- Programming Experience with various programing languages through school curriculum Java, C #, Unix programing, assembly language
- SQL programming for Oracle Database AnalystLearning .ora file architecture in Oracle
- Data analysis- Running HIVE queries using Tez and Vectorization
PROFESSIONAL EXPERIENCE
ETL DataStage Developer
Confidential, Plano TX
Responsibilities:
- Daily use of ETL tools to develop and maintain Operational Data Store (ODS system) using DataStage 9.1 IBM Info Sphere for Web Services
- Provide data to IBM Business Process Manager tool using A web service and a WSDL to communicate between the front end tool and the backend Oracle database stored in an ODS
- Worked with address data as the domain and designed complex ETL process to populate ODS which consist of data for address, property, tenant, cost by market propensity to purchase, building scoring, pre scope stage and building search. This data was used by the front end BPM tool which was used by the end users at the company
- Created functional and technical design documents, mapping documents for business requirements and converting it into Technical documents
- Involved in DataStage version upgrade activities for export and import of all the ETL jobs, setting up the environmental variables, testing jobs, modifying the scheduled batch jobs
- Used SOAP API and Web Service XML stage and ISD stage to connect BPM with DataStage and used Information Server Manager and Web-Sphere to deploy and up-deploy jobs
- Ensuring reusability of existing code and documentation. Contribution to new development standards and best practices
- Used Informatica Metadata Management to get an understanding of the current ODS system and how it relates to the Fact Dimension
- Production Support Lead to solve daily problems and conducting root cause analysis to find where the problem is initiated.
Data Integrator (ETL Developer)
Confidential, Roswell GA
Responsibilities:
- Daily use of ETL tools such as DataStage 8.5, 9.1 and 11.3 on IBM Info Sphere
- Worked on Solution design and ETL development for the proposed functional requirement
- Data Management experience with creating Data Stage jobs using PeopleSoft Data Source
- Training in Relational Database Management Systems and Data Warehousing and Data Stage 9.2
- Expertise in IBM Information Server: DataStage, QualityStage, Information Analyzer
- Handled ETL jobs with Data mapping: source to target and target to multiple formats Performance tuning of ETL jobs
- Used Agile development to design and create ETL programs to address requirements from new data sources
- Reviews ETL programs developed for compliance with best practices, standards, enterprise architecture and documentation requirements, ETL process, programs and scripts
- Software Development with understanding of ETL, EAI and SOA technology.
- Designed the mapping documents between source databases and target databases
- Developing parallel jobs and server jobs using various processing stages (Transformer, Lookup, Join, Filter, Merge, Funnel, Remove Duplicate Stage etc.) and Development/debug stages (Peek stage, Head & Tail Stage)
- Worked on Oracle 12c using PeopleSoft data for a PeopleSoft 9.2 upgrade project
- Great understanding of Data structures and Oracle and PeopleSoft tables and schema
- Provide ETL support and operations issue resolution and troubleshooting
- Design, develop and maintain conceptual, logical and physical data models for Enterprise Data warehouse
- End to End testing on SQR’s developed during PeopleSoft upgrade project from 8.8 to PeopleSoft 9.2
- Creating Stages in IBM Info-sphere Data Stage 11.3 according to business requirements to populate tables in Vertical Data Domain
- Hadoop Integration to load data into a Hive table from an HDFS Directory, Storing the data from a Pig relation into a folder in HDFS; Import data from a table in a relational database into HDFS
- Setup JIL scripts and Stealing as FTP Unix box and automating ETL jobs through JIL scripts through Autosys
- Effectively used DataStage Manager to Import/Export projects from development server to production server. Parameterized jobs for changing environments.
- Worked on Production support team to help analyze the problem and provide solution accordingly.
Business Analyst & System Engineering Analyst
Confidential, Duluth, GA
Responsibilities:
- Systems Engineer and Business Analysis were my major responsibilities at EMC, along with working in Enterprise Pre-Sales
- Creating complicated Visio modules for EMC infrastructure with EMC clients
- Browsing and analyzing market to best understand potential growth in a particular market
- Understanding Client’s requirements and designing business strategies to offer EMC architecture solution
- Helping Account Executive with new potential client study and help enhance the relationship between EMC client and Customer Executive in any way possible
- Responsible for the Oracle 11g DB for creating modifying and updating tables according to the business requirements.
- Worked on UNIX Scripting and AWK commands with NAWK and GAWK Environments supporting the daily demands of the business and meeting the expectation of front end user
- Used Open Source ETL software called Taled Open Studio for Data Integration for using flat files provided by the business and loaded them to staging tables in Oracle 11g for Data Warehousing
- Worked with Raw Customer Transactional data and applied star and snow-flex schema to model the data for faster access
- Experience with SQL query performance tuning and de-normalization of database
- Created various stages in ETL tool from source to target being file to Database conversion
- Worked end to end for ETL process from getting flat files from our vendors to loading data from flat files to staging tables
- Developed ETL process to transform staging table data and load it into the ODS system for further processing done by users