Sr Database & Datastage Developer Resume
Columbus, GeorgiA
SUMMARY
- Around 7.5 years of professional experience in system analysis, design, development and implementation of Data Warehousing Systems using DataStage, application development and Production Support.
- 10 months of experience as graduate research assistant in University of South Alabama performing research on Android platform application.
- Hands on Experience in Designing and Building Enterprise Data Warehouses using IBM Info Sphere DataStage (v 11.7, v11.3, v9.1, v8.7, v 8.5, v8.1, v7.5).
- Experience in working with Banking & Financial industry with involvement in various banking sectors like Mortgage, Online & Mobile banking platforms, Loans, Securities & Trust, Health Care industry like health insurance data.
- Experience as working with onsite - offshore model projects while working closely with clients and team members.
- Possess extensive experience in Data Management and Data Integration, creating data integration ETL jobs using DataStage and developing SQL scripts for data validation as a part of data management.
- Experience in working as Data Governance team with involvement in gathering, documenting and analyzing the Business Requirement Documents, Software.
- Highly knowledgeable in concepts related to Data Warehouses schemas, Star Schema modeling and Snowflake modeling and processes.
- Proficient in data warehousing techniques for data cleansing, Slowly Changing Dimension phenomenon, surrogate key assignment and CDC (Change Data Capture).
- Experience as working with various Relational Data Bases (RDBMS) as Oracle, Teradata, Netezza, MS SQL Server, DB2 and ODBC stages dealing as both source and target systems.
- Extensive knowledge and experience in Parallel job stages (Datasets, Sequential file, Aggregator, Funnel, Filter, Look-Up, Surrogate Key, Remove Duplicate, Transformer, Column/Row Generator and Peek) along with Complex Flat Files formats.
- Experience in working with Infosphere Information Analyzer to perform column analysis as a part of data profiling and data quality assessments.
- Experience in loading high volume data, debugging, troubleshooting and performance tuning.
- Experience in UNIX environment as working with (Korn) Shell Scripts to automate file manipulation and data loading process.
- Experience working with Microsoft SSIS and SSAS
- Worked on different scheduling tools like TWS and Control-M and knowledge on Autosys.
- Excellent communication skills and analytical skills and ability to perform as part of the team.
TECHNICAL SKILLS
ETL & Data Warehousing: IBM Info Sphere DataStage v 11.7, 11.3.1, v9.1, v8.7, v8.5, v8.1 and Ascential DataStage 7.5, ABINITIO GDE 1.12 & Co>operating System 2.1, SSIS, SSAS
Databases: Oracle, MS SQL Server, Teradata, Netezza and DB2
DB Tools: SQL Developer, SQL Navigator, SQL Loader
Programming Languages: C, C#, JAVA, SQL and Python
Data Modelling: Dimensional Modelling like Star Schema, Snowflake Schema
Operating Systems: Windows 7/XP /2000/NT/98, UNIX
PROFESSIONAL EXPERIENCE
Confidential, Columbus, Georgia
Sr Database & Datastage Developer
Responsibilities:
- Design, Develop, Maintain and improve data structures, queries and reporting solutions.
- Create Extract-Transform-Load (ETL) processes and data warehousing strategies for all the mission critical projects.
- To serve as a subject matter expert in data and databases.
- Mentor junior staff members and works with other developers and production DBA's to ensure scalable, efficient and optimized solutions.
- To provide best practice guidance to the development team with regards to Database and DataStage development.
- Perform Data Design and usage, including code reviews and data validation.
- Works closely with customers, management, business analysts and team members to understand business requirements that drive the analysis and design of quality technical solutions and to ensure that the end to end designs meet the business and data requirements.
- Develops ETL audits and controls to ensure quality of data meets or exceeds defined standards and thresholds. Develops and document systems, processes and logic required to expose existing data sets in the warehouse to end users for reporting and analytical purposes.
- Extends the data model to house additional structures as needs to meet applicable regulatory requirements. Designs data warehouse or data mart fact tables, aggregate tables and dimensions. Delivers quality integration projects, standards, best practices and data dictionary.
- Analyzing mapping sheet and prepare ETL Functional and Technical specification document to build DataStage Jobs.
- Designing and developing DataStage jobs for Extracting, Cleansing, Transforming, and Loading data into EDW and different Data Marts.
- Building SQL queries to fetch the data from SQL Server Database as per the business requirement and use the SQL queries in the DataStage for further processing.
- Debugging, Troubleshooting, Monitoring and Performance Tuning of DataStage Jobs and SQL Server scripts.
- Reviewing of code and detection of code related errors and providing solution to rectify the error.
- Developing and executing ETL test plans and maintaining test documents for further reference.
- Providing status and progress reports on development and maintenance activities as required to IT Manager.
- Working on Information Analyzer for column analysis of the new SOR data.
- Performing Data Profiling using Information Analyzer for Column, Primary Key and Foreign Key Analysis.
- Other similar professional responsibilities may also be assigned.
Environment: DataStage v 11.7, & v11.3, Oracle, SQL, MS SQL Server, Windows 7.
Confidential, Schaumburg, Illinois
DataStage Consultant/Lead
Responsibilities:
- Reviewed the project scope, requirements, architecture diagram, proof of concept (POC) design and development guidelines.
- Created S2T documents also done the data profiling and data scrubbing for Test data management (TDM).
- Dealt with various development/debug stages like row generator to create the test data for the jobs.
- Extensively used Dataset, Aggregator, Sort, Join, Funnel, Lookup, Merge, Filter and other parallel stages in developing the solution.
- Dealt with various database stages (Oracle, DB2 stages) as a source and target systems.
- Worked with DataStage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into target files.
- Dealt with hash files for internal data flow across the jobs also for removing duplicates in server jobs.
- Performed various kinds of joins using join stage for the expected results.
- Created Job parameter sets for reusing the parameters.
- Writing Shell Scripts and scheduling Jobs using TWS.
- Worked with UNIX environment to execute (Korn) shell scripts along with basic tasks.
- Monitored the jobs/processes by utilizing the Director Logs and various Environment variables.
- Involved in weekly Code Review meetings to ensure the code deliverables meet the standards.
- Developed and unit tested ETL jobs according to requirements in the Technical Specifications.
- Involved in weekly project plan meetings to track the progress of work and to reach the milestones.
- Achieved the project success within the committed timelines and quality of work as a great working experience with offshore team of developers and with the client.
Environment: DataStage v9.1 and v8.7, Oracle, DB2, Teradata, Netezza, SQL, MS SQL Server, UNIX, Windows 7, WinScp, Putty.
Confidential
Sr Project Engineer
Responsibilities:
- Involved in developing the high standard DataStage code as per the business rules set by SME and mapping documents from data modeler
- Performed complete unit testing of the code developed by testing the code with both positive and negative scenarios.
- Involved in pushing the code to system testing team and providing knowledge transfer sessions on the developed code for better understanding.
- Fixing the defects in the current production system and maintaining the current production system.
- Involved in creating the scheduler wrapper scripts for DataStage jobs to be scheduled in the scheduler.
- Implementing the code into production by coordinating with the admin team along with scheduling the batch jobs.
Environment: DataStage v8.5, Oracle, Teradata, UNIX, Putty, Win SCP, TWS, and Windows XP.
Confidential
Project Engineer
Responsibilities:
- Analyzed the data and gathered the requirements for building a data warehouse.
- Actively involved in analyzing the old database system and mapping tables, relationships, columns
- Enforced the Business Rules by creating constraints.
- Successfully managed Extraction, Transformation and Loading (ETL) process by pulling large volume of data from various data sources.
- Tested to optimize the Stored Procedures and Triggers to be used in production.
- Created Database Objects Tables, User defined functions, Triggers, Stored Procedure, Constraints.
- Successfully implemented indexes on tables and views for optimum performance tuning.
- Debugging / editing the existing SQL Scripts.
- Optimized the performance of various SQL scripts.
- Documented all process and Data Flow involved in the database for future reference.
Environment: DataStage v8.5 and v8.1, SQL Server, UNIX, Teradata, Control-M, Putty, Windows XP.
Confidential
Project Engineer
Responsibilities:
- Extracting, Transforming and Loading data into Oracle tables using DataStage as ETL tool by applying various business rules.
- Prepared the detailed definition documentation of requirements, design, and development for the sources.
- Used DataStage Designer for extracting data from Flat files, UNIX file system (data as flat files).
- Used DataStage Manager for importing metadata from repository, creating new job categories and new table definitions.
- Created table definitions and look-up reference data from Revenue Management and Contract Accounts.
- Wrote transformation logic by using different functions like Field, Trim etc., for formatting data from source systems.
- Aggregated the borrower’s data and loan data for loan sales.
- Extensively involved in analyzing the data for each load (Weekly/Monthly) and working with the Business group to modify or re-define the transformation rules due to discrepancies in the data.
- Creating and using the data sets for testing and debugging the jobs.
- Creating Sequencers for executing the jobs in batch and combining different job interfaces.
- Creating email notifications in Sequencers for emailing the error logs, exceptions and job status.
- Using the DataStage Director and the log files for monitoring the errors and results, resolving the DataStage jobs locking by using clean up resources in DataStage Director.
- Tuning SQL statements in existing programs and creating new SQL queries (by effectively using them) to analyze the performance of queries.
- Involved in preparing and executing test for unit and integration testing.
Environment: DataStage v8.1 and Ascential DataStage v7.5, SQL, TWS, Oracle, Teradata, UNIX, Putty,