Data Integration/technical Architect Resume
Reston, VA
SUMMARY:
- Total experience of 10 years as Data Integration Architect, Data Modeler, ETL Lead/Developer using technologies like Ab Initio, Informatica, B2B DT, PySpark, Python, UNIX shell programming, Oracle PL/SQL, Teradata, Netezza, DB2 and AWS Cloud. I have extensively worked in functional area and in end - to-end of delivery of application from Requirement analysis (mapping)/gap analysis, ETL design (logical and technical design), Modeling, development, testing, debugging and maintenance of complex systems.
- Extensive experience on designing & developing BI applications using Ab Initio, Informatica PowerCenter, B2B Data Transformation, DB2, Teradata and Oracle PL/SQL, Netezza NZSQL and AWS Cloud.
- Excellent Knowledge of Business Intelligence and Data Warehousing Concepts.
- Extensively worked in designing and building Type 1, Type 2 and Type3 based star & snow-flake schema data warehouse and 3NF model based Data Stores.
- Developed strategies for Extraction, Transformation and Loading process.
- Well Versed with all the Parallelism Features of AbInitio 3.0 and Multi File System (MFS) techniques.
- Good knowledge in using AbInitio Meta programming/PDL for building Meta Data Driven ETL process for data store.
- Used Conduct>IT for job scheduling wherein created several plans using resources.
- Have good knowledge on AbInitio Meta Environment (EME) for application version control, code promotion and deployment.
- Worked on performance and tuning of Ab Initio ETL graphs, processes and load routines.
- Developed Meta Data driven XML and Flat file format vending to called ‘VaSE’ (Vending as Service for Enterprise)
- Developed Meta Data driven ‘Automated validation Tool’ used to compare data between different layers.
- Implemented Data Quality validation rules based on the Rule Engine.
- Expertise in Informatica B2B Data transformation tool
- Worked extensively in Informatica PowerCenter 9.6
- Excellent knowledge in using Inforamtica Partition
- Well versed in using Informatica feature ‘Push down Optimization’
- Good knowledge of Workflow Scheduler
- Good knowledge in Python and PySpark, implemented proof of concept for Meta data driven XML/Json flattening.
- Worked on load scripts like SQL loader (Oracle), Fast load, MultiLoad, Fast Export and Tpump (Teradata utilities).
- Worked on Netezza NZSQL to load data to EDW
- Experience working with various Source Systems like Oracle, DB2 UDB, XML, JSON and Flat files.
- Experience in the Teradata developing BTEQ scripts.
- Extensive experience developing Oracle SQL, PL/SQL (Coding Procedures, Functions, Database Packages and Triggers) for ETL processes.
- Extensive experience working writing UNIX Shell scripts for ETL process, created number of Automation Tools.
- Worked with modelling team to Model the Data store/ Data warehouse systems.
- To a great extend worked closely with BAs and Data modellers on creating mapping document .
- Worked with business users to translate requirements into system flows, data flows, data mapping and relevant technical documentation.
- Lead design and develop data warehouse solutions using different architecture, design and modelling techniques
- Good experience in Functional testing, Regression testing, Integration testing , Performance testing, Load testing and Impact testing .
- Good domain knowledge on Basic banking and Mortgage backed Securities (MBS) life cycle.
- Excellent planning, analytical, written, communication and interpersonal skills.
- Familiar with different software development methodologies like Waterfall, Iteration, SAFE Kanban & Scrum.
TECHNICAL SKILLS:
RDBMS: Oracle 12c, DB2 v8, Teradata 13.10, Netezza 7.0
ETL: Ab Initio 3.1, Informatica PowerCenter 9.6, Oracle PL/SQL
Other software Tools: Toad, DB2 command editor, Teradata SQL Assistant, Aginity work bench 4.3
Language: Oracle SQL, PL/SQL, Java, J2EE, Python, PySpark
Version Control tools: EME, VSS
Scripting Language: Unix Shell Programming, HTML and Java script
OS/Environment: IBM AIX, HP-UX, LINUX, Windows 2000/XP, Windows NT
Job scheduling: Autosys, CA7
PROFESSIONAL EXPERIENCE:
Confidential, Reston, VA
Platform: Windows 2000, Linux.
Technology/Software: Informatica PowerCenter 9.6, Ab Initio 3.14, Oracle 11g, Netezza, Autosys.
Data Integration/Technical Architect
Responsibilities:
- Responsible for translating requirements created by functional analysts into the ETL architecture and describing it through architecture and design artifacts.
- Worked with Data Modeling team to design the Data Store model and Meta data storage model for vending.
- Created the Meta data frame work the data store.
- Involved designing and implementation of Non-functional requirements of the application, like identifying requirements and implementing generic components to handle it.
- Reviewed technical design documents and codes based on prescribed coding standard documents.
- Developed technical design and implementation documents.
- Developed Meta data driven XML and Flat file format vending process using Ab initio.
- Developed to tool to sweep the code base line for standard and hard coding using B2B Informatica DT.
- Designed and worked in implementation of Instrument level locking for the Data store.
- Implemented proof of concept for XML flattening using the PySpark and Python scripting.
- Define process review.
- Job orchestration design.
- Performance testing tuning the ETL process.
Confidential, Atlanta
Platform: Windows 2000, Linux.
Technology/Software: Ab Initio 3.14, Oracle 11g, Autosys
Project ETL lead/Architect
Responsibilities:
- Created logical design docs from the data requirements.
- Involved in Source target mapping documents for the ETL process.
- Design of the application.
- Reviewed technical design documents and codes.
- Developed technical design docs.
- Developed common graphs for delta process, backup strategy and re-run mechanism.
- Used Ab Initio EME for version control.
- Code review.
- Job orchestration.
- System test support and production migration.
Confidential, Herndon
Platform: Windows 2000, Linux.
Technology/Software: Ab Initio 3.14, Oracle 11g, Autosys
Project ETL lead/Architect
Responsibilities:
- Created logical design docs from the data requirements.
- Involved in Source target mapping documents for the ETL process.
- Worked with modeling team to build the model for data store.
- Involved system design of the application.
- Reviewed technical design documents and codes.
- Developed technical design docs.
- Developed generic components for extraction, CDC, loading, reject capture, reference data processing, reject reporting, and surrogate key maintenance.
- Implemented Meta data driven the ETL process for loading the data store.
- Used Ab Initio EME for version control.
- Code review.
- Job orchestration.
- System test support.
Confidential, Atlanta
Platform: Windows 2000, HP-UX.
Technology/Software: Ab Initio 2.15, Teradata 12
Project ETL lead/Architect
Responsibilities:
- Developed High Level Design docs from the functional requirement. .
- Involved in Source target mapping documents for the ETL process.
- Reviewed Technical design documents and codes.
- Developed Technical design docs.
- Developed graphs using Ab Initio components for type two table versioning.
- Used Ab Initio EME for version control.
Confidential, Atlanta
Platform: Windows 2000, HP-UX.
Technology/Software: Ab Initio 2.15, DB2 v8
Project ETL lead/Architect
Responsibilities:
- Developed High Level Design docs from the functional requirement. .
- Involved in Source target mapping documents for the ETL process.
- Reviewed Technical design documents and codes.
- Developed Technical design docs.
- Developed graphs using Ab Initio components.
- Developed Ab initio Macros for dynamic controlling graph components.
- Implemented the Meta data driven Data Quality validation rules from rule engine.
- Used Ab Initio EME for version control.
- Reviewed graphs of the other Team Members.
- Co-ordinate offshore team in executing the project plan.
Confidential, Atlanta
Platform: Windows 2000, HP-UX.
Technology/Software: Ab Initio 2.15, DB2 v8
Technical lead
Responsibilities:
- Developed High Level Design docs from the functional requirement.
- Involved in Source target mapping documents for the ETL process.
- Worked with Modelling teams to prepare the warehouse model.
- Reviewed Technical design documents and codes.
- Developed Technical design docs.
- Developed graphs using Ab Initio components.
- Used Ab Initio EME for version control.
- Reviewed graphs of the other Team Members.
- Co-ordinate offshore team in executing the project plan.
Confidential, Atlanta
Platform: Windows 2000, HP-UX
Technology/Software: Ab initio 2.15 and Tera data
Technical lead
Responsibilities:
- Code implementation of slowly changing dimension model using Ab initio ETL tool.
- Creating scripts for database objects (tables, indexes and views)
- Creating Entity-Relationships diagram using ER Win Data Modeler.
- Performing unit and Integration testing and verifying the test results through Backend as well as front end
- Basic performance tuning of the sql queries
- Preparing release notes during incremental release of modules in each build
- Creating UNIX based email notification reports on the Run Status of the application and report on final consolidation of the run time for each job.
