Data Engineer/data Architect - Data Lake Delivery Lead Resume
SUMMARY:
- IT professional with over Fifteen years of IT experience, functioning in roles including Senior Data Architect, Data Modeler, DBA, Business Analyst, Data Analyst, Data Integration Developer and Team Lead
- Extensive experience with Data Warehousing, transaction and System Design in the Application Development space.
- Years Big Data Architect/Data warehouse experience with extensive knowledge on Hadoop platform especially Hortonworks solution including YARN, ZooKeeper, Oozie, Hive, Hbase, Spark, TEZ, HIVE, PIG, Kafka, Flume, Cassandra, MongoDB.
- Extensive knowledge and experience on ingestion tools like HVR, ATTUNITY.
- Extensive knowledge and experience on reporting tools especially Spotfire, Cognos, OBIEE.
- Broad experience in most relational databases e.g., Oracle, SQL Server, Teradata
- Excellent in Requirements Gathering with the ability to communicate effectively with business and technical partners.
- Outstanding project and team management skills.
TECHNICAL SKILLS:
Development Methodology: Waterfall, Agile.
BI Technology: Data Analytics, Data Warehousing, Inmon Methodology, Kimball Methodology, Slowly Changing Dimensions, Star Schema, OBIEE, COGNOS, Spot - fire, Denodo.
Modeling Tools: Embarcadero ER Studio, Erwin, SQL server Database Diagrams.
DBMS: Big Data MS SQL Server, Oracle SQL-Server, Sybase DBMS, TeraData
Programming languages: VB, Visual C++, Java, SQL, PL/SQL, ASP, Unix Shell, C# .Net, VB Script, Java Script, XML, Excel Macro
Integration Tools: SQL Server Integration Services, Informatica, Oracle SQL Loader, IBM COGNOS TM1 Turbo-Integrator, HVR, ATTUNITY
PROFESSIONAL EXPERIENCE:
Confidential
Data Engineer/Data Architect - Data Lake Delivery Lead
Responsibilities:- Model and manage all the data models within treasury.
- Design and manage ETL activities and team for treasury domains.
- Design and manage reporting development team.
- Monitor the activities of data quality, data profiling and Meta data.
- Plan and implement releases and updates.
- Respond to the needs of concurrent projects.
- Manage database developer and data analysts with hands on data analysis
- Monitor the activities related to design performance and come up with a solution.
- Review all the data model across treasury for treasury data warehouse.
- Design, plan, and execute MDM integration with treasury DW.
- Train new Data architects.
- Conduct Subject-Matter expert (SME) sessions.
- Grooms and prioritizes User Story backlog
- Successfully migrated many Treasury Data domain from Oracle platform to Data Lake.
- Architected and designed a future state solution for treasury data warehouse in Data Lake.
- Redesigned Star schema for Short Term funding, long Term funding, derivatives, Investment, Third Party Debt, Collateral data per Data lake standards.
- Redesigned and delivered reporting solution in Cash Management, Investment, and debt area. (enabling enhanced controllership & increase cash process monitoring)
- Architected and led a team to develop corporate reporting solution for the corporate investment management (CIM) accounting users through integrating and migration the investment portfolio from source system (SUMMIT) to Wall Street suite (DDS).
- Redesigned the Third-Party Debt (loans) to utilize IBM Cognos TM1 platform before we integrate the data to the Data Lake which result in eliminating a lot of changes at the lake and have cleaner data in the Data Lake.
- Designed a solution for the collateral data comes from different banks to eliminate the manual file process which resulted in reducing the processing time and increasing the accuracy.
- Architected and led a team to Intergrade Investment data to Treasury Data Lake.
- Revised our Data Architecture standardization in per the new platform the Data Lake.
- Redesigned our Data Mapping Specification to have one document for each star schema which resulted in consolidating many DMS for dimension and fact into one place which make it easier and faster to work with it and develop against.
- Created a new process to handle late arrival dimension and RI/none RI errors.
- Enhanced the release process by adopting a new IBM Udeploy tool and process which helps expedite the process of moving more projects and enhancement to production and eliminate the use of support team.
- Established a master review process for all model changes resulted in reusability of our existing design and increased the efficiency and improved data consistency
Confidential
Data Architect
Responsibilities:- Master reviewer for all the new and reverse engineering data models.
- Design, plan, and execute ETL activities plan to migrate data from old system to a new system.
- Train web application developers on using the new model and coding against it.
- Monitor the activities of data quality, data profiling, and Meta data.
- Plan and implement releases and updates.
- Manage and Monitor all schema physical activities
- Balance a variety of projects simultaneously.
- Monitor the activities related to improve performance and come up with a solution.
- Conduct Subject-Matter expert (SME) session
- Provided BI solution for shop-floor systems to facilitate On-Wing Engine Support
- Generated logical models to support TIPQA quality management systems
- Designed and developed a complex database for different aviation applications.
- Built a BI Solution to integrate SAP application with EDW and design Data Mart for Shop-floor maintenance systems
- Created DMS for ETL Architect in developing source - to-target data mapping
- Utilized Erwin 7.3 to generate modify existing models and generate DDL
- Facilitated sessions with SME’s and IT personnel to gather requirements.
- Worked on Enterprise Industry Standard Models for Teradata in Aircraft Engine Manufacturing using Kimball methodology
- Generated Data Models for a Document Management system
- Enhanced the data architecture for the Aircraft-wing and control segments control system
- Revised additional table and columns to satisfy new Train Transportation system requirements.
- Updated the Engine-parts Warranty System data architecture
- Utilized the Erwin to keep all models and metadata up to date with requirements
- Trained developers on best approaches to design queries for a specific database worked with data tools and technologies - data modeling, ETL tools, meta data management tools, master data management tools, database technologies and design created and implemented project level data backup and recovery architecture
- Created data model policy and a naming convention for Teradata, oracle and SQL server
- Led implementation of the enterprise data dictionary and enterprise master data content for a specific project (i.e., definition, type, format, gold source, and content)
- Lead resolution of end to end data issues, data design issues and end to end data test issues
- Lead the implementation of PDM to help the optimization of database queries
- Reviewed the work of the database Administrators against the PDM
- Created ETL to migrate the Database from a legacy system to Oracle
Confidential
Technical Data Architect/ Data Analyst
Responsibilities:- Create conceptual, logical, and physical Data model.
- Created DDL and physicalize data models.
- Perform data analysis.
- Perform Data quality activities.
- Conduct training session in order to train developer on the model.
- Master reviewer for all the new and reverse engineering data models.
- Design, plan, and execute ETL activities plan to migrate data from old system to a new system.
- Train web application developers on using the new model and coding against it.
- Monitor the activities of data quality, data profiling, and Meta data.
- Plan and implement releases and updates.
- Manage and Monitor all schema physical activities
- Balance a variety of projects simultaneously.
- Monitor the activities related to improve performance and come up with a solution.
- Conduct Subject-Matter expert (SME) session
- Provided a complete solution for the state of Michigan for energy saving program using SQL server (SSIS, SSAS, SSRS).
- Built a DW to track all the customers participated in energy saving program for multiple states.
- Established an end-to-end Data Warehouse of consumer profiles using SQL Server
- Streamlined process and data migrating procedures from Excel and access to SQL server
- Manage scheduled and ad-hoc data processes and reports
- Analyzing data acquired from different source systems.
- Conducting a full lifecycle analysis for the data.
- Create stored procedure, triggers, functions and views in SQL server
- Acquired data from different source and uploaded to SQL server.
- Redesigned existing Data Models, Data dictionary, and created new database object: tables, stored procedures, views for existing applications
- Supported the process of Migrating SQL Server from windows server 2000 to Windows server 2003
- Migrating SQL Server 2000 to 2005
- Cleansing, messaging Data from more than a source and feed into SQL server database
- Create/modify stored procedure, triggers, functions and views in SQL server
- Manage and maintain ETL process using DTS packages
- Migrate/Upgrade databases
Confidential
DBA /Technical Data architect
Responsibilities:- Reverse Engineering the existing Data Model from oracle and DB2
- Database design/implementation
- Migrate/Upgrade databases/Backup/restore/Refresh database and maintain users/privileges
- SQL Tuning using profiler
- Work with system admins, App Arch, and application groups for testing the new environment
- Design/install/monitor backup jobs
- Redesigned Tables, queries, and stored procedure to enhance the performance
- Implementing Data Integrity by Using Constraints and Triggers
Confidential
Business Analyst/Programmer/Software Developer/Data Analyst, product manager
Responsibilities:- Design a migration plan for Data and web application across platforms and executed it.
- Generate Data models, completed Data Architecture Design and implementation
- Complete identification, assessments and analysis phases of the SDM process for re-engineering a database design for existing applicationsd
- Design/implement process improvements
- Support SharePoint and eRoom application Database
- Develop functions to import data from input files to relation database.
- Merge SQL Servers database thus reducing the number of physical servers and support effort
- Created a proactive Monitor process for eRoom and SharePoint which resolved many technical issues. Created a program that made it possible to extract eRoom data along with folder configurations to be imported to non eRoom environments
- Redesigned database processes to clean up log tables which significantly reduced the time and effort of implementation and made it possible to run it anytime during business hours. Created a proactive Monitor process for eRoom which resolved many technical issues
- Worked with key project stakeholders to understand and validate high level requirements, determine the scope, develop and document the detailed requirements for the vendor application development team
- Created all application documentation (business, technical, traceability).
- Liaison for all new enhancements between IT business and vendor teams
- Managed all aspects of the new enhancements to the system
- Resolved technical issues relating to architectural complexities. Explained solution to project
- Stakeholders and any potential impact as a result of the changes
- Created test plans and test cases in accordance with customer specifications