Lead Data Engineer & Solution Architect Resume
New, YorK
SUMMARY
- Over 13+ years of Information Technology Experience in Data Engineering, ETL Architecture design, Solution Architect, Data Modeling, Data Warehouse design, Data Quality Management, Master Data Management & Data Migration projects.
- As a Lead Data Engineer & Solution Architect, provided high quality technology solutions on Application Design, Development, Testing, Implementation, Maintenance and Supporting for an Enterprise level Data Integration, Data Warehouse (EDW) Business Intelligence (BI) solutions using Operational Data Store (ODS), Data Warehouse (DW)/Data Mart (DM), using Informatica Powercenter, IDQ & MDM tool.
- 12 + years of working experience in Banking and Financial Services (BFS) with domain noledge in Trades, Sensitivities, Positions, Collaterals, Securities, Counterparty & Customer Account Reference Data and other financial/compliance data.
- 13 years of extensive experience in Informatica Powercenter ETL Architecture design tool including, Power Exchange, IDQ and Master Data Management ( MDM )
- Good Knowledge in Big data technologies using Informatica ETL with HDFS, Pig, Hive adaptors.
- Expertise in Data Modeling techniques like Dimensional Data modeling, Star/Snowflake/Hybrid Schema modeling, and Conceptual/Logical/Physical data modeling using Erwin/Visio tools.
- Experience in integration of various data sources like Oracle, Teradata, Exadata, Netezza, Sybase, flat files, XML, Share Networks, Web services, CDC (Change Data Capture) and Informatica Data Replication (IDR).
- Expertise in creating Complex Informatica Mappings and reusable components like Reusable transformations, Mapplets, Worklets and reusable control tasks to work with reusable business logic.
- Experience in power centre IDQ of developing plans for Analysis, standardization, Matching and merge, Address doctor, consolidating data from different components.
- Experience in creating Python and UNIX shell scripts
- Experienced in configuring Nodes and Repositories in Informatica Power Center Designer, Workflow Manager, Workflow Monitor and Repository Manager.
- Experience in implementing SCD (Slowly Changing Dimension) Type 1, Type 2, and Type 3.
- Good experience in performance techniques like partitioning and push - down optimization, SQL Queries, tuning of informatica mappings and other database related tuning.
- Conducted System, UAT and Functionality testing and investigated software bugs.
- Extensive experience in conducting Requirement-gathering sessions, writing Business Requirement Document, Functional Requirement Document.
- SQL Tuning and creation of indexes for faster database access, better query performance in Informatica by partitions, creating Explain Plan, SQL hints for query and indexing
- Knowledge in design and development of Business Intelligence reports using BI tools Tableau, Business Objects and Cognos.
TECHNICAL SKILLS
ETL Tools: Informatica Power Centre 9.6, MDM & IDQ 9.5/10, & Power Exchange, Informatica Data Replication (IDR)
Business Intelligence: Tableau, Business Objects, Cognos and Hyperion Essabase
Cluster computing framework: Apache SPARK and Oracle Coherence
RDBMS: Oracle 12C/11G/10G/9i, SQL*Loader, Teradata, Netezza, Exadata, Sybase
Data Modelling: Erwin 9.X, Microsoft Visio
Tools: Toad, SQL DBx, PL/SQL Developer, SQL Assistant, Rapid SQL 8.x, Putty, WinSCP, Autosys, Remedy, Quality Centre, Control-M, JIRA
Languages: SQL, PL/SQL, Perl, Python, UNIX Shell Scripting
Operating Systems: Windows, UNIX/LINUX, Sun OS
PROFESSIONAL EXPERIENCE
Confidential, New York
Lead Data Engineer & Solution Architect
Responsibilities:
- Designing Extraction, Transformation and Load strategies for Trades, Sensitivities, Collaterals, Positions, Securities, Issuers, Ratings, Counterparty, CustomerAccount and Reference data sets.
- Lead teh Estimation & Proposal writing, scoping, requirements study, client interfacing and creating and providing solutions to customers.
- Lead Data Warehouse Architecture and Designing Star Schema, Snow flake Schema, Fact and Dimensional Tables, Physical and Logical Data Modelling using Erwin. And build forward engineering of dimensional database.
- Lead designing data load strategy for Slowly Changing Dimensions
- Lead designing data load strategy for various granular levels in Fact tables
- Lead Data management system design, Data validation rules and exception handling mechanism build & maintenance.
- Involved Relational Database design, Dimensional Database design and data modelling.
- Involved in generating Data Lineage documents, Normalization & De-normalization, database relationships, entities, attributes, cardinalities.
- Involved in creating UI prototypes and preparing layout for teh system.
- Involved in building and maintaining teh Data Dictionary for Trades, Sensitivities, Collaterals, Positions, Securities, Issuers, Ratings, Counterparty, CustomerAccount and other compliance & reference data sets.
- Responsible for coordinating JAD sessions with business users to analyse gather and define teh key performance indicators and presented teh requirement specifications
- Managed scope creep (Change control), and Business User expectations and various levels of approval.
- Interacted with stakeholders and business operation team and performed Gap Analysis of end user requirements
- Planning teh tasks dependency and working with Project Manager on teh Project Plan.
- Assigning teh tasks and Tracking teh Deliverables and ensuring end to end data analysis and data Quality.
- Responsible for overseeing teh Quality procedures related to teh project.
Project Management
Responsibilities:
- Worked closely with other technology team members to ensure appropriate cover is provided during teh working day and where required, be prepared to work out of hours and weekends to support upgrades and new releases to teh application.
- Able to understand and present complex technical data / details to senior management at a high level
- Conducting stakeholder meetings with teh project stakeholders as and when required
- Getting actively involved in project planning, testing strategy and production implementation discussions
- Able to effectively manage onshore/offshore vendor resources as and when required
- Good communications skills and ability to put forward arguments persuasively
Customer Relationship
Responsibilities:
- Provided ongoing coaching, support and advice to teh management and employees on people and HR related issues.
- Provided timeous feedback and maintain professional communication to all stakeholders of teh Bank.
- Proactively address people related issues in teh Bank by maintaining close corporate relationship with management and teh employees at all levels.
- Evaluate and audit teh BSC performance reviews and appraisals to ensure consistency, fairness and correctness
- Identify teh top performers and implement appropriate action plans to further enhance their performance and career in teh Bank
- Identify non-performers and assist management to develop personal development plans and monitor their progress on a monthly basis
- Identify employees with talent and potential and recommend them on development programs such as ATP through teh established Career Management Committees
- Conduct career guidance to employees and encourage them to be career focus through personal development, outstanding performance and good attitude
- Assist in monitoring and evaluation of teh performance of talented employees and implement appropriate retention strategies to minimize teh staff turnover rate
- Provide continuous support, coaching and guidance to management on career and talent management interventions and processes to teh management
- Provided timeous feedback and maintain professional communication to all stakeholders of teh Bank.
- Worked with business users to clarify requirements and translate teh requirement into technical specifications. Involved in business analysis and technical design sessions with business and technical staff to develop requirements document, and ETL specifications.
Environment: Informatica Power Center 9.6, IDQ & MDM, CDC, Oracle 11G, Exadata, PL/SQL, Flat Files (XML/XSD, CSV, EXCEL), VISIO, UNIX/LINUX, Shell Scripting, Crontab & CTRL M Scheduler, HP Quality Centre, Remedy, SharePoint
Confidential, San Francisco
Lead Informatica Developer
Responsibilities:
- Being teh part Application owner team of Enterprise data warehouse our primary task was analyzing teh existing system to add new data elements from different internal Front office Applications and designing teh process flow.
- Identified teh hierarchies in teh dimensions for dealing with complex relationships between different dimensions including Super grandparent to grandparent, FC splits etc.
- Involved in designing star schema dat addresses teh financial consultant splits and sales trader splits by using ER-Win.
- Developed UNIX shell scripts for logging teh process control info and sending out notification emails.
- Cleaning up fact tables having duplicates/redundant data.
- Worked with business users to help them understand teh warehouse.
- Working with SQL for performance tuning.
- Creating indexes for improving BO performance.
- Creating various mappings for loading facts/dimensions.
- Tuned teh mappings for performance for transactions data coming from Investor.
- Modifying mappings for reject re-processing.
- Involved in Recruitment/training for new employees.
- Gathered business requirements for identifying teh necessary elements for building a data warehouse.
- Identifying teh grain at which teh data warehouse should be built for dealing with international business.
- Identified teh hierarchies in teh dimensions for dealing with complex relationships between different dimensions including Super grandparent to grandparent, FC splits etc.
- Involved in designing star schema dat addresses teh financial consultant splits and sales trader splits by using ER-Win.
- Extracted, Transformed and Loaded OLTP data into Data Warehouse built on Oracle using Informatica mappings and complex transformations.
- Involved in fixing invalid Mappings, testing of Stored Procedures and Functions, Testing of Informatica Sessions, and teh Target Data.
- Designed and developed transformations, mappings and sessions in Informatica to load target database, and tuned mappings for improving performance.
- Combined teh data from Salmon and Smith Barney, for supporting teh international business.
- Developed scripts for handling slowly changing dimensions (both type1 and type2) using Informatica.
- Supported teh need for accurate hourly reporting, for teh global audience.
- Involved in teh data migration using Informatica.
- Involved in writing Shell scripts for dynamic manipulation of files.
Confidential
Senior Informatica Developer
Responsibilities:
- Worked with business users for identifying teh corresponding business processes required for Database Licensing automation.
- Identified and designed teh necessary tables required for DBL automation and Quality Analysis.
- Involved in writing Detail Design Document with Mapping Specifications and Unit Test Plans.
- Extracted, Transformed and Loaded data from Informix (DSS), MIS to Informix (DBL) and flat files using Informatica mappings and complex transformations.
- Handled complex mappings consisting of about 20-25 update strategy transformations.
- Successfully handled teh automation of DEA, UPIN, State License, Historical License &Residency, Deceased Physicians, CPT ASST, MOB, Group Practice, Vendor Contract, Weekly DBL File, MIS member Info and GME processes.
- Worked with automation of Weekly, Monthly and Quarterly file deliveries.
- Used Update Override for dealing with teh complex situations like tables having no primary key.
- Performed routine conversions of rows to columns using Rank, Update Strategy and Aggregator Transformations for Pivoting purposes on spread sheets.
- Extensively used SQL override and lookup override for dealing with teh complex business needs.
- Used Pre session and post Session tasks along with shell scripts for combing files and sending emails.
- Combined Excel Macros with complex Informatica mappings and UNIX shell scripts for presenting data in different worksheets of teh same excel file.
- Handled teh Pivoting and report level display of Excel sheets using Informatica.
- Designed teh Quality Analysis tables for dealing with error handling in teh automation process.
- Designed mappings for quality checking of data before teh file delivery.
- Extensively used shell scripts for sending emails to users on account of failure of QC processes, and for file transfers.
