SUMMARY

• 14+ years of experience as a Senior Data Engineer/Big Data Engineer, Data Modeler, DWBI Data Architect
• Worked extensively in both Data Warehousing (ETL, OLAP, and Dimensional Modeling) and high availability online transaction processing systems (OLTP). Well versed with RDBMS, OODBMS and OS concepts.
• Involved in Analysis, Design, Development and Testing.
• Big Data development experience in Hadoop, HDFS, Scala, Spark(SparkSQL, Streaming) and Hive, Pig, Impala, HBase, Kafka, Storm, Sqoop, Autosys, Oozie, Solr, OrientDB, MongoDB, Cassandra.
• Proficiency in Data Ingestion, Transformation and load process in Big Data technology.
• Big Data development experience in Cloud hosting and AWS.
• Understanding of Spark Machine Learning Algorithms Spark MLib.
• Special skills in Analysis, Modeling, Designing and documenting data bases, Depth knowledge of Agile, Scrum, BPM and database modeling, Knowledge of Object, relational and multi - dimensional database development of extraction, transformation and load processes Testing/Test Results Capturing Troubleshooting Informatica Jobs and PL/SQL Process Learn rapidly and apply it to the working environment, Strong analytical and problem solving skills
• Proficient in usage of tools like Erwin 9.5/8.3/7.1/4.1 (Data Modeler, Model Mart, navigator), ER Studio Data Architect, IBM MetaData Workbench, Oracle data profiling tool, Informatica 9.1/8.1/7.x/6.x, Oracle Forms, Reports, SQL*Plus, Toad, Crystal Reports.
• Solid Experience in Oracle 11i, 10g, 9i, 8i, Writing PL/SQL scripts
• Solid development skills in Informatica v8.1, v6.1, Cognos ETL tool, Tableau.
• Solid Programming skills in UNIX Shell Scripting and CGI script.
• Exposure to development and designing reports in COGNOS and Crystal Report version 10, 9, 8.5
• Demonstrated ability to adapt to ever changing technologies and methodologies.
• Proficient in analyzing and translating business requirements to technical requirements and architecture.
• Excellent interpersonal skills, quick learner and a good team player.
• Self confident, hard working and dedicated individual, honest and resourceful in completion of projects.

PROFESSIONAL EXPERIENCE

Senior Data Engineer

Confidential

Responsibilities:

• Data modeling and Reverse Engineer.
• Design technical load level mapping document for Kafka and
• Coding, Code walk-through
• Test planning, Bug tracking and Implementation

Lead Architect/Designer/Developer

Responsibilities:

• Created Technical Solution in Scala to process HDFS file in avro/csv file format using Spark RDD, Dataframe, Transformations and Actions. Explored Spark Lazy value evaluation feature.
• Created Bigdata database table, view in Hive, Impala.
• Created programs in Spark Scala to do transformations on HDFS file.
• Participated in all phases of the Project Initiation Phase including Business Walk-through, requirements gathering, design, development, troubleshooting, debugging and documentation.
• Interfaced with business customers, business analysts, data analysts, other developers, and IT support staff to validate that the requirements and specifications are complete, consistent, concise, and achievable and ensure all these are documented.
• Participated in the discussion on which Big Data technology would be the right fit.
• Performed small POC to validate the assumption and facts for any decision taken regarding big data technology stack selection
• Created all required documentation (Architectures, Metadata and data dictionaries) to support, communicate, and validate the data model.
• Worked directly with clients, developers, and other technical source team members and Big Data Infrastructure administrators to design and develop high performing System.
• Participated in the development standards and conventions, data dictionaries and data element naming standards for spark / scala development process.
• Conducted a POC using OrientDB, HBase and MongoDB to identify best fitting NoSQL database for Huron project
• Assisted as scrum master in agile process when required.
• Coordinated with QA team and the Production Deployment Team

Lead Data Modeler/Data Architect

Confidential

Responsibilities:

• Participate in all phases of the Data Warehouse development process including in Business Walk-through, requirements gathering, design, development, troubleshooting, debugging and documentation.
• Interface with business customers, business analysts, data analysts, other developers, and IT support staff to validate that the requirements and specifications are complete, consistent, concise, achievable and ensure all these are documented.
• Create, refine or enhance (reverse engineer) the data models within the scope of the business requirements.
• Create all required documentation (Architectures, Metadata and data dictionaries) to support, communicate, and validate the data model.
• Develop conceptual data models including categories, subject areas, key entities and entity relationships conforming to the applicable data standards within the scope of the business requirements.
• Create logical data models and physical data models that extend and attribute the conceptual models to an appropriate level of detail, along with accompanying documentation in conformance with the applicable data standards to meet the business requirements.
• Develop mapping spreadsheets that will provide the Data Warehouse Development (ETL) team with source to target data mapping, inclusive of logical names, physical names, data types, volumetrics, domain definitions, and meta-data definitions.
• Participate in the development and maintenance of overall data architecture, data management standards and conventions, data dictionaries and data element naming standards to support data warehousing.
• Design Normalized ER-Models(3NF) and Dimensional models (Data Marts)
• Involve in Data extraction, transformation, loading for data management
• Create source to target mapping characteristics for database population
• Maintaining integrity of databases, including referential integrity checking, multiple access schemes, establishing standards, monitor performance.
• Determine appropriateness of data storage, archive, recovery, Load strategy, purge and security
• Tuned the performance of the Data Base, PL/SQL Procedures, SQL queries, Informatica mappings to load the data quicker

Confidential

Lead Data Modeler/Data Architect

Responsibilities:

• Create, refine or enhance (reverse engineer) the data models within the scope of the business requirements.
• Create all required documentation (Architectures, Metadata and data dictionaries) to support, communicate, and validate the data model.
• Design Normalized ER-Models(3NF) and Dimensional models (Data Marts)
• Design and implement Data marts from enterprise data warehouse.
• Involve in Data extraction, transformation, loading and ETL metadata management
• Tuned the performance of the Data Base, PL/SQL Procedures, SQL queries, Informatica mappings to load the data quicker

Lead Data Modeler/Data Architect

Confidential

Responsibilities:

• Design and develop the Conceptual, logical and physical ERD’s, Business scenarios, Use Cases and database structures.
• Create all required documentation (Architectures, Metadata and data dictionaries) to support, communicate, and validate the data model.
• Work directly with clients, ETL developers, and other technical data warehouse team members and database administrators to design and develop high performing databases.
• Participate in the development and maintenance of overall data architecture, data management standards and conventions, data dictionaries and data element naming standards to support data warehousing.
• Design Normalized ER-Models(3NF) and Dimensional models (Data Marts)
• Design and implement Data marts from enterprise data warehouse.
• Involve in Data extraction, transformation, loading and ETL metadata management

Data Modeler/ Data Architect

Confidential

Responsibilities:

• Create, refine or enhance (reverse engineer) the data models within the scope of the business requirements.
• Create all required documentation (Architectures, Metadata and data dictionaries) to support, communicate, and validate the data model.
• Participate in the development and maintenance of overall data architecture, data management standards and conventions, data dictionaries and data element naming standards to support data warehousing.
• Design Normalized ER-Models(3NF) and Dimensional models (Data Marts)
• Design and implement Data marts from enterprise data warehouse.
• Involve in Data extraction, transformation, loading and ETL metadata management. Tune Application using right index system.
• Capture and management of model metadata that describes the logical to physical mapping as well as source to target mapping for database population

Confidential

Data Modeler/Data Architect

Responsibilities:

• Participate in the development and maintenance of overall data architecture, data management standards and conventions, data dictionaries and data element naming standards to support data warehousing.
• Design Normalized ER-Models(3NF) and Dimensional models (Data Marts)
• Designed, developed and tested Informatica mappings, mapplets, configuring sessions and workflow to facilitate Extract Transform and Load of data.
• Used transformations like joiner, router, aggregator, normalizer, sorter, update strategy, look ups, filter, expressions, rank, Stored Procedure etc to load data
• Addressed performance issues of enterprise ETLs and optimizing the mappings using various performance enhancement features like caching etc
• Developed UNIX Shell scripts to automate repetitive database processes. Enhanced SQL packages to fix production issues.