Sr. Data Architect/data Modeler Resume
Minneapolis, MN
SUMMARY
- Over 7+ years of experience in Oracle/DataArchitect/DataModeler & RAC Oracle Database Administration with extensivedataarchitecture, database development and administration experience in full SDLC, designing and building relational databases in OLTP, OLAP, decision support (DSS), client/server,datawarehouse and multi - tier web based projects.
- Experience in Agile methodology/Scrum and water fall models of DW complete life cycle projects
- Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems (RDBMS) and from RDBMS to HDFS.
- Expertise in developing solutions around NOSQL databases like MongoDB and HBase.
- Extensive expertise in Data Warehousing on different database (s), as well as data modeling, both logical and physical data modeling tools like Erwin, Power Designer and ER Studio.
- Skills in scientific application design and development and scientific data processing related technologies: VBA, Pipeline Pilot, R, Python, or web service integrations.
- Profound experience on SSIS, SSRS, SSAS deployment's and maintenance of L1/L3 support with required service and proxies and granular level permissions of regional security levels.
- StrongDatamodeling experience using ER diagram, Dimensionaldatamodeling, Conceptual/ Logical/ Physical Modeling using 3NormalForm (3NF), Star Schema modeling, Snowflake modeling using tools like Erwin, ER-Studio, SAP Power Designer.
- Experienced in integration of various relational and non-relational sources such as DB2, Teradata, Oracle, Netezza, SQL Server, NoSQL, COBOL, XML and Flat Files, to Netezza database.
- Business Intelligence: Requirements analysis, Key Performance Indicators (KPI), metrics development, sourcing and gap analysis, OLAP concepts and methods, aggregates / materialized views and performance, rapid prototyping, tool selection, semantic layers Excellent experience in writing SQL queries to validatedatamovement between different layers indatawarehouse environment.
- DataWarehousing: Full life-cycle project leadership, business-driven requirements, capacity planning, gathering, feasibility analysis, enterprise and solution architecture, design, construction,data quality, profiling and cleansing, source- Confidential mapping, gap analysis,dataintegration/ETL, SOA, ODA,datamarts, Inman/Kimball methodology,DataModeling for OLTP, canonical modeling, Dimension Modeling fordataware house star/snowflake design.
- Experience in BI/DW solution (ETL, OLAP,Datamart), Informatica, BI Reporting tool like Tableau and Qlikview and also experienced leading the team of application, ETL, BI developers, Testing team
- Excellent knowledge in preparing required project documentation and tracking and reporting regularly on the status of projects to all project stakeholders
- Extensive ETL testing experience using Informatica 9x/8x, Talend, Pentaho and Worked on Informatica Power Center tools-Designer, Repository Manager, and Workflow Manager.
- Experience in DimensionalDataModeling, Star/ Snowflake schema, FACT & Dimension tables and expertise on RelationalDatamodeling (3NF) and Dimensionaldatamodeling.
- Experience in developing Map Reduce Programs using Apache Hadoop for analyzing the bigdataas per the requirement.
- Practical experience and understanding of theDatamodeling (Dimensional & Relational) concepts like Star-Schema Modeling, Snowflake Schema Modeling, Fact and Dimension tables.
- Skillful inDataAnalysis using SQL on Oracle, MS SQL Server, DB2 & Teradata and Heavy use of Access queries, V-Lookup, formulas, Pivot Tables, etc. Working knowledge of CRM Automation Salesforce.com, SAP.
- Proficient in System Analysis, ER/DimensionalDataModeling, Database design and implementing RDBMS specific features and Logical and physical database designing like Tables, Constraints, Index, etc. using Erwin, ER Studio, TOADModelerand SQLModeler.
- Experienced in Technical consulting and end-to-end delivery withdatamodeling,datagovernance and design - development - implementation of solutions.
TECHNICAL SKILLS
Big Data technologies: MapReduce, HBase, HDFS, Sqoop, Spark, Hadoop, Hive, PIG, Impala.
Data Modeling Tools: ER/Studio 9.7/9.0, Erwin 9.6/9.5, Power Sybase Designer.
OLAP Tools: Tableau, SAP BO, SSAS, Business Objects, and Crystal Reports 9/7
Programming Languages: SQL, PL/SQL, UNIX shell Scripting, PERL, AWK, SED, Scala, Python
Databases: Oracle 12c/11g, Teradata R15/R14, MS SQL Server … DB2.
Testing and defect tracking Tools: HP/Mercury (Quality Center, Win Runner, Quick Test Professional, Performance Center, Requisite, MS Visio & Visual Source Safe
Operating System: Windows, UNIX, Sun Solaris
ETL/Data warehouse Tools: Informatica 9.6/9.1, SAP Business Objects XIR3.1/XIR2, Talend, Tableau, Pentaho.
Methodologies: Agile, RAD, JAD, RUP, UML, System Development Life Cycle (SDLC), Ralph Kimball and Bill Inmon's, Waterfall Model.
PROFESSIONAL EXPERIENCE
Confidential, Minneapolis, MN
Sr. Data Architect/Data Modeler
Responsibilities:
- Helped the Client solve critical business needs by modeling and maintaining the business intelligence database environments and researched, evaluated, architect, and deployed new tools, frameworks and patterns to build sustainable Big Data platforms for our clients.
- Designed and architecting AWS Cloud solutions for data and analytical workloads such as warehouses, Big Data, data lakes, real-time streams and advanced analytics.
- Designed and developed architecture for data services ecosystem spanning Relational, NoSQL, and Big Data technologies and implemented Agile Methodology for building Integrated Data Warehouse, involved in multiple sprints for various tracks throughout the project lifecycle.
- Develop and Implement End to End BigDataAnalytic and EDW/BI projects using multiple tools and platform which include.
- Developed Data Mapping, Data Governance, and Transformation and cleansing rules for the Master Data Management Architecture involving OLTP, ODS.
- Worked on Normalization and De-normalization concepts and design methodologies like Ralph Kimball and Bill Inmon's Data Warehouse methodology.
- Developed prototype solutions to verify capabilities for new systems development, enhancement, and maintenance of MDM.
- Reviewed the Conceptual EDW (Enterprise Data Warehouse) Data Model with Business Users, App Dev. and Information Architects to make sure all the requirements are fully covered.
- Involved in several facets of MDM implementations including Data Profiling, Metadata acquisition and data migration and Responsible for Metadata Management, keeping up to date centralized metadata repositories using Erwin modeling tools.
- Designed both 3NF data models for ODS, OLTP systems and dimensional data models using Star and Snow Flake Schemas and involved in Normalization/De-normalization techniques for optimum performance in relational and dimensional database environments.
- Handled importing of data from various data sources, performed transformations using Hive, MapReduce, loaded data into HDFS and Extracted the data from Oracle into HDFS using Sqoop.
- Developed ETL processes extracted data daily and loaded data into a SSIS based Decision Support Warehouse.
- Driven the technical design of AWS solutions by working with customers to understand their needs and conducted numerous POCs (Proof of Concepts) to efficiently import large data sets into the database from AWS S3 Bucket.
- Worked on analyzing source systems and their connectivity, discovery, data profiling and data mapping and generated ad-hoc SQL queries using joins, database connections and transformation rules to fetch data from Teradata database
- Createddatamodels for AWS Redshift and Hive from dimensionaldatamodels and worked onDatamodeling, Advanced SQL with Columnar Databases using AWSand driven the technical design of AWS solutions by working with customers to understand their needs.
- Collected large amounts of log data using Apache Flume and aggregating using PIG in HDFS for further analysis.
- Formulated procedures for migration of source data with Salesforce applications.
- Created HBase tables to load large sets of structured, semi-structured and unstructured data coming from UNIX, NoSQL and a variety of portfolios.
- Interacted with End-users for gathering Business Requirements and Strategizing the Data Warehouse processes
- Write complex Netezza views to improve performance and push down the load to database rather than doing it in the ETL tool.
- Created data migration templates to migrate from multiple sourced into Salesforce.
- Involved in data model reviews with internal data architect, business analysts, and business users with explanation of the data model to make sure it is in-line with business requirements.
- Created DDL scripts using Erwin and source to Confidential mappings to bring the data from source to the warehouse.
- Developed enhancements to MongoDB architecture to improve performance and scalability and worked with MapReduce frameworks such as Hadoop and associated tools (pig, Sqoop, etc)
- UsedPowerpivot,powerview to build dashboards using OLAP cube.
- Used ETL methodology for supporting data extraction, transformations and loading processing, in a complex MDM using Informatica.
- Generated the frame work model from IBM data Architect for the Cognos reporting team.
Environment: Erwin r9.6/7, Netezza, SQL Server 2016, Informatica 10.2, Taradata15, PowerBI, OLAP, OLTP, UNIX, MDM, Hadoop, Hive, Pig, Salesforce.com, HBase, HDFS, SAP, AWS, Redshift, EMR, S3, Apache Flume, Ralph Kimball and Bill Inmon's, PL/SQL, BTEQ, Python.
Confidential, Chicago, IL
Sr. Data Architect/Data Modeler
Responsibilities:
- Collaborate in identifying the current problems, constraints and root causes withdatasets to identify the descriptive and predictive solution with support of the Hadoop HDFS, MapReduce, Pig, Hive, and Hbase and further to develop reports in Tableau.
- Massively involved in Data Architect role to review business requirement and compose source to Confidential data mapping documents and involved in relational and dimensional Data Modeling for creating Logical and Physical design of the database and ER diagrams using data modeling like Erwin.
- Created the data model for the Subject Area in the Enterprise Data Warehouse (EDW) and applied Data Governance rules (primary qualifier, class words and valid abbreviation in Table name and Column names)
- Worked on AWS Redshift and RDS for implementing models and data on RDS and Redshift.
- Involved in several facets of MDM implementations including Data Profiling, Metadata acquisition and data migration.
- Worked on NoSQL databases including HBase, Mongo DB, and Cassandra. Implemented multidata center and multi-rack Cassandra cluster.
- Developed Data Mapping, Data Governance, and Transformation and cleansing rules for the Master Data Management Architecture
- Worked closely with Product Owner and Solution Architects to find out the optimal solution for the Database design from and ETL and Data Governance perspective.
- Worked on Normalization and De-Normalization techniques for both OLTP and OLAP systems and worked with data investigation, discovery and mapping tools to scan every single data record from many sources.
- Performed Data mapping between source systems to Confidential systems, logical data modeling, created class diagrams and ER diagrams and used SQL queries to filter data.
- Loaded data into Hive Tables from Hadoop Distributed File System (HDFS) to provide SQL access on Hadoop data
- Automation of SSIS Packages for production deployment with xml configurations and developed Historical/Incremental of SSIS Packages with SCD2 concept of Star Schema.
- Involved in OLAP model based on Dimension and FACTS for efficient loads of data based on Star Schema structure on levels of reports using multi-dimensional models such as Star Schemas and Snowflake Schema
- Involved in Teradata utilities (BTEQ, Fast Load, Fast Export, Multiload, and Tpump) in both Windows and Mainframe platforms.
- Designed both 3NF Data models for DB2 systems and dimensional Data models using Star and Snowflake Schemas.
- Administered and managed data management and reporting services related to salesforce.com.
- Extensively used Metadata & Data Dictionary Management, Data Profiling and Data Mapping and involved in Performance Tuning in SSIS packages by using Row, Block and Unblock Transformations.
- Designed both 3NF data models for ODS, OLTP systems and dimensional data models using star and snow flake Schemas.
- Wrote and executed SQL queries to verify that data has been moved from transactional system to DSS, Data warehouse, data mart reporting system in accordance with requirements.
- Conducted design walk through sessions with Business Intelligence team to ensure that reporting requirements are met for the business.
- Designed and developedPowerBIgraphical and visualization solutions with business requirement documents and plans for creating interactive dashboards.
- Performed Extracting, Transforming and Loading (ETL) data from Flat file, MS SQL Server by using SSIS services and involved in debugging and Tuning the PL/SQL code, tuning queries, optimization for the Sql database.
- Completed the data migration into Salesforce and guide clients to perform the data validation and tracks.
- Worked on Tableau for insight reporting and data visualization and extracted data from IBM Cognos to create automated visualization reports and dashboards on Tableau.
- Developed and implemented data cleansing, data security, data profiling and data monitoring processes and generated DDL and created the tables and views in the corresponding architectural layers.
- Created PL/SQL Tables, Collections, and Records, Partitions and Used Dynamic SQL and triggers for faster data access and to in corporate business logic and facilitated in developing testing procedures, test cases and User Acceptance Testing (UAT)
- Extensively worked with Developers and ETL team in enhancing the models and co-ordinate the same with DBA in implementing those changes into Applications or Databases.
Environment: ERWIN r9.5, Congos, SQL Server2016, DB2, SSIS, OLAP, OLTP, LINUX, MDM, Hadoop, Hive, Pig, HBase, SAP, AWS, Redshift, PL/SQL, ETL, MondoDB, AWS S3, Informatica 9.6, Salesforce.com, Power BI, AWS EMR, SQL, Teradta, Netezza, Oracle and SSRS.
Confidential, Saint Cloud, MN
Sr. Data Modeler/Data Analyst
Responsibilities:
- Designed the procedures for getting the data from all systems to Data Warehousing system. The data was standardized to store various Business Units in tables.
- Gathered Business requirements by organizing and managing meetings with business stake holders, Application architects, Technical architects and IT analysts on a scheduled basis.
- Handled data from many sources using Excel and SQL queries and managed internal and external reporting requests while helping automate processes using data from multiple sources to an internal data warehouse.
- Assisted in data review of service failure investigations, providing this information to the Quality Manager for processing.
- Created DDL scripts using ER Studio and source to Confidential mappings to bring thedatafrom source to the warehouse and developed dimensional model forDataWarehouse/OLAP applications by identifying required facts and dimensions.
- Improved performance on SQL queries used Explain plan / hints /indexes for tuning created DDL scripts for database. Created PL/SQL Procedures and Triggers.
- Performed data mining on data using very complex SQL queries and discovered pattern and used SQL for Querying the database in UNIX environment.
- Tested Complex ETL Mappings and Sessions based on business user requirements and business rules to load data from source flat files and RDBMS tables to Confidential tables.
- UtilizedPowerQuery inPowerBIto Pivot and Un-pivot the data model for data cleansing and data massaging.
- Wrote and executed unit, system, integration and UAT scripts in a data warehouse projects and responsible for different Data mapping activities from Source systems to Teradata.
- Wrote and executed SQL queries to verify that data has been moved from transactional system to DSS, Data warehouse, data mart reporting system in accordance with requirements.
- Involved with Teradata utilities like Fastload, BTEQ, Multiload and Teradata SQL Assistant.
- Created a high level industry standard, generalized data model to convert it into logical and physical model at later stages of the project using ERWIN.
- Involved in Netezza Administration Activities like backup/restore, performance tuning, and Security configuration
- Designed and developed Use Cases, Activity Diagrams, Sequence Diagrams, OOD (Object oriented Design) using UML and Visio.
- Implemented several DAX functions for various fact calculations for efficient data visualization inPowerBI.
- Created a logical design and physical design in ER Studio and created DDL scripts using ER Studio and source to Confidential mappings to bring the data from source to the warehouse.
- Performed Data Analysis and data profiling using complex SQL on various sources systems including Oracle 10g and Teradata, to ensure accuracy of the data between the warehouse and source systems.
- Helped the testing team in creating the test plans and test scripts. Assisted the users in UAT testing by providing test scenarios and test data.
Environment: ER Studio, OOD, OLAP, OLTP, Teradata 13, MS Excel, Oracle 10g, SQL, PowerBI, PL/SQL, MS Visio, SQL*Loader, Netezza, SQL.
Confidential, Conshohocken, PA
Sr. Data Analyst/Data Modeler
Responsibilities:
- Developed logical data models and physical database design and generated database schemas using Erwin.
- Performed data analysis and data profiling using complex SQL on various sources systems including Oracle and MS SQL Server.
- Document all data mapping and transformation processes in the Functional Design documents based on the business requirements.
- Prepared High Level Logical Data Models using Erwin, and later translated the model into physical model using the Forward Engineering technique.
- Generated and DDL (Data Definition Language) scripts using Erwin and assisted DBA in Physical Implementation of data Models.
- Translated business requirements into working logical and physical data models for OLTP & OLAP systems.
- Generated SQL scripts and implemented the relevant databases with related properties from keys, constraints, indexes & sequences.
- Used Reverse Engineering to connect to existing database and developed process methodology for the Reverse Engineering phase of the project.
- Developed the batch program in PL/SQL for the OLTP processing and used Unix Shell scripts to run in corn tab.
- Performed extensive data profiling and data analysis for detecting and correcting inaccurate data from the databases and track the data quality.
- Provided guidance and solution concepts for multiple projects focused on data governance and master data management.
- Created DDL scripts using Erwin and source to Confidential mappings to bring the data from source to the warehouse.
- Designed and developed SAS macros, applications and other utilities to expedite SAS Programming activities.
- Involved in writing T-SQL working on SSIS, SSRS, SSAS, Data Cleansing, Data Scrubbing and Data Migration.
- Analyzed and Gathered requirements from business people and management and business requirement document to prioritize their needs.
- Responsible for backing up the data and involved in writing stored procedures and involved in writing ad-hoc queries for the data mining.
- Used various sources such as SQL Server, Oracle, Excel and flat files to pull data intoPowerBI.
- Developed and maintained data dictionary to create metadata reports for technical and business purpose.
- Create and Monitor workflows using workflow designer and workflow monitor and involved in extensive DATA validation by writing several complex SQL queries and Involved in back-end testing and worked with data quality issues.
- Used SSRS for generating Reports from Databases and Generated Sub-Reports, Drill down reports, Drill through reports and parameterized reports using SSRS.
- Developed PL/SQL scripts to validate and load data into interface tables and Involved in maintaining data integrity between Oracle and SQL databases.
- Heavily worked on SQL query optimization also tuning and reviewing the performance metrics of the queries.
- Performed the Data Mapping, Data design (Data Modeling) to integrate the data across the multiple databases in to EDW.
- Collaborated with the Relationship Management and Operations teams to develop and present KPIs to top-tier clients.
Environment: Erwin, Oracle 9i, MS SQL Server 2008, SSRS, OLAP, OLTP, MS Excel, Flat Files,, PL/SQL, OLAP, OLTP, SQL, IBM Cognos, Tableau.
Confidential
Data Analyst/Data Modeler
Responsibilities:
- Part of the team responsible for the analysis, design and implementation of the business solution and Coordinated with DBA on database build and table normalizations and de-normalizations.
- Maintained the quality of data analysis, researched output and reporting, and ensured that all deliverables met specified requirements.
- Data Vault used in both a data loading technique and methodology which accommodates historical data, auditing, and tracking of data.
- Data governance functional and practical implementation and also responsible for designing common Data governance frameworks.
- Extensively working on Data Modeling tools Erwin Data Modeler to design the data models and designed ODS, and Data Vault with expertise in Loan and all types of Cards.
- Worked in enhancement of the existing Teradata processes running on the Data Warehouse
- Performed performance improvement of the existing Data warehouse applications to increase efficiency of the existing system.
- Worked extensively on Data Quality (running Data Profiling, Examine Profile outcome) Metadata management.
- Performed Data Analysis, Data Validation and Data verification using Informatica DVO (Data Validation Option) from raw data to user acceptance.
- Created data masking mappings to mask the sensitive data between production and test environment.
- Worked with data investigation, discovery and mapping tools to scan every single data record from many sources.
- Applied data analysis, data mining and data engineering to present data clearly and involved in administrative tasks, including creation of database objects such as database, tables, and views, using SQL, DDL, and DML requests.
- Involved in Teradata SQL Development, Unit testing and Performance Tuning and to ensure testing issues are resolved on the basis of using defect reports.
- Tested the ETL process for both before data validation and after data validation process. Tested the messages published by ETL tool and data loaded into various databases.
- Worked in multiple issues raised by different users/ consumers of Data Warehouse and aided them in analyzing and modifying user queries to pull the reports.
- Heavily worked on SQL query optimization also tuning and reviewing the performance metrics of the queries.
- Created mapping specification spreadsheets to document the transformation logic and worked with Model Manager and multiple data marts, involving multiple subject areas simultaneously, domains and Naming Standards
- Developed and maintained the central repository, populated it with the metadata.
Environment: Erwin 8, Netezza, Oracle9i, SQL, PL/SQL, Taradata12, T-SQL, Metadata, SQL Server, SSIS, SSRS, MS Access, Excel, Flat Files, ODS, OLAP, OLTP, Crystal reports, Metadata.
