OBJECTIVE:

• Highly Motivated ETL / BI - Data Architect / Senior Data Modeler / Hadoop Developer with Seventeen years of professional experience in designing, developing and administering software using various technologies. Proven project-based leadership experience, technical expertise, problem-solving skills, and effective communication style, interpersonal skills, motivated, diligent, team-player - can be highly productive in a stressful work environment.

SUMMARY

• 17 years of IT experience as ETL Data Architecture, Data modeling, Data analysis, Oracle SQL & PL/SQL development and DataStage ETL Development.
• Having Domain knowledge on Banking, Transportation, HR, Pharma, Equity Trading, E-commerce, ERP, and Credit Cards Domain.
• Worked on Functional area like Store / Data Migration, Enterprise Data Warehouse, Fraud Data Lake, Credit Card Systems and inner workings, TSYS interaction, HR Bonus System Implementation, ERP, Legal and compliance, Confidential etc.
• Excellent command over Conceptual Data Model, Logical and Physical data modeling.
• Well versed in Normalization/De-normalization techniques for optimum performance in relational and dimensional database environments.
• Worked with Erwin (Model Manager and Model Mart), leveraged report feature for metadata extract out of Erwin Data Model.
• Proficient in System Analysis, ER/Dimensional Data Modeling, Data Vault Data Modeling, Semantic Data Modeling, Database design and implementing RDBMS specific features.
• Provided guidance in establishing Data Modeling and Database Standards, Policies and Guidelines and best practices to be used across all Data Models for enterprise.
• Contributed to creating Data Dictionaries for multiple silos system and incorporating them into one Enterprise Data Dictionary.
• Providing technical leadership and modeling expertise and guidance in establishing Data Governance and Data Quality initiative for Company.
• Solid experience using Meta Data to support Data lineage tracking and operational data governance, enabling systems to provide long-term stability and reliability.
• Experience with Data Migration, Data Conversions, Data Extraction/ Transformation/Loading (ETL) using PL/SQL Scripts.
• Extensive experience in development of SQL, OLAP, Stored Procedures, Triggers, Functions, Packages, Performance tuning and optimization for business logic implementation.
• Experience in Data Transformation, Data Mapping from source to target database schemas, data cleansing procedures.
• Created Mapping Document between source and the target system, mapping of attributes.
• Expertise in using Oracle 9i/10g and good knowledge in 10g databases.
• Proficient working experience with SQL, PL/SQL, Stored Procedures, Functions, Packages, DB Triggers and Indexes.
• Proficient in SQL*Loader, SQL*PLUS, PL/SQL developer and TOAD applications to manage database.
• Proficient in working on Netezza as a Backend Database / Appliance and DataStage as an ETL tool
• Experienced in Tuning SQL Statements and Procedures for enhancing the load performance in various schemas across databases.
• Technical documentation of different lifecycle deliverables and user manuals.
• Used Erwin tool for developing Entities and relationships in both physical and logical model.
• Familiarity with incorporating of various data sources such as Oracle, DB2, XML and Flat files into the staging area.
• Expertise in Software Development Life Cycle (SDLC) of Projects - System study, Analysis, Design, Resource Planning, Coding, Testing and implementing business applications.
• Expertise in Agile Methodologies and Software Development Life Cycle (SDLC) of Projects - System study, Analysis, Physical and Logical design, Resource Planning, Coding, Testing and implementing business applications. (Agile & Waterfall Methodologies).
• Used Planning/Scrum Poker methodology to estimate effort size of development goals for software development and plan Sprints.
• Facilitate scrum ceremonies (grooming, sprint planning, retrospectives, daily stand-ups, etc.)
• Used Rally to create User Stories, track Burn down Chats and manage product and release backlogs, etc.
• Hands on experience in preparing User Specification Requirement, Software Requirement, Technical Documentation.
• Conducted meetings with the functional team and the technical team for requirement gathering.
• Well versed with Data quality approach to data analysis using profiling techniques.
• Proposed and Lead effort for Data Quality Analysis tool (In-house @Barclays) development.
• Execute Data Quality Assessment for specific functional areas of business.
• Strong in writing Shell Scripts to automate file manipulation and data loading process.
• Excellent team member with problem-solving and trouble-shooting capabilities, Quick Learner, highly motivated, result oriented and an enthusiastic team player
• Loaded large sets of structured, unstructured and semi structured data from different servers onto Hadoop Distributed File System.
• Migrated existing Hive processes to Spark to improve performance drastically
• Transformed data which is moved onto HDFS into single file using Pig Scripts.
• Created Hive tables (both managed and external) using partitioning, dynamic partitioning and bucketing based on application requirement.
• Implemented Spark Scripts using Scala, Spark SQL to access hive tables into spark for faster processing of data.
• Involved in converting Hive/SQL queries into Spark transformations using Spark RDD's, and Scala, Python.
• Loaded data from Linux file system to Hadoop Distributed File System and vice versa.
• Reviewed Hadoop Log files.
• Used YARN for cluster resource management.
• Managed and automated data loading using Oozie

TECHNICAL SKILLS

Operating System: Windows NT 95/98/, UNIX, MS-DOS

Hadoop Core: HDFS, Map-Reduce, Yarn

Hadoop Ecosystems: Pig, Hive, Sqoop, Spark, Spark SQL, Flume, HBase, MapReduce, Zookeeper, Oozie, Azure, Kafka

Hadoop Cluster: Cloudera CDH3/4/5

NoSQL Databases: HBase, Cassandra, Dynamo DB

Databases: Netezza, Oracle 11g, Oracle 10g /9i /8i/ 7, Sybase, DB2

Databases Query Tool: s SQL Navigator, TOAD (Tool for Oracle application Developers), Oracle SQL developer 3.1

ETL Tool: InfoSphere DataStage 8.1, 9.1, Informatica Powercenter 8.1, 8.6

Data Modeler: Erwin 4, 7.2 (Model Mart), Erwin 8 (Model Mart), ER Studio, MS-Visio

Data Upload Tools: SQL Loader, OLLOAD, Oracle Data Pump

Data Governance: Erwin

BI Tools: Cognos Series 7.0/6.0, MS Access Reports, MicroStrategy 9.2.1, Developer 2000 (Reports 2.5/3.0)

Programming Languages: PL/SQL, SQL, C, Pro *C, Shell Script

Version Management: Clear case (labeling, merging & SCA build), CVS, SCCS and Visual Source Safe.

DBA Skills: Object Creation, Security & Access Permission, System performance, Production ReleasePerformance Tuning etc

PROFESSIONAL EXPERIENCE

Confidential, Warren, NJ

Senior Technical Account Manager

Responsibilities:

• Working with the Architecture team Supporting Confidential Data Model, Data Governance, ETL Architectural Issues. Part of the Compliance AML (Anti Money Laundering) Systems, worked on the Confidential - Know Your Customer Application.
• Reviewed Design Documents for different functionality existing within Confidential .
• Lead Architect for Confidential implementation for Confidential Screening, EAP, L1 Reports, L2 Reports and Reconciliation Reports.
• Lead Architect for Implementation of necessary system changes to ensure compliance with FinCEN's Enhanced Customer Due Diligence Rule.
• Reviewed Data Migration ETL code built for migration of cards data from source system (DQIP).
• Review and Approve various project artifacts such as the Data Mapping Template, Change Request(CR), Target Record Layout (TRL), and an internal Issue/Resolution Worksheet.
• Designed logical and physical data models for system designed and developed for Confidential .
• Involved with an End to End design reviews for all stakeholders.
• Provided suggestions and improvements for ETL framework for capturing data into EDW for data feeds needs.
• Participated in design decision discussion on Logical Model, database scenario, ETL framework and approach for data load, Error Handling etc.
• Ensured DIT, SIT and UAT testing cycles were managed properly by meeting acceptance criteria.
• Held various live sessions with ETL team to make sure all requirements were implemented in the ETL design doc for data migration. Validate via Traceability Matrix.
• Proactively communicate and collaborate with business, compliance and IT team to review deadlines, and analyze functional requirements
• Loaded large sets of structured, unstructured and semi structured data from different places onto Hadoop Distributed File System.
• Migrated existing Hive processes to Spark to improve performance drastically
• Transformed data which is moved onto HDFS into single file using PigScripts, Python.
• Worked on Building and implementing real-time streaming ETL pipeline using Kafka Streams API.
• Created Hive tables (both internal and external) using partitioning, dynamic partitioning and bucketing based on application requirement.
• Implemented Spark Scripts using Scala, Spark SQL to access hive tables into spark for faster processing of data.
• Involved in converting Hive/SQL queries into Spark transformations using Spark RDD's, and Scala, Python.
• Wrote Map reduce programs and responsible for troubleshooting issues in execution of MapReduce jobs by inspecting and reviewing log files.
• Loaded data from Linux file system to Hadoop Distributed File System and vice versa.
• Reviewed Hadoop Log files.
• Used YARN for cluster resource management.
• Managed and automated data loading using Oozie
• Used Planning/Scrum Poker methodology to estimate effort size of development goals for software development and plan Sprints.
• Facilitate scrum ceremonies (grooming, sprint planning, retrospectives, daily stand-ups, etc.)
• Used Rally to create User Stories, track Burn down Chats and manage product and release backlogs, etc.
• Developed the Star Schema / Snowflake Schema for the proposed warehouse models to meet the requirements.
• Resolved multiple Data Governance issues to support data consistency at the enterprise level.
• Determining the transformation for each attribute that is being mapped / derived / ETL generated.
• Analyzing and updating existing logical and physical models for discrepancies with the physical database and business rule document.
• Played significant role in various phases of project life cycle, such as requirements definition, functional & technical design, testing, Production Support and implementation.

Environment: Oracle 10g, 11g, PL/SQL, SQL, Toad 9.2, SQL Developer/Modeler, SQL*Loader, Erwin 7.2, Visio, UNIX, Talend 5, Ab-Initio, HPQC and Jira for Defect tracking, Rally Agile Software, Hadoop 0.20.2, Hive 0.2.0,Spark, pig 0.11.1, Sqoop, Flume, Oozie, YARN, Azure Data Factory, Azure Storage

Confidential

ETL Architect / Data Modeler

Responsibilities:

• Working with the Architecture team for building Enterprise Data Warehouse, Data Migration\Conversion API’s and Fraud Analytical System.
• Worked in the client launch team for stores CBK, CJB, Spanx, PetSmart, Quik, DC Shoes, Nautica, Kipling, Shoe Carnival and different Market Places.
• Involved in various projects to understand data in different source system and conversion API’s for migration of OMS Orders, Webstore Customers, Wishlist, CSR (Customer Service) and Enterprise Data Warehouse involving customer, Order, Product, Promotion and Wishlist.
• Data Migration\ Conversion API’s were built for different Use Cases meant for data migration.
• Actively involved in building the Fraud Analytical Data Lake, proposed data model, built ETL framework and designed S2T (source to target) mapping document for data coming from different other system.
• Designed logical and physical data models for system designed and developed in Confidential enterprise.
• Involved with an End to End design for fraud as an analytical system storing aggregated data for fraud identification and checks.
• Worked with the fraud analyst for requirements gathering and mainintaing a product backlog list for 2 weeks sprint cycle.
• Worked on the enterprise data warehouse Data model and ETL framework for capturing data into EDW for store reporting and data feeds. This includes Customer, Order, Product, Promotion, Wishlist and Cart Data.
• Participated in design decision discussion on Logical Model, database scenario, ETL framework and approach for data load, Error Handling etc.
• Used Planning/Scrum Poker methodology to estimate effort size of development goals for software development and plan Sprints.
• Facilitate scrum ceremonies (grooming, sprint planning, retrospectives, daily stand-ups, etc.)
• Used Rally to create User Stories, track Burn down Chats and manage product and release backlogs, etc.
• Developed the Star Schema / Snowflake Schema for the proposed warehouse models to meet the requirements.
• Resolved multiple Data Governance issues to support data consistency at the enterprise level.
• Determining the transformation for each attribute that is being mapped / derived / ETL generated.
• Analyzing and updating existing logical and physical models for discrepancies with the physical database and business rule document.
• Played significant role in various phases of project life cycle, such as requirements definition, functional & technical design, testing, Production Support and implementation.
• Excellent team member with problem-solving and trouble-shooting capabilities, Quick Learner, highly motivated, result oriented and an enthusiastic team player.
• Support QA, UAT, Production Release and Store Launch.

Environment: Netezza, Oracle 10g, 11g, PL/SQL, SQL, Toad 9.2, SQL Developer/Modeler, SQL*Loader, Erwin 7.2, Visio, UNIX, InfoSphere DataStage 8.1, Talend 5, Pentaho, Business Objects, Jira for Defect tracking, Rally Agile Software.