We provide IT Staff Augmentation Services!

Senior Data, Bigdata, Etl Architect  Resume

3.00/5 (Submit Your Rating)

Ny City, NY

SUMMARY:

  • Seasoned IT professional with over twenty years’ experience in designing and executing end to end solutions for complex business problems. Substantial data, bigdata architecting and Data Management skills. Offers technical guidance and directions for Enterprise Data Warehousing, and data security ( Role Base Assess Control ) for analytics and reporting.
  • Data Management, Data Warehouse Design, Data Integration, Agile Development, Informatica design and development,, Informatica Data Quality, Informatica Power Exchange for Web Services, Database Normalization, Production Support, Big Data & Analytics, Hadoop Ecosystem, Dimensional Modeling.

TECHNICAL SKILLS:

Programming Languages: PIG, Scala, Scoop, Spark, Flume, Shell Scripting, Oracle - SQL, Oracle-Packages, Oracle-PL/SQL, Java Script, VBA(Excel), VB Script, Visual-Basic, C, C++, Java Swing, JavaDatabases: Hive, Hbase, Impalla, Teradata, SQL Server, Oracle 11g, Oracle 10g, Oracle 9i, Oracle 8i, Oracle 7, MYSQL, POSTGRESQL, MS Access

Operating System: Linux, Windows 10, Vista, Windows XP, Windows 98, Windows 95

Technical Tools: Cloudera Manager, HUI, Yarn, Collibra, Ab Initio, SQL Developer, SQL Developer Data Modeler, Erwin 8.1, ER-Studio, TOAD, Informatica PowerCenter & Power Exchange 8.6/9.1, Informatica Data Quality, Informatica Master Data Management, Informatica Scheduler, Visual Studio, SourceSafe, Active Batch V7, Global Event Web Services, Control Server (SCHEDULER), ODBC, JDBC, Microsoft Visio, Crystal Reports Pro, Notes Pump.

PROFESSIONAL EXPERIENCE:

Confidential, NY City, NY

Senior Data, BigData, ETL Architect

Responsibilities:

  • Designed and developed a customizable data management system in Hadoop to interfaced with the current RBAC system.
  • Integrated Collibra, Ab-Initio and ER-Studio to collect the business and technical metadata.
  • Responsible for classifying fifty thousand financial data fields as per Data Governance requirements.
  • Created Apache Impala Normalized database for metadata data repository.
  • Used UNIX shell and HQL scripting to extract, convert and load metadata files into HDFS directories.
  • Integrated business and technical metadata into RBAC system to offer data access security and data management.
  • Incorporated Data Security Management , Document Record and Content Management , Meta Data Management and Data Governance for regulatory.

Technology Used: VBA(Excel), Unix Shell Scripting, SQL, HQL, Impala, VBA(Excel), Tivoli, ER-Studio

Confidential

Senior Data, Bigdata, ETL Architect

Responsibilities:

  • Translated business requirements into technical specification and Logic.
  • Worked with the data modelers and business users to review the dimension modeling design and the Logical Data Model(LDM).
  • Created the source to target mapping documents for the Staging, Enterprise, Integrated and Analytical layers.
  • Analyzed each field to determine the logic from the Data Transformation rules and created algorithm.
  • Built HQL insert logic script for each dimension and fact tables.
  • Delivered final source to target mapping and insert scripts to the Hadoop Developers.
  • Worked on design for Incentive and compensation and cross-reference strategies for legacy and future reference data.
  • Analyzed and resolved defects for SIT, UAT and Pre-Production.

Technology Used: Informatica, Scoop, Unix Shell Scripting, Psftp, Super Putty, SQL, HQL, VBA(Excel), Teradata, Impala, Hive, HBase, Agile development

Confidential

Lead Senior Data & Informaticac ETL Architect

Responsibilities:

  • Identified and created detailed data flow diagrams for the current Informatica ETL processes and Shell Scripts.
  • Reversed engineer and redesigned a more robust system that addressed the manual and semi-automated processes.
  • Redesigned and created detailed data flow diagrams for the proposed end to end solution for the merchant payment system.
  • Created source to target mapping documents, Data Transformation and logic and algorithms.
  • Worked with the Subject Matter Experts and data modelers to update the Logical Data Model.
  • Delivered Infromatica workflows, source to target mappings and logic to developers to create the final ETL processes.

Technology Used: Informatica ETL Tools, Unix Shell Scripting, SQL, Teradata, BTEQ, Microsoft Visio, Tivoli, VBA(Excel)

Confidential, El Segundo, CA

Lead Senior Data Architect/Informatica Developer

Responsibilities:
  • Worked with Business Analysis and Architect in gathering the requirements for new data warehouse.
  • Translated business requirements into technical specification.
  • Laid out the solutions for the ETL, logic, algorithms, and source to target loading strategies.
  • Developed, tested, validated, migrated and implemented data into SIT, UAT and Pre-Production and supported production Support.

Technology Used: SQL Server 2008, Oracle 11g, Informatica Tools, SQL, UNIX Shell scripting, Active Batch

Confidential, Hoboken, NJ

Senior Data Architect & Lead Informatica Developer

Responsibilities:
  • Gathered Business Requirements and translate into Technical Specifications for Informatica ETL team.
  • Offered technical strategies and directions to five onshore and four offshore Informatica develop.
  • Laid out the solutions for the ETL, logic, algorithms, and source to target loading strategies.
  • Developed, tested and migrated Informatica ETL mappings for OLTP and OLAP system for SIT, UAT and Pre-Production.
  • Oversee Production migration and assisted production support team.

Technology Used: Oracle 11g, PLSQL Packages, Procedure and Functions, SQL Transformation, Update/Insert Strategy, Mapping Parameters and Variables.

Confidential, New York, NY

Senior Data Architect, RDBMS & Data Warehouse Developer

Responsibilities:
  • Created ETL scripts using PLSQLto migrate data to Oracle’s Revenue Management Billing financial system (RMB) .
  • Created translation, cleansing and mappings procedures.
  • Utilized Oracle performance tools to accurately optimized and tuned SQL scripts reducing extraction process by 70%.
  • Validated completeness and accuracy of converted data. Developed scripts to enabled fast recovery of Oracle objects.
  • Developed, tested, validated, migrated and implemented data into DEV, SIT, UAT and Production.
  • Oversee Production migration and assisted production support team.

Technologies Used: Oracle 10g, SQL, PLSQL Packages, Procedure, and Functions.

Confidential, East Hanover, NJ

Senior Data, ETL Architect, RDBMS, Data Warehouse Developer

Responsibilities:
  • Responsible for all aspect of software development including designing, developing and production support.
  • Interacted with the business owners to gather requirements and translate them into technical specifications.
  • Managed the logical and physical data models for the OLTP and Data Warehouse system
  • Managed the design and development for ETL scripts that supported seventy internal and external systems.
  • Created and managed the training environment as well as creating training documents for the sales representatives.
  • Oversee migration data into DEV, SIT, UAT and Pre -Production. Supported all Sales Representatives applications.

Technologies Used: Lotus Notes GUI interface, Stored Procedures, Oracle 8i/9i, SQL, PL/SQL, VB, Unix Shell Script, Crystal reports Pro, Java Web Development, Trillium, Siperian Master Data Management, Toad, Eclipse, C, C++, Java

Confidential, Bridgewater, NJ

Senior Software GUI, ETL, RDBMS Developer

Responsibilities:
  • Translated business requirements into technical specification.
  • Participated with team members in architecting the research project.
  • Designed, developed and migrated the OLTP GUI application for substructure searches on chemical compounds.
  • Designed and developed customizable reporting system using Visual Basic.
  • Created conceptual, logical and physical models.
  • Developed, tested, validated, migrated and implemented processes into DEV, SIT, UAT and Production.

Technologies Used: Oracle 8i/9i, SQL, PL/SQL, Stored Procedures, Visual Basic, Batch Scripting, Crystal Reports Pro,

We'd love your feedback!