We provide IT Staff Augmentation Services!

Senior Data Engineer Resume

CAREER SUMMARY:

  • Experienced and detail - focused senior developer and leader with extensive IT experience Adept in analyzing systems, architecting the data process flow diagrams, and building functional and technical documents.
  • Over 11 years of experience in data warehousing and data integration.
  • Proficient in data integration and ETL on Informatica platform.
  • Last 5 years of my career I have mostly been in Informatica Solution Designer and/or Senior Informatica Developer roles on Agile projects.
  • Able to demonstrate proficiency and implement Informatica best practices approach and architecture.
  • Experience in automated generation of Informatica code (mappings) and passionate about optimizing both Informatica processes as well as underlying SQL. In depth knowledge of Informatica platform, data quality, data profiling and metadata management.
  • Held DWH/Data Integration consultant across various industries: banking (1.5 years), telecom (3.5 years), retail (2 years), insurance (4 years) and airline industry (1 year); and have solid understanding of each industry data model.
  • Expert experience over various database platforms: Oracle, Teradata, Greenplum, DB2, Amazon Redshift, SQL Server, Postgres.
  • And reporting platforms: Cognos and Business Objects.
  • I have worked mostly on projects involving high volumes of data and have done either projects or proofs of concept involving Informatica, Data Vault, CDC and Big Data.
  • Regarded by the clients for being able to quickly understand their data and processes and propose viable and quality solutions.
  • Throughout my career I have demonstrated my capacity for adapting to change, learning quickly and creating strong relationships.
  • I enjoy leading a team or just being a part of it.
  • My career goal is to continue building and demonstrating knowledge, and keep working on interesting and challenging projects, providing simple but quality solutions for seemingly complex problems.

CORE COMPETENCIES INCLUDE:

  • Data Analytics
  • Data Conversion and Migration
  • Agile Methodology
  • Data Analysis
  • SQL
  • Leadership
  • UNIX Shell Scripting
  • Source Systems Analysis
  • Data Integration
  • Data Mapping
  • Data Models Development

STRENGTHS:

Data Analysis | Problem Solving | Solutions Focused | Change Agent | Team Collaboration | Performance Development

TECHNICAL SKILLS:

ETL: Informatica Powercenter 10.1 (Repository Manager, Designer, Server Manager, Workflow Monitor, Workflow Manager, PowerExchange CDC, Analyst), Data Mapping, Data Profiling, Informatica Data Replication, Informatica Powercenter 9.6, 8.6, 8.1

Data Modeling: Physical modeling, Logical modeling, Relational modeling, Dimensional modeling (Star Schema, Snowflake, Fact, Dimensions), Entities, Attributes, Cardinality, ER Diagrams, Erwin

Reporting: Cognos, Business Objects

Databases: Oracle, Teradata, Greenplum, Postgres, Redshift, DB2, SQL Server

Job Scheduling & Other tools: CONTROL-M, Autosys

Utilities: TOAD, SQL Loader, SQL Navigator, SQL Developer, MS SQL Server Management Studio, pgAdmin, Aginity, Tortoise SVN, GIT, JIRA, Confluence

Languages: UNIX Shell Script, SQL, PL/SQL

Environment: UNIX (Sun Solaris, HP-UX, AIX), Windows 2013/2000/XP

Others: Enterprise Architect, Visio

EXPERIENCE:

Confidential

Senior Data Engineer

Responsibilities:

  • Designing solutions to complement and improve data acquisition processes
  • Setting up data replication jobs to Greenplum, Postgres and Kafka
  • Creating Informatica Mappings and Workflows
  • Setting up data replication jobs (Informatica Data Replication, Powerexchange) in test and production environments
  • Collaborating with DBAs for various source systems (Oracle, Mainframe, z/oS, Informix, MS SQL Server…) and providing guidance for setting up data replication jobs from source databases
  • Deploying code changes to Production based on business requirements and priorities
  • Submitting code (object DDLs) to GitHub for Deployment to Production
  • Developing complex SQL for reconciliation of real time data in Production
  • Creating and updating JIRA tickets
  • Supporting and improving Production jobs
  • Creating automation scripts and workflows to generate code for faster development and deployment of objects
  • Mentoring and training other team members
  • Provided support and guidance for upgrade of Informatica platform from 9.6 to 10.1

Confidential

Senior Informatica Developer

Responsibilities:

  • Delivered Informatica mappings and optimized data model that served as a template for future data vault implementation in the company
  • Provide mentoring and guidance for employees on site
  • Informatica 9.6 Business glossary and Metadata Manager installation and configuration

Confidential

Consultant

Responsibilities:

  • Informatica Best Practices Architecture implementation and configuration, documentation and knowledge transfer
  • Solution design and project development/delivery ( Informatica 9.6 and Amazon Redshift )
  • ODS solution design (Informatica and Oracle)
  • Developing complex SQL queries for reconciliation on large datasets

Senior ETL Developer

Confidential

Responsibilities:

  • Gathered Requirements to understand the data flow and analyze Functional Design, coordinate with the client thru emails and conduct meeting to clarify all the insufficient information
  • Created Technical Design based on all the information provided in the Functional Design to transform data from one Interface to another to create a Integrated Marketplace.
  • Working on multiple technical designs at the same time to meet the deadlines.
  • Data Architecture, Data Flow Diagrams
  • Creating all Informatica mapping and workflow templates
  • Optimization and troubleshooting of existing non-performant ETL components
  • Delivery of key projects that involved ETL support - such as Premium UpgradeMe Bid for Marketing
  • Involved in enhancement of the UNIX shell script to be more efficient for various processes

Senior ETL Developer

Confidential

Responsibilities:

  • Creating all Informatica mapping and workflows for critical, actuary driven project, under a tight deadline
  • Defining and applying hundreds of rules in ETL (Informatica), defined by actuaries, on large datasets
  • Testing and deployment to production
  • Collaborated with business intelligence and functional teams to gather information regarding the source and target mappings.

Confidential

BI developer/ Senior Informatica Specialist

Responsibilities:

  • Upgrade and migration of Informatica Platform from 8.1 to 9.1
  • Data migration planning and preparation - 3 existing database environments (Oracle)
  • Creating all SQL scripts for data migration and performing most of the reconciliation and testing of data and Informatica jobs after the migration
  • ODS solution design and development
  • Support and deployment of production Informatica jobs
  • Created design documents for the vendor development team to transform data from data warehouse into dimensional data mart. Load of all the dimensional and fact aggregated tables
  • Created Source to Target mapping document to understand the mapping scenario between the two applications.

Confidential

DWH Consultant

Responsibilities:

  • Gathered, analyzed and modeled client data on customers, financials, operations and access channels or market data on competitors, products and suppliers to improve insight and decision making.
  • Reviewed Functional Requirements to understand the data flow from one application to another. Reviewed the product requirement and requirement traceability matrix document.
  • Collaborated with business intelligence and functional teams to gather information regarding the source and target mappings.
  • Studied the dimensional data model to understand the structure of the data and data types. Mapping the data types between the source and target tables. Reached out to the Data Architecture team for any difference or issues.
  • Data Profiling included the understanding of Data Lineage of Data flow from various feeds to various in stream tables and the column used in any Java process or Procedure. Reading and understanding the Java code or Procedure to analyze data.
  • Conducted review with the business to decide if breaks were necessary to build based on the data profiling results.
  • Created Controls by using Analytics SQL Queries to build Pivot Reports, DQI and Count Reports to represent the Market to Market Value on the possible break based on Feed and counterparty level on their existing processes.
  • Created Graphs to show visual representations of data for various kinds of reports.
  • Championed role as ETL Informatica Developer. Performed the detailed design of ETL to data mart (informatica). Participated in design reviews, Inform the technical architect and project manager of any issues that may affect any other areas of the project Fix any defects and performance problems discovered in Production
  • Resolved high and critical defect fixes in the development of ETL processes generated by System Test & business rules change
  • Created new Mappings and modified existing Mapping /Workflows (Target - XML and DB), processed defect fixes, tested, validated data.
  • Documented and implemented all the objects being used in ETL development into upper environments.
  • Created Test Documents for all the changes and uploaded to the Tortoise SVN
  • Created new Autosys job scheduling entry to run the interface. Implemented logic for Dependency scheduling jobs. Ran Autosys jobs to verify migration moved correctly
  • Migrated data from one environment to another. Created data validation sheets for unit test for each Releases.
  • Generated Mock data, Test scripts for various data scenarios and tested all the Test Script using backend.
  • Migrated the development work into UAT environment and Production.

Hire Now