Senior Data Engineer Resume
Bethpage, NY
SUMMARY
- 9+ years of experience in System Analysis, Design and Development in the fields of Data Engineering & Business Intelligence using Informatica, Oracle, SQL Server, DB2, Netezza, Red Shift
- Experience in working with Amazon Web Services cloud platform, (EC2, S3, Redshift, RDS & Athena)
- Extensive hands on experience on OLTP & OLAP Relational Data Source
- Experience in UNIX Shell scripting & Python Analytical Modules (Pandas & Numpy)
- Strong Experience in SQL & PL/SQL (Procedures, functions, triggers and packages)
- Experience with query optimization and Data Architecting in Netezza & Red Shift
- Expert in database tools like SQL Developer, PL/SQL Developer, TOAD & Aginity Workbench
- Experience with Data Modeling using SQL Developer Data Modeler, ERWIN & Aqua Cluster
- Experience working with clients for Requirement Analysis, Architecture, Design and Build
- Experience working in Waterfall and Agile SDLC methodology
- Experience working in Finance, Insurance & Media Domain
- Proficient in all phases of the project development life cycle starting from user interaction, specification development, back end development, coding, testing, implementation and production support.
- Excellent team leader with a unique blend of Managerial, Technical, Functional and Qualitative skills backed by strong record of facilitating cross - functional coordination for successful delivery of the Software Solutions.
TECHNICAL SKILLS
Operating System: Windows 2000, XP, UNIX
Data Warehousing: ETL- Informatica 9x, Tableau
Databases: DB2, Netezza, SQL Server 2005, Oracle, AWS Red Shift
Development/Productivity Tools: TOAD, Agility, HP Quality Center, Lotus Notes, MS Office.
Functional Areas: Insurance, Finance, Media
PROFESSIONAL EXPERIENCE
Confidential, Bethpage, NY
Senior Data Engineer
Environment: Netezza, Red Shift, UnixDuration
Responsibilities:
- POC on AWS Red Shift for the first cloud initiative for Cablevision enterprise and productionalized
- Successfully implemented Multi-Tenant Architecture design for the application.
- Worked on National Weighted Sampling and National Demographic files of 350M US Customers (DDG)
- Enhancing Media Plan Algorithms based on Reach, Budget & Impression
- LDM & PDM Data Modelling using Aqua Cluster & Erwin
- Development of complex SQL’s for media plan generation
- Performance optimization in Netezza & redshift
- ETL requirement analysis and weekly team updates on future enhancements
- Development of PL/SQL in Netezza for programmer dashboard.
- Data QC for Adhoc request from business team
- Usage & Performance reports using Tableau & Python 2.7
- Evaluation of NO SQL database, Mongo DB & SOLR
Confidential, Los Angeles, CA
Senior ETL Developer
Environment: Informatica, Unix, DB2
Responsibilities:
- As a lead member of ETL Team, responsible for analysing, designing and developing ETL strategies and processes, writing ETL specifications for developer, ETL and Informatica development, administration and mentoring.
- STTM’s were designed based on the discussion with clients and considering various data scenarios present in production.
- Clarifications of requirements for team and follow ups with DBA for database changes.
- Involved in developing complex database objects (SQL, ETL Mappings)
- Review of ETL code and test results.
- Work with the Data Architects in defining database structure
- Creating Unix Shell scripts for Audit & Balance control tables.
Confidential
Sr. ETL/Database Developer
Environment: Informatica, Unix, DB2. SQL Server
Responsibilities:
- Involved in the reviewing of components and test cases also involved in GAP analysis between STTM and requirements.
- Ensuring change of PDM for new requirements also supporting and defecting fixes during UAT phase.
- Developed complex SQL and involved in tuning and optimization of ETL procedures
- Responsible for requirement gathering from BA's and Architects also involved in Testing of data in Universe (BO) to ensure data flow and functionality.
Confidential
Sr. Project Engineer
Environment: Informatica, Unix, DB2, SQL Server
Responsibilities:
- Reviewed LDM and PDM received from On-Site and provided gaps if any also prepared STTM based on LDM and PDM.
- Responsible for preparing Traceability Matrix, Change control Tracker, LLd’s and UTC’s also designed components for Data marts.
- Accountable for reviewing the Components developed by Team members and provided the review comments.
- Involved in providing clarifications and mentored junior team members.
- Developed Automated UNIX Script to generate the workflow and review the mapping standards.
Confidential, Schaumburg, IL
Project Engineer
Environment: Informatica, Unix, DB2, Netezza, Autosys
Responsibilities:
- Efficiently designed Low Level Design documents and made reviews for components developed by team members.
- Designed UTC's covering Netezza and all logical and functional scenarios also completed component testing for complex Components.
- Involved in writing adhoc SQL to extract data from database to downstream purposes
- Involved in performance tuning of ETL objects
- Mentored new project members.
Confidential
Project Engineer
Environment: Informatica, Unix, DB2
Responsibilities:
- Designed complex Low Level Design documents and completed reviews for complex components.
- Designed UTC's covering all logical and functional scenarios for the complex components also designed code and completed component testing for the complex Components.
- Created logical data model for Business needs and requirements
- Developed Physical Database structure
- Managing production issues resolution and closure for issues forwarded by L3 support requiring major design support.
Confidential
Project Engineer
Environment: Informatica, Oracle, DB2
Responsibilities:
- Contributed in Requirement Analysis activities and involved in creating low level design document.
- Created unit test cases for medium and complex components also developed complex Informatica components.
- Involved in writing adhoc SQL to extract data from database to downstream purposes
- Involved in performance tuning of ETL objects
- Tested medium and complex Informatica components.
Confidential
Project Engineer
Environment: Informatica 8.1, Lotus notes, Oracle, DB2
Responsibilities:
- Responsible for creating mapping based on the requirements.
- Involved in writing adhoc SQL to extract data from database to downstream purposes
- Involved in performance tuning of ETL objects
- Wrote test cases and involved in Component testing also prepared Low level design documents.