Technical Architect/lead Etl Developer/greenplum Developer Resume
Norwalk, CT
PROFESSIONAL SUMMARY:
- A forward thinking, capable and committed Technical Architect/ Senior Data warehouse consultant having over 11 years of experience in implementing Data warehousing/Data quality applications and Data lake applications and data virtualization applications with different tools and multiple backend databases.
- Well versed with Data warehousing concepts and good understanding data lake concepts and architecture.
- Expertise in the data analysis for source and target systems and Data architecture.
- Expertise in designing and implementing ETL environments using tools like Informatica and backend databases racle and Greenplum
- Experience in using ETL methodologies for supporting Data Extraction, Data Migration, Data Transformation and loading using Informatica Power center 9.6.1/9.1/8.6.1/ 7. x/6.2, IDQ
- Had experience in doing Gap analysis between source feeds and master data
- Had experience in Devops environment and understanding of operational challenges
- Strong understanding of data warehousing - Star/Snowflake schema
- Preparing logical and physical data models using ER studio
- Implemented performance-tuning techniques at application, database and system levels.
- Having good exposure in UNIX shell scripts with Informatica.
- Experience in dealing with a software development process from requirements through implementation
- Wide range of IT industry experience with Banking / Finance with strong analytical, problem-solving,Organizational, communication, learning and team skills. Experienced with coordinating cross-functional teams.
- Excellent communication and interpersonal skills. Ability to work effectively as a team lead as well as an Individual
- Good understanding on collateral management and capital investment domain terminology.
- Ability to quickly adapt to changing priorities, requests, and environments.
- Understanding of OBIA, DAC and OBIEE environments.
- Adept in UNIX operating system commands & Shell Scripting.
- Experience with scheduling tools Control-m, Appworx. and window scheduler
- Experience in implementing data virtualization projects
- Experience in implementing Informatica change data capture (CDC).
- Very good experience in developing solutions using the Informatica Ipaas and cloud
- Experience in Informatica Data Quality for cleansing and formatting customer master data.
- Performed profiling using Informatica Analyst and Informatica Developer.
- Captured DQ metrics (like Total record count, Distinct record count, count of a distinct field, Count of null,Referential checks etc.) on the inbound/raw data (i.e., Prep or Stage), and then again on the processed/output data (i.e., Base or Pub).
- Created scorecards to review data quality.
- Used Informatica Data Quality tool (Informatica Developer) to scrub, standardize and match customer address against the USPS database.
- Experience in Data profiling and working various data quality transformations and data standardization
- Involved in the installation and administration of Informatica server.
- Used Informatica Metadata Manager and Metadata Exchange exhaustively to maintain and document metadata.
- Strong experience in programming using SQL.
- Good understanding of green plum databases and capable of writing complex sql’ s and functions
- Extensively involved in creating Oracle PL/SQL Stored Procedures, Functions, Packages, Triggers, Cursors, and Indexes with Query optimizations as part of ETL Development process.
- Expertise in designing data lake environments using HVR and Pivotal Green plum.
- Experience in loading data from different sources into Greenplum system.
- Understanding of AWS redshift database internals
- Implemented parallel data unloading and loading using external table with gpfdist utility.
- Experience in performance tuning.
- Implemented some of the etl processes using linux shell scripting and PL/pgSQL language.
- Good understanding of data distribution, table partitioning and compressions in Greenplum.
- Experience in designing data models.
- Experience in implementing Enterprise Data Warehouse using Greenplum as Target system.
- Involved in designing and creating reports in Denodo platform
- Strong skills in Data Analysis, Data Requirement Analysis and Data Mapping for ETL/Denodo processes.
- Hands-on experience in creating the Denodo views through using JDBC, ODBC, Delimited files and SOAP/REST Web services
- Creating Denodo views and derived views in VDP with connecting multiple data source systems.
- Creating and Scheduling the Denodo jobs with Web scheduler.
- Monitoring overall data quality for assigned data entities and capturing DQ rules for the same.
TECHNICAL SKILLS:
Operating Systems: Windows 2000/2003 server and UNIX
Languages: C, C++, XML, SQL and PL/SQL, PostgreSql 8.2.1
Databases: Oracle 9i, 10g and 11g, Teradata and Green plum 4.3
ETL Tools: Informatica PC 7.1.4,8.1.1,8.6.1,9.1.1,9.5.1 and 10.1, PWX 8.6.1 RT, PWX WebServices 8.1.1 RT and 8.6.1 RT.
Data Quality and Cloud: Informatica Data Quality 9.1.1,9.5.1 and 10.1 (IDQ), Informatica Ipaas and cloud and AWS redshift
Data Virtualization: Denodo 5.5 and 6.0, Denodo Administration
Bigdata Technologies: HDFS, HIVE, Apache Pig, Sqoop, Map reduce
OLAP Tools: Business Objects 5.1.6, OBIEE 11G, OBIA, Tableau 10.1
Data Modeling Tools: ER studio 9.0
Scheduling Tool: Ctrl-M, DAC11G, Appworx
Tools: Toad, PL/SQL Developer, PG Admin 1.2, Sub version, Microsoft Vss, Putty, Rally
PROFESSIONAL EXPERIENCE:
Confidential, Norwalk, CT
Technical Architect/Lead ETL developer/Greenplum Developer
Responsibilities:
- Participating in user meetings, gathering requirements, discussing the data issues with end users.
- Responsible for data analysis of source feeds and file feeds
- Preparing High Level technical d esign documents.
- Preparing logical and physical data models using ER studio
- Developed mapping spreadsheets for (ETL) team with source to target data mapping with physical naming standards, data types, volumetric, domain definitions, and corporate meta-data definitions.
- Experience in writing functions in pivotal green plum
- Proven experience in writing complex sql queries and functions in oracle and Greenplum
- Involved in creation of denodo views and schedules
- Creating Denodo views and derived views in VDP with connecting multiple data source systems
- Involved in designing and creating reports in Denodo platform
- Code review of all technical specs like informatica mappings, sessions and scripts and responsible for deliverables.
- Tuning the performance of mappings and sessions in informatica and at database level
- Performed profiling using Informatica Analyst and Informatica Developer.
- Captured DQ metrics (like Total record count, Distinct record count, Count of a distinct field, Count of null, Referential checks etc.) on the inbound/raw data (i.e., Prep or Stage), and then again on the processed/output data (i.e., Base or Pub).
- Created scorecards to review data quality.
- Used Informatica Data Quality tool (Informatica Developer) to scrub, standardize and match customer address against the USPS database.
- Design, Development and implementation of Informatica Developer Mappings for data cleansing using Address validator, Labeler, Association, Parser, Expression, Filter, Router, Lookup transformations etc.
- Used Informatica Address Doctor for global address verification across an organization
- Imported mapplet and mappings from Informatica developer (IDQ) to Power Center.
- Done extensive testing and wrote queries in SQL for push down optimization
- Responsible for change management and ensuring the quality of the deliverables.
- Participating in UAT meetings and co-ordinating with Business to receive business sign-off.
- Preparing improvements plans in BI and value adds to the project
- Ability to quickly learn applications & Process with minimal documentation
- Leading the technical team and guiding the team on technical challenges.
- Supervising day to day activities completed by team and updating customer on daily basis
- Strong influencing and technical Communication skills.
Environment: Informatica Power Center 10.1, Informatica IDQ 9.5.1 and 10.1, Oracle 11g, Greenplum 4.3, Sql, PostgreSQL, Denodo 5.5 and 6.0, UNIX, PG Admin 1.2
Confidential
Lead ETL Developer
Responsibilities:
- Participating in user meetings, gathering requirements, discussing the data issues with end users. Translating user inputs into ETL design docs.
- Preparing High Level Design documents.
- Preparing logical and physical data models using ER studio.
- Leading the technical team and guiding the team on technical challenges.
- Code review of mappings, sessions and scripts and responsible for deliverables.
- Mapping development and guiding the team on ETL development
- Tuning the performance of mappings and sessions.
- Involved in preparing design steps for reporting teams.
- Having understanding of reports and dashboards creation in OBIEE.
- Participating in SIT and co-coordinating with other vendors.
- Responsible for change management and ensuring the quality of the deliverables.
- Participating in UAT data loads and co-ordinating with Business to receive business sign-off.
- Responsible for Lead problem solving and collaboration with in the team.
Environment: Informatica Power Center 9.5.1, Oracle 11g, Oracle EBS, OBIEE 11G, DAC, Unix.
Confidential, Eagan, MN
Senior DW consultant
Responsibilities:
- Participating in user meetings, gathering requirements, discussing the data issues with end users. Translating user inputs into ETL design docs.
- Preparing High Level Design documents.
- Preparing logical and physical data models using ER studio.
- Developed mapping spreadsheets for (ETL) team with source to target data mapping with physical naming standards, data types, volumetric, domain definitions, and corporate meta-data definitions.
- Mapping development and guiding the team on ETL development.
- Tuning the performance of mappings and sessions in informatica and at database level
- Proven experience in writing complex sql queries and functions in oracle
- Code review of all technical specs like informatica mappings, sessions and scripts and responsible for deliverables.
- Performed profiling using Informatica Analyst and Informatica Developer.
- Design, Development and implementation of Informatica Developer Mappings for data cleansing using Address validator, Labeler, Association, Parser, Expression, Filter, Router, Lookup transformations etc.
- Imported mapplet and mappings from Informatica developer (IDQ) to Power Center.
- Involved in Extracting data from sales force and loading into Data warehouse.
- Worked with Memory cache for static and dynamic cache for the better throughput of sessions containing Rank, Lookup, Joiner, Sorter and Aggregator transformations.
- Participating in SIT and co-coordinating with other vendors.
- Responsible for change management and ensuring the quality of the deliverables.
- Participating in UAT data loads and co-ordinating with Business to receive business sign-off.
- Creation of process flow diagram from Microsoft Visio.
Environment: Informatica Power Center 9.1.1, Informatica IDQ 9.1.1, Oracle 11g, Sql Server, Sales Force, Unix.
Confidential, NJ
Senior DW consultant
Responsibilities:
- Analysis of the specifications and estimating the effort.
- Participating in user meetings, gathering requirements, discussing the data issues with end users. Translating user inputs into ETL design docs.
- Preparing High Level Design documents.
- Developed mapping spreadsheets for (ETL) team with source to target data mapping with physical naming standards, data types, volumetric, domain definitions, and corporate meta-data definitions.
- ETL mappings development & bug fixing.
- Used various transformations like filter, expression, sequence generator, update strategy, joiner, router, aggregator, union and XML transformations to create robust mappings.
- Hands on experience working with reading data thru XML sources and Targets, working thru web services, Configuring Informatica workflows to read thru Web services.
- Experience in implementing Informatica change data capture (CDC).
- Configuring and running sessions, tasks, and workflows.
- Participating in SIT and co-coordinating with other Confidential vendors.
- Installation, configuration Informatica server and Informatica repository server on DR machine.
- Tuning the performance of mappings and sessions.
- Extensively involved in creating Oracle PL/SQL Stored Procedures, Functions, Packages, Triggers, Cursors, and Indexes with Query optimizations as part of ETL Development process.
- Responsible for change management and ensuring the quality of the deliverables.
- Migrating Informatica workflows/folders from one environment to another.
- Scheduling file watcher and Informatica jobs in Ctrl-M.
- Creation of process flow diagram from Microsoft Visio and mapping documents
Environment: Informatica Power Center 8.6.1 and 9.1.1, Oracle 10g/11g, Toad, Windows 2003 Server, UNIX.
Confidential
Informatica Developer
Responsibilities:
- Analysis of the specifications.
- Preparing conceptual design documents
- Preparing source to target mappings documents.
- ETL mappings development and implementation of small enhancements.
- Used various transformations like filter, expression, sequence generator, update strategy, joiner, router, aggregator, union and XML transformations to create robust mappings.
- Configuring and running sessions, tasks, and workflows.
- Created mappings for various sources like flat files, Oracle and Transformations like aggregator, update strategy, expression, lookup to load and integrate the investment level details to ware house
- Tuning the performance of mappings and sessions.
- Effectively used different Workflow manager tasks viz, Worklet, Command, Decision, Email, Event wait and Event raise
- Initial extraction of data from source to target.
- Creation and Monitoring Workflows and Sessions using Informatica.
- Enhanced and modified the existing UNIX shell scripts to schedule tasks/sessions and to execute Informatica workflows.
- Scheduling jobs using Control-M and Windows scheduler.
- Unit and system testing of ETL code.
- Creation of process flow Diagrams and Mapping documents
Environment: Informatica Power Center 8.6.1, Oracle 10g, Toad, Windows 2003 Server and Unix.
Confidential
Informatica Developer
Responsibilities:
- Analysis of the specifications.
- Preparing source to target technical design document (TD).
- ETL mappings development and preparing mappings documents.
- ETL mappings development and implementation of small enhancements.
- Used various transformations like filter, expression, sequence generator, update strategy, joiner, router, aggregator, union and XML transformations to create robust mappings.
- Involved in System Integration Testing of ETL Jobs.
- Unit testing and fixing test defects in SIT and UAT
- Supporting production environment to some period of time.
- Interacting with users and resolving the issues raised.
- Involved in scheduling the ETL Jobs.
Environment:: Informatica Power Center 8.1.1, Oracle 9i, Toad, Windows 2003 Server.
Confidential, California
Informatica Developer
Responsibilities:
- Prepared test cases for ETL mappings.
- Preparing mapping documents.
- Involved in bug fixing of ETL transformation logics
- Involved test case preparation for ETL testing
- Involved in System Integration Testing of ETL jobs.
- Preparing test results
- Supporting production environment for some period of time.
- Interacting with users and resolving the issues raised.
- Involved in scheduling the ETL Jobs using windows scheduler and Informatica scheduler.
Environment:: Informatica Power Center 7.1.1, Oracle 9i, Toad, Windows 2000 Server.
