Senior Database / Etl Architect Resume
MD
SUMMARY:
- Expertise in Data modeling for Data Warehouse/Data Mart development, Data Analysis for Online Transaction Processing (OLTP) and Data Warehousing (OLAP)/Business Intelligence (BI) applications.
- Experience in overall SDLC including Requirements gathering, Development, Testing, Debugging, Deployment, Documentation, Production Support and Applications management.
- Expertise in Master Data Management concepts, Methodologies and ability to apply this and expertise in building MDM solutions.
- Designed and developed workflows for maintenance of master data using Informatica MDM. And expertise on MDM Hub implementation.
- Extensive experience in Database Design, Normalization, Selective De - normalization, Forward/ Reverse Engineering of Applications, Conceptual, Logical and Physical data modeling using Erwin, E/R Studio and Sybase Power Designer.
- Good Experience in creating Data strategies, Data flow Diagrams and Data modeling (Dimensional & Relational) using Star-Schema Modeling, Snowflake Schema Modeling with Fact and Dimension tables.
- Experience with process modelling CMMI and BPM methodologies.
- Expertise in Process Improvement, Data Cleansing and Data Profiling using Informatica Data Quality (IDQ).
- Implemented Slowly Changing Dimensions and various transformations with Informatica Power Center 9.1 and IBM Data stage tools.
- Designed and Implemented Sequential and Parallel jobs with IBM Data stage tool.
- Experienced in implementing ETL solutions using various ETL tools such as Data stage, Informatica Power center, SQL Server Integration Services (SSIS), Data Transformation Services (DTS).
- Extracted the data from Teradata into HDFS using Sqoop (version 1.4.3) jobs with incremental load to populate Hive External tables.
- Extensive experience in writing Pig (version 0.11) scripts to transform raw data from several data sources into forming baseline data.
- Developed Hive (version 0.10) scripts for end user / analyst requirements to perform ad hoc analysis
- Very good understanding of Partitions, Bucketing concepts in Hive and designed both Managed and External tables in Hive to optimize performance.
- Good working knowledge of Cassandra & Tableau.
- Experience in version control using SVN, GIT and GITHUB and continuous integration management using Jenkins. Experienced in provisioning solutions using Docker.
- Working experience with E-ledger (AR, AP, GL) modules and Sub ledger system.
- Designed and Implemented Dimensional modelling for Sub ledger system and General Ledger System.
- Strong programming experience in Creating Packages, Procedures, Functions, Triggers, Views, Collections, Materialized Views, Dynamic SQL, ad-hoc reporting using SQL and other utilities like Oracle text and context on various oracle versions (9i,10g,11i,12c).
- Developed Forms and reports using Oracle APEX and oracle forms/reports 11g.
- Good experience in writing Java Scripts for Apex customizations and extensively used XML, HTML, CSS and Ajax for validations and Verifications in APEX 5.1. and APEX 4.1
- Worked with DBA/SA on Oracle Database/Exadata server’s upgrades, patching, ASM, Active guard set up, backups and contingency server’s maintenance & deployments.
- Integrated and implemented MDM, business intelligence (BI) and data warehousing (DW / EDW) solutions.
- Effective troubleshooting of performance and tuning problems in Oracle databases and Oracle Applications including I/O optimization, Indexing, SQL Tuning and Backup and Recovery Planning, Testing and Implementation.
- Working experience with Agile process in application development using JIRA, Confluence and TFS tools to define goals, coordinating teams and achieving results.
- Experience in Code reviewing, Mentoring and training junior developers by providing domain knowledge and Database designing approaches.
TECHNICAL SKILLS:
Scripting languages: SQL/PLSQL, Shell Scripting, Java script, CSS, AWK, SED, XML and HTML
Databases: Oracle 9i /10g /11g/12c, Teradata, Hadoop, SQL Server, Sybas e and PostgreSQL.
Data modeling: ER Studio, Erwin and Oracle Designer
Unix flavors: IBM AIX, HP UX, Sun OS, Linux
DW tools: Informatica power center 9.1, MDM & IDQ, Datastage 8.1, SSIS, Essbase Hyperion & Tableau.
Versioning Tools: SVN, VSS, Win CVS and SSH (Source Code Control System)
Operating Systems: Unix, Linux,Solaris,Windows98/2000/XPDocumentation: MS Office
Issue Tracking Systems: BMC ARS (Action Remedy System), HP Service Manager
Batch Job Processing: Autosys, CRONTAB, oracle scheduler and Control M
Other Tools and Systems: HP-Quality Centre(QA Tracking Tool), TOAD for database querying
PROFESSIONAL EXPERIENCE:
Confidential, MD
Senior Database / ETL Architect
Responsibilities:
- Involved as Database Team Lead for the team of 4 members to facilitate all the development and support activities for 16 NIAMS applications built on Hadoop(OLAP) and oracle (OLTP) database environments.
- Formulated technical specifications and prepared data models for the new applications along with Process flow and Data flow documents for the applications and developed Conceptual and Logical model using Erwin tools to design OLTP and OLAP applications.
- Analyzed existing data persistence and transmission mechanisms, identified core data assets, and created easy-to-understand data models for various consumers within the organization.
- Use database design and database modeling concepts to ensure data accessibility and security
- Worked with project and application teams to ensure that they understand and fully comply with data quality standards, architectural guidelines and designs.
- Created the architecture for the work flow management and integrated among the applications using the shared database.
- Managing Reconciliation/Correction of dividend data provided from various Confidential branches.
- Implemented Master Data and Land Process of loading the Grants and Accounts Data Set into Informatica MDM from various source systems.
- Defined the Trust and Validation rules and setting up the match/merge rule sets to get the right master records.
- Involved in Designing, document and configure the Informatica MDM Hub to support loading, cleansing, matching, merging, and publication of MDM data.
- Active participation in decision making and QA meetings and regularly interacted with the Business Analysts & development team to gain a better understanding of the Business Process, Requirements & Design.
- Implemented ETL solutions using Informatica as an ETL tool to extract data from various sources systems Teradata, Hadoop and legacy systems.
- Designed complete Gene Code processing system and Data flow models for Sequence generator project with PostgreSQL as database.
- Worked with highly unstructured and semi structured data of 90 TB in size (270 TB with replication factor of 3) to extract data from Teradata into HDFS using Sqoop.
- Extensive experience with Pig (version 0.11) to transform raw data from several data sources into forming baseline data.
- Designed and utilized Hive (version 0.10) scripts for end user / analyst requirements to perform ad hoc analysis and to resolve performance issues with OLAP Applications.
- Managing Analysis, Testing and Solution for different Issues (Tickets) requested for different schemas in Grants processing area.
- Reviewing Development of PL/SQL stored procedures, ETL jobs along with UNIX shell scripts.
- Managing and helping team to follow the complete SDLC cycle and agile methodologies using JIRA to plan the scrum schedules and deliverables for each scrum.
Environment: Erwin, Informatica power center 9.1, Informatica MDM & IDQ, SQL/PLSQL on Oracle 12c/11g and PostgreSQL, Control-M, Red hat Linux and APEX 5.1.
Confidential,DE
Database /ETL Architect
Responsibilities:
- Conducted one-on-one sessions with business users to gather data warehouse requirements
- Analyzed database requirements in detail with the project stakeholders by conducting Joint Requirements Development sessions
- Developed a Conceptual and Logical model using Erwin based on requirements analysis and designed Alerts system for the Credit card users as part of the credit card Notification system.
- Designed normalized Data warehouse environment for the enterprise level applications and Data marts for the credit card usage Analysis and applications.
- Worked with Database Administrators, Business Analysts and Content Developers to conduct design reviews and validate the developed models
- Facilitated development, testing and maintenance of quality guidelines and procedures along with necessary documentation
- Defined the Base objects, Staging tables, foreign key relationships, static lookups, dynamic lookups, queries, packages and query groups.
- Generated ad-hoc SQL queries using joins, database connections and transformation rules to fetch data from Oracle, Teradata and SQL Server database systems for Data profiling and Quality Analysis.
- Worked with highly unstructured and semi structured data of 90 TB in size (270 TB with replication factor of 3) to extract data from Teradata into HDFS using Sqoop.
- Developed Hive (version 0.10) scripts for end user / analyst requirements to perform ad hoc analysis and to resolve performance issue using Hive and Pig with understanding of Joins, Group and aggregation.
- Extracted data from the databases (Oracle and SQL Server, FLAT FILES) using DataStage to load it into a single data warehouse repository.
- Used DataStage Designer, Workflow Manager and Repository Manager to create source and target definition, design mappings, create repositories and establish users, groups and their privileges
- Exhaustively collected business and technical metadata and maintained naming standards
- Used Erwin for reverse engineering to connect to existing database and ODS to create graphical representation in the form of Entity Relationships and elicit more information
- Used Model Mart of Erwin for effective model management of sharing, dividing and reusing model information and design for productivity improvement
- Facilitated in developing testing procedures, test cases.
- Integrated the work tasks with relevant teams for smooth transition from testing to implementation.
- Managing and helping team to follow the complete SDLC cycle.
- Following agile methodologies using JIRA to plan the scrum schedules and deliverables for each scrum.
Environment: Erwin, Oracle 11g, DataStage 8.1, Control M, UNIX and SQL/PLSQL
Confidential,NJ
ETL/DB Architect
Responsibilities:
- Gathered various reporting requirement from the business analysts.
- Profiled the data using Informatica IDQ tool to analyze source data c oming from Legacy systems and performed Data Quality Audit.
- Reverse engineered the reports and identified the Data Elements (in the source systems), Dimensions, Facts and Measures required for new enhancements of reports.
- Conduct Design discussions and meetings to come out with the appropriate Data Mart Confidential the lowest level of grain for each of the Dimensions involved.
- Designed and Implemented Dimensional modelling for Sub ledger system and General Ledger System .
- Involved in implementing the Land Process of loading the customer Data Set into Informatica MDM from various source systems.
- Designed a STAR schema for the detailed data marts and Plan data marts involving confirmed dimensions.
- Configured match rule set property by enabling search by rules in MDM according to Business Rules.
- Created ETL Jobs using Informatica and Custom Transfer Components to move data from Oracle Source Systems.
- Created and maintained the Data Model repository as per company standards.
- Conduct Design reviews with the business analysts and content developers to create a proof of concept for the reports.
- Ensured the feasibility of the logical and physical design models.
- Collaborated with the Reporting Team to design Monthly Summary Level Cubes to support the further aggregated level of detailed reports.
- Involved in design and development of ASO and BSO cubes to support Planning, Forecasting and Reporting.
- Key involvement in editing Calc Scripts, developing MaxL scripts for automation, MDX for advanced queries. Worked extensively on data loads, load rules, Calc scripts and UDAs.
- Responsible for the design, development, enhancement, and maintenance of the various BSO cubes used for forecasting and strategic decision-making.
- Involved in development, performance tuning and optimizations for data/dimension loads, database restructuring (BSO/ASO), calculations, overall Essbase performance. Key techniques used were resetting databases, grouping sparse member combinations, using parallel calculations, managing caches, using two-pass calculations and changing buffer size.
- Worked on the Snow-flaking the Dimensions to remove redundancy.
- Designed Sales Hierarchy dimensions to handle sales hierarchy reporting historically and dynamically
- Worked with the Implementation team to ensure a smooth transition from the design to the implementation phase.
- Worked closely with the ETL Developers to explain the complex Data Transformation using Logic
Environment: Informatica Power center 8, MDM & IDQ, ER Studio, SQL/ PLSQL on Oracle 11g, Autosys, UNIX, Hyperion Essbase 11.1.2, Essbase Studio, Hyperion Excel Add-in and DB Profiler.
Confidential,Columbus,OH
Oracle Lead Developer
Responsibilities:
- Responsible in developing “Privacy Initiative” (PI) project using Virtual Private Database (VPD).
- Created Relational model for the alerts system by identifying required parent and child tables using Erwin r7.1
- Used forward engineering to create a Physical Data Model with DDL that best suits the requirements from the Logical Data Model
- Automated the Testing of security policies on schemas which restricts sensitive data to the users.
- Involved in Analysis, Testing and Solution for different Issues (Tickets) requested for different info1 maintained schemas.
- Designed a STAR schema for the detailed data marts and Plan data marts involving confirmed dimensions.
- Used forward engineering to create a Physical Data Model with DDL that best suits the requirements from the Logical Data Model
- Prepared and led multiple internal and external IT groups and resources during deployment and Go live by executing issue resolutions both hands on and through escalations.
- Active participation in decision making and QA meetings and regularly interacted with the Business Analysts & development team to gain a better understanding of the Business Process, Requirements & Design.
- Coded and implemented packages to perform PI testing and batch job scheduling.
- Developed Shell Scripts to automate the testing PI applied columns across the schema.
- Developed UNIX Shell Scripts and PL/SQL procedures to extract and load data for batch processing.
- Performed tuning and optimization on SQL queries using Explain Plan.
- Expertise in use of Export/Import and Datapump (object level, schema level, transportable tablespace and full database).
- Experience in Performance Tuning databases using various techniques. Collected performance statistics memory usage, data storage, data manipulation, physical / logical storage, network traffic and implement / manage parallelism for optimum performance using Explain Plan, SQL Trace, Tkprof & Statspack.
Environment: Oracle 10g, Crontab, AIX, SQL/PLSQL, Informatica power center 8.6
Confidential,NY
Senior Oracle Consultant
Responsibilities:
- Involved in Discussions with Swiss Re personnel based on the System Requirements Document to cover the functionality, technical issues and scope of work
- Analyzed, diagnose dividend data to identify any problems in data
- Analyzed Business requirements for changes.
- Reconciliation/Correction of dividend data provided from various vendors
- Automation of manual tasks which require more effort/resource and various other tasks
- Coded in PLSQL and Unix Shell Scripting
- Developed Data Inflation module using PLSQL packages.
- Code Review for the team developed procedures.
- Created many PLSQL packages
- Created many tables, stored procedures on Oracle
- Worked in query optimization
- Participated in performance tuning
- Provided support to the data files by running extracts and performing data imports through SQL Loader.
Environment: Oracle 10g, Oracle Designer, SQL/PLSQL, shell scripting.
Confidential
Senior Oracle Consultant
Responsibilities:
- Involved in user requirement gathering, analysis, design, coding and testing
- Involved in Design Documents of HLD & LLD
- Coded in PLSQL and Unix Shell Scripting
- Developed modules using SQL/PLSQL
- Designed, developed and modified Plsql scripts using the package & modules
- Worked in automating feed processing module with table-based data
- Created queries to generate complex reports by using inline quires and joins
- Created many tables, stored procedures on Oracle
- Involved in database design and SQL query performance tuning
- Created many batch scripts using KSH and scheduled in CRON TAB
- Created batch processes to function independently behind the scenes for data transfers and database updates
- Worked on bug fixing and supported the production applications
- Participated in design and development of various modules
- Worked in design documentation and change control up
Environment: Oracle 10g, Erwin, Informatica power center, shell scripting.
Confidential
Oracle Developer
Responsibilities:
- Involved in the Data Migration Activities
- Involved in Development of AOL objects like Defining Concurrent Programs and Executables for finance modules.
- Prepared requirement documents, high level design and unit test plans
- Developed and tested new scripts required to automate and drive the procedural execution of applications for efficiency and troubleshooting purposes
- Worked on creation of Control Files for SQL Loader to load data from Text Files.
- Created new stored procedures, triggers, views as part of Implementation. In AR, AP, GL Modules.
- Created Forms and Reports in AR, AP modules.
- Used SQL Loader for data loading
- Created Unix Shell Scripts for sequential execution of scripts including data extraction, transformation and loading. and Stored Procedure execution
- Involved in client interaction Confidential requirements capturing stage
- Developing test plans.
Environment: E -business Center 11i FINANCE Modules, PLSQL, Shell Scripting
Confidential
Responsibilities:- Responsible for Onsite Client interaction for information gathering.
- Developed an ISR data Entry tool to allow users to enter the terms of new ISR or Traded deals under negotiation signed or unsigned
- Coding and bug fixing
- Created new stored procedures, Triggers and modified existing packages and other schema objects
- SQL query tuning on complex reports
- Maintained the version control through Visual source safe.
Environment: PERL Solaris 2.x, KSH, Oracle, Erwin
Confidential
Responsibilities:
- Developed utilities and different shell scripts which were used while unit testing the code fixes.
- Created new stored procedures, Triggers and modified existing packages.
- Created Reports and customized Graphs to display real-time Views of the Data.
- Maintained the version control through Visual source safe.
- Worked on new modules and enhancements created views and table joins for generating Reports
- Analyzing the PLSQL code, log files and core dump taken from the defective systems.
- Worked on Shell Scripting.
- Involved in functionality testing and integration testing
Environment: PERL Solaris 2.x, KSH, SQL/PLSQL, OFA, OSA
