Big Data Architect / Project Management Resume
Houston, TX
SUMMARY:
- 12 years of experience in leading Enterprise Data Warehouse as Application Lead, Data Architect, BI Reporting and Data Visualization, ETL, Data warehouse Technologies, Databases and Big Data ( Hadoop Eco system, HDFS, Hive, Sqoop, PIG, Spark )
- Experienced in leading and managing a Database and Data warehouse team of 3 to 15 people or more as part of a larger IT Development & Support teams consisting SMEs, DBAs, Database Developers and Application Developers.
- Understanding and delivery experience with all phases of the software development lifecycle (SDLC) and release management methodologies.
- Experienced in implementing custom development and / or systems integration projects phases of the software development lifecycle.
- Exposure in overall SDLC including Requirement Gathering, Development, testing, debugging, deployment, documentation, production support and Extensive experience in Project Management Methodologies MAPIT & PMAS.
- Designed, developed, and delivered software applications utilizing Hadoop and its infrastructure including Hive, Hbase, Pig, and Sqoop.
- Experienced with Cloudera, Hortonworks, Big Insights, and Pivotal Distributions of Hadoop.
- Delivered a Master Shell Script which automated an entire component of a project consisting of a Map Reduce job, Java program, and Loading data into a Hive Table
- Utilized UNIX commands to communicate to and from HDFS and manipulate other files in order to test development of software.
- Developed an application in Java to output metrics on a high volume of data from multiple flume clusters. This deliverable was sent to the business customer for constant usage.
- Involved in various projects related to Data Modeling, System / Data Analysis, Design and Development for both OLTP and OLAP Data warehousing environments.
- Experienced in Planning, Designing, developing and deploying Data warehouses / Data Marts with experience of both relational and multidimensional database design using Data Modeling tool Erwin (Physical and Logical data models).
- Extensive working knowledge on Data Modeling (Dimensional & Relational) concepts like Star Schema, Snow Flake & Constellation Schemas.
- Performance tuning, including collecting statistics, analyzing explains & determining which tables needed statistics. Increased performance by 35 - 40% in some situations.
- Utilized Big Data Technologies for preparing technical designs.
- Participated in learning of Big Data tools and Technologies.
- Analyzed Structured and Unstructured Data for Data Patterns. Data Science - Predictive Analysis using SPSS Modeler and R Programming.
- Strong experience in client interaction and understanding business applications, business data flow and data relations for them.
- Extensively worked Procurement data sets and Procurement Stakeholders.
- Strong technical, communication, time management and interpersonal skills.
- Highly motivated, result oriented professional with a short learning curve.
- Experience in Domains like Insurance, Banking, Retailer, Travel & Transport, Hospitality, Pharmacy, Oil and Energy and Entertainment.
TECHNICAL SKILLS:
BI Tools: Data Visualization BI Analytical Tools:Cognos 10/8.x, Cognos 7.x, Report Studio, Query Studio, Analysis Studio, Metric Studio, Event Studio, Data Manager, Access Manager, Power Play, Web, Business Insight, Business Insight Advance (BIA), Business Objects BOXI R2,: Tableau, Qlik view
BI Modeling Tools: Cognos Framework Manager, Transformer, Universe Designer
ETL Tools: Informatica Power Center 8.5/8.6, SQL Server Integration Services (SSIS)
Data Modeling: Erwin r7.1/7.2, ER Studio v 8.0.1, MS-Visio, IBM Rational Rose
Operating Systems: Windows (98, NT, 2000, XP, Vista, 7), UNIX, DOS
Directory Servers: LDAP server, Active Directory Server
Big Data Analytics/ Data Science Tools: Hadoop, No SQL, Hive, PIG, Big Insights, Ambari,R Programming, SPSS Data Modeler
Languages: SQL, PL/SQL, No SQL, HIveQLWeb Servers: IIS, Apache, IBM WebSphere
Languages: C, C++, Visual Basic, C#, Java, JavaScript (Cognos SDK), XML
Databases: Oracle 11g/10g/9i/8i/7.0, DB 2 8.0/7.0/6.0, MS SQL Server 2005/2000/7.0/6.0, Teradata V2R5/V2R4/V2R3, V13 Sybase 12.x/11.x, MS Access 7.0/2000, Netezza 7.0, 9.0v, IBM Pure Data systems
Data Warehousing: Informatica Power Center 8.6.1/8.1.1/7.1.1/7.0/6.2, Power Mart 5.1.1/5.x, Informatica Power Connect, Informatica Designer, Workflow Manager, Work flow Monitor, DataMart, OLAP, OLTP, Mapplets, Transformations, Autosys, Control M, SQL*Plus, SQL*Loader, Informatica ILM TDM
PROFESSIONAL EXPERIENCE:
Confidential, Houston, TX
Big Data Architect / Project Management
Responsibilities:
- Gathering Requirements from Client Business Groups and validating the same on Building Data Lake to serve End user Analytical & Reporting needs, Data Integration from multiple source systems.
- Authoring the project charter, documents detailing the business information requirements, functional specifications and executive presentations detailing the team's recommendations and findings. Batch Monitoring & adhering to SLA at the contract level. Collaborating with Client based on SOW. Working on RFI and RFP.
- Performing current state analysis. Connecting to all Business and Project stakeholders.
- Understanding Source Systems and their data / data architecture which serve as input to Data Lake (IBM Big Insights & IBM Pure data systems) for Motiva Reporting and Analytical needs for senior management.
- Exploring Big data tools like Spark, Hive, Big SQL, AQL, JAQL, and PIG.
- Data Visualizations tools for user interface as Watson Analytics, SPSS Modeler and Cognos 10.2.
- Provided planning and Technology recommendations for Motiva data lake with 44 source systems consist of relational and non relational (unstructured) data.
- Interacting with Business Analysts to finalize the requirements and documented the technical design document for Coding.
- Performed POC for SPSS Data Modeler, successfully deployed POC Model to draw business results as part of predictive analysis.
- Involved and managed big insights installations and smoke tests.
- Managing a team of 10 consists of Bid Data Developers, Business Analysts, DBAs and BI Developers.
- Understanding Source systems business and data, mapping it to end user requirements through BI Analytics.
Application Lead Data Management Systems
Responsibilities:
- Provided Test data management solutions for the end to end Simplification Program for Commercial Insurance and Personal Insurance.
- Performed Current System Analysis and provided solutions.
- Managed a team of 5 and also implemented project management solutions and productive templates.
- Orchestrated complex data flows. Interacted with end users on a regular basis to resolve issues pertaining to the reports and ODS Operations data Stores and EDW Enterprise data warehouse.
- Developing code for test data solutions extracting data, subset, masking by using Inforrmatica power center, validate, maintaining data in sync with production data by refreshing, archive the old data, purge, resolving defects and absorbing changes to requirement for test data) using ETL Informatica Power center ( multiple transformations like expression etc ) SQL scripts ( Oracle, DB2 & Netezza ) UNIX scheduled jobs and programming languages.
- Daily standup meetings with respective Application DBAs, Business Analysts, Application Architect and SMEs to go through outstanding issues and track the daily status and also o provide recommendations and solutions to defects / issues.
- Working closely with Application Architects, SMEs and Business analysts to understand the application functionally and technically.
- Designed dimensional models for existing and new Online Transaction Processing (OLTP) source systems.
- Designed and developed ETL’s and reporting products; worked collaboratively with developers to accomplish Simplification project goals.
- Acted as a resource for team members to solve technical problems and design challenges.
- Produced technical design documentation. Participated in User Acceptance Testing (UAT), data analysis and troubleshooting for existing applications.
- Participated in meetings with executives and business sponsors to discuss project status and activities. Followed quality standards and best practices for the development tasks.
- Data Integration from Multiple CI Simplifications Source System Applications.
- Requirements analysis with Business users, requirements analyst and management.
- Developed BI Analytic Dashboards in Tableau.
Sales Data Warehouse Application Lead
Responsibilities:
- Reviewed Root Cause Analysis & Impact Analysis. Playing key role in the incident management.
- Managed a team of 15 offshore and onshore. Driven periodic demand forecast strategies.
- Closed Worked with Procurement stakeholders.
- Extensively worked on Procurement data and analysis data for Procurement Dashboards.
- Being an Application Technical Lead for Sales Reporting Warehouse team, reporting to the senior VP SRW. Functional areas in scope included Area Sales, SRW, Property Sales and Account consolidation.
- Worked with Business Units to define Business strategy and create a centralized reporting capability for users to perform analytical and ad-hoc reporting for business applications and provide accurate information available to Decision Makers.
- Acquired good Business and Data Understanding. Worked with senior IT and business management to develop a comprehensive Data migration and Data integration strategy.
- Application Portfolio Management. Database Management Administration Activities. Working Closely with Infrastructure team on data security and FTP / SFTP.
- Ensure compliance of Data Quality in MDM. Determine the Target in MDM. Specify the Mapping between Sources and Target in MDM.
- Developed SSIS Packages to Consolidate date from various data Sources and also Data loads from various types of sources files (EXCEL, Access, Flat files, CSVs) and converted XL to SQL reporting.
- Designed and developed complex mappings to extract data from diverse sources including flat files, RDBMS tables, and legacy system files.
- Used RDBMSs to implement simple CRUD (Create, Read, Update, and Delete) operations and Built data marts ( detailed and Summarized)
- Involved in daily nightly batch loads (FULL & INCREMENTAL) into Staging and ODS areas, troubleshooting process issues and errors.
- Reviewed Root Cause Analysis and Impact Analysis. Played key role in the incident management.
- Managed a team of 15 offshore and onshore. Driven periodic demand forecast strategies.
- Application Technical Lead for Sales Reporting Warehouse team, reporting to the senior director SRW. Functional areas in scope included Area Sales, SRW, Property Sales and Account consolidation.
- Authored the project charter, documents detailing the business information requirements, functional specifications and executive presentations detailing the team's recommendations and findings.
- Batch Monitoring and adhering to SLA at the contract level.
- Worked closely with Business Analysts to finalize the requirements and documented the technical design document for Coding. Analysis and data mapping for the new source systems w.r.t legacy systems.
- ETL Informatica Power Center 9.1 for extraction, loading and transformation (ETL) of data in the data warehouse.
- Debugging and validating the mappings and Involved in Code Review and Design Review.
- Implements Informatica recommendations, methodologies and best practices.
- Identified data extract, transform, and load (ETL) strategies and ETLT strategies.
- Worked with multiple programming teams to establish ETL programming constructs and standards.
- Worked with users to develop effective data validation and correction processes.
- Implementations are populated slowly to change dimension to maintain current information and history information in dimension tables.
- Used Informatica Power Center Workflow manager to create sessions and batches to run with logic embedded in the mappings.
- Worked with different data sources such as Oracle, DB2, Netezza and Flat Files.
- Worked with the technical team lead for direction / design and collaboratively with team developers, Architects, DBAs, Integrations Administrators and others to achieve cohesive, compliant software deliveries.
- Participated in Design and technical code reviews as a of CCB (Change Control Board) member.
- Worked on re-run / recovery strategies and on call support for the application.
- Responsible for incident management and Escalation management.
Application Portfolio Lead for Data Warehouse
Responsibilities:
- Worked with Business Units to define Business strategy and create a centralized reporting capability for users to perform analytical and ad-hoc reporting for business applications and provide accurate information available to Decision Makers.
- Lead a team consisting of ETL, Data base and BI Reporting tool Developers.
- Coordinated with Onshore offshore team assignment on Deliverables.
- Worked pro-actively with the client with respect to Severities, opening bridge calls by involving respective stake holders until the issues are resolved.
- Scheduled and organizing stand up meeting related to high priority technical issues.
- Involved in building The ETL architecture and source to target mapping to load data into data warehouse.
- Created sessions, configured work flows to extract data from various sources, transformed data and loading into data ware house.
- Suggested the best time to set up data marts, cubes, and dashboards (before go-live and after), given constraints on scope, resources, time, and quality.
- Modified existing mappings for enhancements of new business requirements.
- Involved in performance tuning at source, target, mappings, sessions and system levels.
- Debugging and validating the mappings and Involved in Code Review and Design Review.
- Implements Informatica recommendations, methodologies and best practices.
- Identifying data extract, transform, and load (ETL) strategies
- Working with multiple programming teams to establish ETL programming constructs and standards
- Worked with users to develop effective data validation and correction processes
- Implementations are populated slowly to change dimension to maintain current information and history information in dimension tables.
- Created the Framework manager model using the Model Accelerator to bring up a perfect Star Schema.
- Provided sessions on the usage of the External Metadata functionality to the Power Users which enables the customized data reporting.
- Created Multi Page report based on Multiple Master queries to show the data on different pages when the Master record changes in a Report using Report Studio.
- Successfully Migrated Reports from Cognos 8.4 to Cognos 10.1.1 environment.
- Conceptualize and formalize several List, Chart, Cross tab, master-detail, Drill-Down and Bursting reports using Report Studio, and made available to the users.
- Developed Conditional Formatting, Conditional Blocks Using String, Boolean and Language variables.
- Developed few ad-hoc custom SQL reports.
- Scheduling and distributing Reports through Schedule Management in Cognos Connection.
- Define the security structure for the complete user community, by adding roles and groups to the Cognos Connection directory and mapping all the users to 1 or more of these roles / groups.
- Deployment of Reports, Packages, Users and sometimes the complete Content Store from one environment to the other.
- Trained business users in the Ad-Hoc Components like Business Insight and the Business Insight Advanced.
- Prepared the Presentations / User Guides to the End Users as part of the training.
Data / ETL Architect
Responsibilities:
- Involved in the entire project life cycle from analysis, installation, development, testing, production and end user support.
- Worked closely with business users while gathering requirements.
- Used Existing ETL standards.
- Analyzed data mappings for the new source systems w.r.t legacy systems for converted properties.
- ETL Informatica Power Center 8.0 for extraction, loading and transformation (ETL) of data in the data warehouse.
- Uses Informatica Power Center Workflow manager to create sessions and batches to run with logic embedded in the mappings.
- Worked with different data sources such as Oracle, DB2, Netezza and Flat Files.
- Worked with the technical team lead for direction/design and collaboratively with team developers, Architects, DBAs, Integrations Administrators and others to achieve cohesive, compliant software deliveries.
- Participated in Design and technical code reviews, also active member of CCB.
- Worked on re-run /recovery strategies and on call support for the application.
- Created Dimension Model for the reporting system by identifying required Dimensions and facts using E R Studio v8.0.1.
- Conducted Design discussions and meetings to come out with appropriate data mart at the lowest level of grain for each of the dimensions involved.
- Conducted Design reviews with analyst and content developers to create POC for the reports.
- Evaluated Netezza features to leverage existing functionality and application performance.
- Collaborated with senior system Architects to pin down detailed solutions for specified requirements.
- Worked on POCs and prototyping activities to assess whether the proposed architecture and database components meet the non functional requirements like reliability, scalability, performance and maintenance.
- Participated in data modeling and database design. Performed database development tasks in Netezza. Modified Unix scripts for batch jobs
- Upgrades from Informatica version 9.1.0 to 9.6
- Uses Informatica Power Center 9.1 for extraction, loading and transformation (ETL) of data in the data warehouse.
- Debugging and validating the mappings and Involved in Code Review and Design Review.
- Implementation of CDC using Informatica variables.
- Implements Informatica recommendations, methodologies and best practices.
- Identifying data extract, transform, and load (ETL) strategies
- Worked with multiple programming teams to establish ETL programming constructs and standards
- Worked with users to develop effective data validation and correction processes
- Worked with senior IT and business management to develop a comprehensive data migration strategy.
- Implementations are populated slowly to change dimension to maintain current information and history information in dimension tables.
- Development of Oracle SQL scripts, SQL Plus, PL/SQL packages, procedure & functions to extend Oracle EBS functionality based on user requirements.
- Uses Informatica Power Center Workflow manager to create sessions and batches to run with logic embedded in the mappings.
- Worked with different data sources such as Oracle, DB2, Netezza and Flat Files.
- Worked with the technical team lead for direction/design and collaboratively with team developers, Architects, DBAs, Integrations Administrators and others to achieve cohesive, compliant software deliveries.
- Participate in Design and technical code reviews.
- Created test data and run code to support SIT and QA testing.
- Prepared Weekly Status Reports (PMO) and shared with the Managers.
- Production Support which involves solving user problems and Provided End User Training and Support.
- Prepared User documentation to train users and functionality of each report.
Data / ETL Architect
Responsibilities:
- Worked with administrators to Install and Configured Cognos 8 BI version 8.4 Suite in multi-server environment on Windows.
- Involved in Planning and implementation of Cognos 8 BI Suite.
- Worked jointly with the data management team members to understand data domains, values, cardinalities and other dimensions of data needed to support BI solutions.
- Creating and modifying MULTI LOADS for Informatica using UNIX and Loading data into EADW.
- Loading data from various data sources and legacy systems into Teradata production and development warehouse using BTEQ, FASTEXPORT, MULTI LOAD, FASTLOAD and Informatica.
- Working as an On-Site Lead for Warehouse including DBA activities that are Implementation of data and table-level security, setting up access rights and space rights for Teradata environment. Performance tuning, Monitoring and reporting Review system utilization by user
- Extracted Citi balance feeds and other data files using SSIS.
- Created Metadata Modeling by using multiple databases in Cognos 8 BI Modeling.
- Created Oracle PL / SQL Stored Procedures, Functions for use by Framework Manager Packages and Report Studio reports.
- Created Framework Manager Models including DMR and created IQD’s for Transformer.
BI Architect
Responsibilities:
- Gathered and analyzed the end-user business requirements.
- Analyzed Business requirements from the analysts.
- Informatica Designer tools were used moderately, to design the source definition, target definition and transformations to build mappings.
- Used Source Analyzer and Warehouse Designer to import the source and target database schemas and the mapping designer to map source to the target.
- Created database layer and business layer, defining appropriate relationship between query subjects in Framework Manager for Reports which involved multi-queries.
- Created several drill through reports including accessing between master and child reports (charts).
- Extensively used Power play Transformer to move relative data mart data into power cubes.
- Worked on Java Script for complex validation, navigation, communication and format customization.
- Performance tuning the by analyzing and comparing the turnaround times between SQL and Cognos.
- Created Scheduled Jobs by scheduling multiple reports in a job.
- Developed Dashboards and created Drill through reports from Dashboard to all summary reports and Summary to Detail reports.
- Scheduled the reports and busted reports according to user requirements in Cognos.
- Deployed Packages and Reports from DEV Environment to UAT and PROD Environments.
- Did Unit Testing for all reports and packages.
- Created user groups and roles in Cognos Connection and applied data level and group level security for various entries.
- Creating report views with saved prompts and schedule according to the business requirement.
- Personalized Cognos Connection, Specified display options, regional options and personal information.
- Resolved issues resulting from User Acceptance Testing (UAT).
- Extensively worked with all the new features in IBM information Server.
- Worked with SCD stage for implementing slowly changing dimensions. Extracts data from Flat Files and Oracle databases and applies business logic to load them in the central Oracle database.
- Develops map, reusable objects, transformation, and Mapplets using Mapping Designer, transformation developer and Mapplets Designer in Informatica PowerCenter 7.1.1/8.6.1.
- Upgrades from Informatica version 7.1.1 to 8.6.1.
- Creates reusable transformations and Mapplets and uses them in mappings.
- Uses Informatica Power Center 8.6.1./7.1.1 for extraction, loading and transformation (ETL) of data in the data warehouse.
- Works with data modelers to prepare logical and physical data models and adds and deletes necessary fields using Erwin.
- Implements Informatica recommendations, methodologies and best practices.
- Implementations are populated slowly to change dimension to maintain current information and history information in dimension tables.
- Uses Informatica Power Center Workflow manager to create sessions and batches to run with logic embedded in the mappings.
- Creates folders, users, repositories, and deployment group using Repository Manager
- Tuned Data Stage jobs for better performance by creating Data Stage Lookup files for staging the data and lookups.
- Used the Manager to import, export jobs and routines.
- Created Shared Containers to increase Object Code Reusability and to increase throughput of the system.
- Experience developing complex transformations, surrogate keys, routines, dimension tables and fact tables.
- Modeled metadata from SQL Server 2005 data source for use in Report studio and Query Studio using Framework Manager.
- Implemented Star Schema Grouping and Dimension Hierarchy in Framework Manager Model.
- Implemented Framework manager security for Data access, Object level access and Package access.
- Create IQDs (impromptu Query Definitions) using Framer work Manager.
- Developed List, cross tab, drill through, master-detail, chart and complex reports which involved Multiple Prompts, multi-query, Cubes in Report Studio, Burst Reports against database.
- Created custom templates and custom toolboxes for the use of reporting.
- Customized Cognos Connection with appropriate reports and security measures.
- Involved in Query Optimization, Creating Query Prompts, Developing Prompt pages and Conditional variables.
- Designed Power Play reports to provide summarized results by measures and dimensions.
- Created custom prompted reports in Report Studio, Bursting reports to different user groups.
- Published framework models and reports from development to QA and then Production servers.
- Exhaustive report analysis using Slice and dice / drill methods and by creating Master-detail reports.
- Actively involved in gathering end user Requirements, User / System Documentation, testing developed reports for final deployment.
- Coordinated and resolved Data Quality issues for smooth migration to production / maintenance of Reports and Models to different environments within the organization.
Confidential, Los Angeles, CA
Sr. BI Consultant
Responsibilities:
- Involved in gathering Business requirements for new models and Built models using Framework Manager.
- Updating the Framework Model when new metadata is imported.
- Created and published Packages using Framework Manager.
- Created Mix Reports with the selection criteria defaults by user role to help pre-select a subset of data that is most critical and most relevant for the users.
- Creating database connections for different data sources.
- Deploying Sample, Testing the Server and Managing Cognos Connection Portal.
- Identified facts and dimensions tables.
- Tuned sources, targets, mappings and sessions to improve the performance of data load.
- Wrote Teradata SQL queries according to process need.
- Used Teradata SQL assistant and manager for database.
- Generated reports using Teradata BTEQ.
- Creating and Managing Jobs and Schedules.
- Wrote BTEQ scripts to extract data.
- Consumed web service to retrieve user credentials from LDAP server.
- Designed dynamic SSIS packages to transfer data crossing different platforms, validate data and data clearing during transferring, and archived data files for different DBMS.
- Deployed SSIS packages and scheduled jobs.
- Established loading process using MLOAD, FLOAD, and BTEQ.
- Exported data using BTEQ and fast export.
- Created Simple and Complex Reports using Report Studio with multiple Charts and Reports on 1 page.
- Introduced Highlight exceptions and graphics, and drill-down reports to expedite analysis.
- Used Query Studio for Ad-hoc Reporting.
- Created new jobs using Cognos Connection.
- Bursting Reports and Multilingual Reports Using Report Studio and Query Studio.
- Deploying the packages (exporting and importing the packages) using the Deployment functionality under Cognos Connection Portal.
- Wrote SQL queries to populate different calculated columns in reports.
- Training Users on Query Studio for Ad-Hoc Reporting.
- Documenting the process.
Data Analyst / ETL Developer
Responsibilities:
- Performed data analysis on all results and prepare presentations for clients.
- Performed audit on data and resolve business related issues for customer.
- Coordinated with application teams and product management team and ensure accuracy on all
- Used transformations such as source qualifier, aggregator, expression, lookup, router, filter, update strategy, joiner, transaction control and stored procedure.
- Developed and tuned Informatica mappings and Mapplets for optimum performance, dependencies and batch design.
- Worked with Informatica source analyzer, warehouse designer, transformation developer, Mapplets Designer, Mapping Designer, repository manager, workflow manager, workflow monitor, repository server and Informatica server to load data from Flat Files, legacy data.
- Designed mappings between sources (external files and databases) to operational staging targets.
- Worked with pre and post sessions, and extracted data from transaction system into staging area.
- Created SSIS packages to migrate slowly changing dimensions.
- Implemented slowly changing dimension methodology.
- Created several Informatica mappings to populate data into dimensions and fact tables.
- Maintained bugs in the bug tracker tools based on their severity.
- Analyzed and tracked test result documents and bug reports using Quality Center 9.0.
- Developed Perl script to load data from Source to Target.
- Maintained versions of mappings, Mapplets, sessions, and workflows using StarTeam/Accurev.
- Worked with the team members to identify and resolve various Informatica and other database related issues.
- Designed and developed Oracle PL/SQL procedures and UNIX Shell Scripts, data import/export and data conversions.
- Optimized Oracle SQL queries.
