Consultant, Nj
SUMMARY
- 15 years experience designing ETL frameworks and data models in several different configurations. Multiple years experience with Ab Initio, Informatica and Datastage.
- Proven leadership and mentoring skills. A dedicated team builder and motivator, with a proven track record of project success, especially employing Agile scrum/sprint methodology
- Strong communicator with the ability to listen, understand and ask questions to drive specifications.
- 8 years experience in Sql Server Data and ETL Architecture (SSIS, SSRS, DTS, SSIS, VB .NET)
- 10 years experience in Oracle Database architecture, tuning, hints, stored procedure development and testing, replication (Active Passive, Dual Active ), RAC, 11x and 12c
- Able to appropriately assess technical and resource options to logically solution through project challenges, both expected and unexpected.
- Depth of experience: Have architected and supported varied departments (R&D, Sales & Marketing, Supply Chain, CRM, HR and Finance) and verticals (Health Care, Insurance, Software, Multi - channel Retail, Entertainment, Finance and Public Utilities)
TECHNICAL SKILLS
Software: SPSS, ElasticSearch, SAP Data Services, Oracle OBIEE, Ab Initio 2.13 thru 3.0 (latest prod system was CO>OP 2.16, GDE 1.16, EME 2.16, Data Profiler 2.16, Conduct>It), Oracle 10/11g RAC, UDB/DB2, ERWIN, SQL, PL/SQL, Peopletools, Pentaho ETL, MicroStrategy, DB2/SQL, Oracle/SQL, COBOL, AS400 utilities, Unix KSH scripting, Perl scripting, Ruby on Rails, Control-M, Tidal Job Scheduler, Maestro, Informatica Powercenter 7/8, IBM Information Server Suite (datastage, quality stage, business glossary, information analyzer, IDA), Hudson, Jira, Maven, Cognos 8.4 Report and Powerplay Studio, Business Objects, Trillium MDM, Oracle Forms (now OBIEE), SSIS, SPSS, SAS, MS Project and Excel.
Scripting/Languages/Architectures: Java, Python, shell scripting (javascript, perl, ksh, bash, awk), Ruby, javascript, Ajax, ant, C++, PL/SQL, TSQL, SQL, Ruby, RoR, Pig, Hive, NoSQL. MongoDb, Cassandra,, Map/Reduce, HBASE, Flume, Kafka, Avro, HDFS, Maven, JIRA, Agile, R, Spark, Mahout
Hardware and Database: IBM AIX 5L, Linux, Netezza, Teradata V2R6 12,13.x,14.0, Sun Solaris, AS400, SCO UNIX, IBM MF, SQL Server 2000 - 2008 (SSIS,SSRS, SSAS), Oracle 7/8/9/10/11, IBM DB2 for OS390/ZOS, IBM DB2 EE, MySQL, Redhat Linux, 30 node HDFS, VLDB (1 Petabyte)
PROFESSIONAL EXPERIENCE
Confidential
Consultant
Responsibilities:
- As CEO of Dabney Solutions, me provide IT, networking and Business Intelligence solutions for small business owners in the San Diego area. Billed $72,000 in services in 2015.
Confidential
EDW Solution Architect
Responsibilities:
- As TEMPprincipal architect for Data Science, me have designed, modeled and managed changes for a 35TB Enterprise Data Warehouse, consisting of 18 separate production databases.
- Designed, developed and tuned stored procedures to support data migration between Teradata, Oracle and mysql data marts.
- Generated technical specifications to support data migration between systems, including data mapping, data profiling and test plan generation.
- Managed 8 member team charged with developing batch MapR jobs to ingest enterprise data into a 50 node HDFS. Utilized Drill, as well as engated in limited RESTful java web service development (SPRING).
- Supported predictive analytics teams using SPSS and Revolution R.
Confidential
Solution Architect
Responsibilities:
- Architected Dimensional data presentation layers (Facts & Dimensions), consuming data from 2650 Appliance TD system with 3NF base tables (from Industry LDM), for use in OBIEE dashboards and reports. Primary architecture is OLAP.
- Developed, tested and supervised all of the following… Data modeling, ETL design, Query design, Data Optimization for Reporting applications (OBIEE, Microstrategy), Capacity Planning, Scripting Fastload, Multiload, TPump and BTEQ ETL, Stored Procedure development and tuning, ArcMain Backup Scripting, Security Administration in Teradata.
- Recovered a Red project inherited from previous architect, and provided superior services, which enabled Teradata to keep Livenation as a client. Livenation were so impressed with level of service, they negotiated with Teradata to have me converted from consultant to permanent employee.
Confidential
Managing EDW Architect
Responsibilities:
- Constructed and managed a 3 year BI readiness roadmap with the goal of upgrading existing Sql Server 2000 Data Marts into a Netezza Enterprise Data Warehouse (Twinfin 3), with IBM Datastage ETL and Cognos 10 BI reporting.
- Involved in extensive vendor selection process, including crafting RFPs, and evaluating responses to RFP.
- Interviewed and ultimately hired team to support existing Cognos 8.4 BI solution. Managed 4 direct reports (2 offshore, 2 onshore) with an annual budget of $500,000.
- Designed Cognos PowerPlay Cubes for use in Finance (Budget vs Actuals) and Operations (comparing Estimated collections to Actual collections)
- Produced reports using Cognos 8.4 Report Studio and Analysis Studio, as well as dashboards using Go Dashboarding product, and scorecards using Metric Studio.
- Designed and implemented ETL in SSIS and IBM Infosphere (Datastage)
- Supported ETL jobs developed in Cognos Data Manager.
- Supported Finance and Accounting users of Cognos Enterprise Planning 8.4.
Confidential, NJ
Managing Consultant
Responsibilities:
- Responsible for Global Statement Delivery enhancement project, and the integration of Citi’s Data Warehouse and BI framework for use by Barclay’s bank.
- Migratied Ab Initio 2.15 to 3.0.
- Client (Oncor Energy - Dallas, TX)
- Led Data Management team, tasked with architecture of a Data Warehouse and Reporting solution for Automated Metering Systems (AMS) within Oncor.
- Reporting on Meter Usage, Metering Services and Billing.Lead Developer/SME for offshore ETL development team, working in Informatica Powercenter 8.
- Target system was Informix.
- Architected and developed solution to populate Time Series (and Virtual Tables) for metering data.
- Lead EDW project team tasked with modeling and ETL mapping of Sales and Pricing Subject areas, the foundation of Republic Services EDW.
- Installed, Configured and Implemented IBM Infosphere stack for ETL and capturing changes from AS400 into SQL Server 2008.
- Converted SSIS jobs into DataStage jobs. Constructed Data mappings, mentored offshore developers, developed Datastage templates and record formats.
Confidential
Technical Consultant
Responsibilities:
- Built a Pentaho ETL framework from the ground up, which served as an Open Source replacement for Ab Initio ETL with a reduced SLA. dis afforded Comcast the flexibility of moving from 2 ETL servers down to 1, which served to reduce licensing costs by approximately $250,000 per year.
- Managed a staff of 6 developers and 2 QA staff, charged with the re-architecture of Comcast’s Third-party Billing Extracts (2TBs of data) from Ab Initio into Pentaho.
- Extensive reverse-engineering required for Ab Initio graphs going back to release 2.13. Obtained 83% of the original graph performance in a Pentaho KETL framework.
- In order to achieve these performance metrics, a hybrid solution was adopted which wrapped high performing C++ sorting and data extraction algorithms with KETL.
- Spearheaded adoption of Jira and Subversion for release management and version control.
Confidential
Senior Software Engineer
Responsibilities:
- Primary responsibilities were ETL and Data Services (Ab Initio 2.15, Teradata V2R12) to funnel operational data into Enterprise Data Warehouse. Reported directly to Director of Business Intelligence.
- Employed Ab Initio and Teradata best practices and constructed reusable components that became the foundation of the ETL architecture.
- Responsible for driving requirements, data modeling, application design, development and testing.
- Rearchitected Oracle EDW and ODS into Teradata (converting Dimensional models to 3NF).
- Implemented a Tidal Scheduling Software solution to replace cron jobs, performed job scheduling analysis by determining job dependencies, in conjunction with resource contention and SLA requirement.
- Prototyped ETL solution for Instant Watch weblog data into a Hadoop File System. Ramped up on map/reduce as an alternate approach to traditional ETL. Pilot me started TEMPhas since been productionalized.
- Extensive prototyping in python for Apache/CloudEra stack for messaging, management of log data and research into noSQL technologies for sparsely populated VL data (>Petabyte).
Confidential, CA
Technical Consultant
Responsibilities:
- Defined and implemented the discipline of release management across the department’s distinct application development tracks. Implemented software configuration management methods and tools.
- Engineered ETL unit-test framework, version control and development best practices for Ab Initio 2.15 Implemented release management wiki for documentation of all associated processes.
- Created multi-stage release environment (dev, qa, integration, production, etc.).
- Recommended and implemented Subversion version control tool and best practices.
- Designed and automated continuous integration release process and created release and packaging tools.
- Recommended and implemented issue-tracking and triage methodology and Jira issue-tracking tool.
- Provided a data profile of all key source system data (AS/400, Oracle and flat file) using Trillium MDM solution.
- Designed dimensionally modeled LDM and PDM.
- Implemented multiple aggregate tables in Teradata, and materialized views in oracle.
- Architected, implemented and trained staff on Subversion version control solution for ETL development. Instituted policies and workflow for team issue/defect tracking. Communication with Teradata Services technical resources and project managers. Supported BI needs of Marketing systems users via use of Microstragey 8 Platform and SAS.
- Extensive experience building requirements documentation for developers from meetings with business users, thus acting as a business analyst.
- Expert python, perl and ksh scripter, for use in Ab Initio, Oracle PL/SQL, SAS Robust ETL and Teradata TTU (BTEQ, Fastload, MultiLoad). Provided strong documentation fundamentals to the development team, and encouraged the use of collaborative software such as Microsoft Sharepoint. Led the charge in leveraging the use of dis software as a metadata repository, Production support tool and noledge base.
Confidential, CA
ETL Consultant
Responsibilities:
- Converted in-house Oracle Forms Inventory Management and Supply Chain solution. Implemented Servigistics software package, Cognos Power Play and Ab Initio ETL platform.
- Architected, developed and unit tested first implementation of BRE (Business Rules Engine) for client.
- Developed custom, re-usable functions for deposit into meta-data repository and use in ETL transformations.
- Constructed supply chain management ETL scripts using perl (DBMS mods) and constructed Oracle Forms for data entry.
Confidential, MN
Senior Data Migration Analyst
Responsibilities:
- Mentor and technical lead for team of 6 developers and 2 Testers. Versed in all areas relating to Data Migration technology.
- Led the migration from a multi-toolset system comprised of ETI extract, BMC Change Data Capture (now Informatica) and PL/SQL to Ab Initio 2.12 (later 2.13).
- TEMPPrincipal data architect of Claims Subject area of BCBSMN’s enterprise Data Warehouse and Claims ODS.
- Responsible for definition of ETL cleansing, validation, and transformation logic, key generalization, and database bulk-loading optimization.
- Technical design, development, and optimization of a 2+ terabyte Oracle ODS and 6+ terabyte DB2EEE data warehouse.
- Designed database aggregation, partitioning, and indexing strategies; re-engineered Ab Initio technical architecture for optimum ETL performance.
- Implemented data quality and control initiatives: added data sampling and validation controls for all incoming data; created processes to extract statistically significant test datasets from the production warehouse to aid in application testing and quality assurance.
- Formalized and implemented development environment, coding, testing, version control, and bug-tracking procedures for team of 10 developers.
- Used Cognos Series 7 (Power Play, Visualizer, ReportNet) to halp develop OLAP cubes for analytic reports.
- Coordinated with membership and claims SMEs to devise test plan and evaluate the TEMPeffectiveness of our Data Warehouse and recommend enhancements.
Confidential
Software Engineer
Responsibilities:
- Transitioned to Baylogics software engineering team after spending time in client services.
- Traveled extensively to client sites to conduct user training and script conversions of source data into Foxpro .dbfs.
- Developed extract, transform, load (ETL) scripts in PL/SQL and UNIX ksh.
- Developed robust, fault-tolerant ETL scheduling, monitoring, synchronization, and restart processes. Implemented ETL auditing and meta-data reconciliation procedures and reports.
- Working with Java developers, was introduced to Extreme Programming and test-driven development; Applied both to the data warehouse application development lifecycle.
- Constructed template-based and ad hoc OLAP query tools and application report templates within a web-based UI architecture utilizing Oracle’s Express server.
- Installed, configured, and administered Oracle and MySQL databases, Oracle Express Server, Oracle Reports Server on Windows, Solaris, and Linux platforms.