Big Data/dw/bi Architect Resume
Carmel, IN
SUMMARY:
I work with clients to define their data needs, gather requirements, model and deliver data warehouse and Big Data solutions, perform ETL activities, and deliver metadata and end user reporting through multiple BI tools.
TECHNOLOGIES:
Data Technologies: Cloudera Hadoop, Amazon Redshift, Azure Synapse,, Azure Data Lake v2Oracle, MS SQL Server, DB2
Business Intelligence: Tableau, Looker, Microsoft, Cognos, Oracle
ETL: SSIS, Informatica, Azure Data Factory, SAS DI
Other related skills: SQL, PL/SQL, Impala, Hive, UNIX, Sqoop, Oozie
EMPLOYMENT:
Big Data/DW/BI Architect
Confidential, Carmel, IN
Responsibilities:
- Data Architecture (Big Data architectures, Data Hub, Solution architecture, Azure Synapse, Azure Data Lake Storage, SAS Data Integration Studio)
- I was brought in to help CNO with a large regulatory project (Long Duration Targeted Improvements ) for their Actuarial department.
- The process changes require a comprehensive data strategy for this business area and I am working to socialize, design and implement a cloud data hub.
- The data hub will provide a solution where raw data can be ingested and used by multiple processes, Extract - Load-Transform engines can feed timely data to time-sensitive applications and finally a business intelligence platform that has access to all of the data for a complete view to be used for regulatory, standard, and ad hoc reporting as well as for audit and reconciliation purposes.
- I work with the Systems Analysts who are gathering data inputs to refine their collection efforts.
- I consult with the business users to understand their needs in not only what data they consume but what they will produce. In partnership with the data and solution architecture teams, I am building an understanding of the best solution for the data hub, as well as working with vendors for the Actuarial and Accounting software to cover integration of those components from a data and infrastructure perspective.
Confidential, Indianapolis, IN
Enterprise Data Architect
Responsibilities:
- Established the project goals in collaboration with the business partners.
- Worked with Software Engineers to enable data ingestion and Data Scientists for data retrieval and processing.
- Designed and developed the Cloudera solution to model data, ensure data flows, implement security, and serve data needs of data scientists and application developers.
- Reduced data processing from over 30 hours down to 10 minutes for certain pipelines.
- One process that had taken 4 days was cut to under 2 hours.
- Enabled a previously unavailable pipeline for sequence data that saved.
- Evaluated data platforms for client's next generation business integration needs.
- Designed and developed a proof of concept using Amazon Redshift with Talend.
Confidential, Carmel, IN
Responsibilities:
- Data warehouse modeling (Oracle and SQL Server); Business Intelligence (SSRS, Cognos 8); ETL (SSIS, Oracle Warehouse Builder)
- Developed data warehouse Architecture for new structures and processes to change the source system for the Confidential data warehouse from an Oracle source to a Microsoft CRM source. Developed the new processes in SSIS to move the client away from Oracle Warehouse Builder.
- Developed views and tables to support new reporting requirements.
- Created SSRS reports, Cognos 8 reports, and Transformer cubes with appropriate delivery solutions (bursting, portal views, etc.) for the audience of the objects.
- Data Migration Architecture; Infor (Lawson) M3 ERP Implementation (SmartData Tool, Data Import)
- Designed a migration strategy and detailed plans for moving the client from an existing iSeries platform to Infor M3 Supply Chain, Manufacturing, Customer Service/Sales, and Financials. Configured a Windows server as an intermediate platform with Oracle XE, Pentaho Data Integration to serve as the migration platform.
- Set up and maintained Lawson SmartData Tool and M3 Data Import, as well as documented a plan on when to use each, working with APIs and Lawson Web Services as appropriate.
- Worked with ERP core team members to turn requirements into code maps and a conversion path.
Confidential, Indianapolis, IN
Responsibilities:
- Designed a multi-fact data warehouse in Oracle with conformed dimensions to accommodate most of the Confidential Eligibility BI needs.
- Developed ETL mapping spreadsheets for the client to use to load the data.
- Documented the DW approach and ETL workflow strategy for the client’s use in carrying forward with the design.
- The client was using data dumps from transactional systems to create Excel spreadsheets with graphs and pivots to report data, executed by a director-level resource.
Principal Big Data Architect
Confidential, Carmel, IN
Responsibilities:
- I was brought in to do platform selection on a next generation data platform, settling on Cloudera.
- Worked with a vendor to set up and configure the platform and begin initial development.
- Managed multiple development paths to “fill the lake” with historical transaction data at the same time as supporting next generation data delivery efforts via a new responsive web application. Model existing data warehouse data appropriately for Cloudera (Parquet partitioning) and perform data engineering tasks to incrementally load data for the next gen app (Sqoop/Impala/Oozie).
Sr. Data Architect
Confidential, Indianapolis, IN
Responsibilities:
- Redesign and replatform the Amazon Redshift Data Warehouse into Hadoop.
- The access points for data are Parquet stored partitioned data via Impala SQL.
- Storing the data this way also allows for Search, Machine Learning and Artificial Intelligence on the same data sets.
- In the interim until the new Data Warehouse is stood up, maintain the existing Redshift database.
- Performed tuning and tweaks to allow for optimization of sizing saving over 2 months of having to scale up the cluster while still reducing load times by as much as 33%.
Business Intelligence/Data Warehouse Architect
Confidential
Responsibilities:
- Executive Dashboarding, Metrics, and Cognos Reporting
- Created custom dashboards and scorecards for executives to have insight into the performance of the entire DFAS organization.
- In addition, developed manager level hierarchical reporting (on organization levels and time) using Cognos 8 Report Studio.
- For existing reports, increased performance from nearly 2 minutes down to 20 seconds utilizing Oracle materialized views and streamlining the report objects.
- Enhanced several current reports with additional runtime choices and detailed drill throughs.