SUMMARY:

• I am looking for an opportunity to work in a leadership and architecture role designing and driving the development of cloud platforms using streaming, AWS services, python, bash, java, ETL and disaster recovery design options.
• I have significant experience working with AWS infrastructure, ETL, python, bash, microservices, serverless code, performance optimization best practices, and leading teams.
• I have designed ETL and orchestration frameworks for massive big data processing to platforms like Netezza, SQL Server and Redshift.
• I have lead development teams in hybrid onshore/offshore models for major clients .

LEADERSHIP SKILLS:

• Team building and management
• Facilitating Discovery/JAD Sessions
• Product/solution design and development based on target market needs

TECHNICAL SKILLS:

• Bash
• Netezza
• Postgres
• AWS
• EC2
• S3
• Cloudwatch
• Redshift
• Lambda
• Cloudformation
• Step functions
• Cloudtrail
• AWS API
• Kinesis
• CodeStar
• IAM
• Dynamo
• SES
• Glacier
• Redshift Spectrum
• Athena
• EMR
• Python
• Pyspark
• ETL
• Data Warehousing
• Performance Optimization including statistics, execution plans, and query tuning
• Partitioning and Partition Aligned Indexing
• SQL CLR

PREVIOUS EMPLOYMENT:

Confidential

AWS Enterprise Architect

Responsibilities:

• Designed complete AWS environment, including subnets, routing tables, nacl’s, security group design, at rest encryption, Confidential and Cloudformation
• Designed data ingestion process, including lambdas, step functions, bash scripts and Talend API integration
• Create architectural diagrams to communicate design and seek security approvals
• Designed and implemented custom schedules, including lambdas, step functions, cloudwatch, restartability, error handling, rejected record handling using Dynamo DB/Mongo for control logic/schedule storage
• Implemented AWS security model (IAM/S3 policies, users, groups, roles)
• Configured VPN/VPG connectivity with Palo Alto Networks
• Created highly customizable Cloudformation templates that can be reused for various environments, applications and AMI’s
• Setup and configuration of AWS based RDS Gateway with Duo MFA and AWS Samba Directory Service
• Implemented infrastructure change request process
• Implemented automated Confidential promotion process using AWS CodeStar project (CodePipeline, CodeBuild, CodeCommit, etc)
• Created Kinesis sources/streams using Cloudwatch logs to stream logging data to Redshift, using python lambdas for real record transformation and s3 for intermediate storage
• Implemented a disaster recovery model that included S3 replication, multiple availability zones, auto scaling groups, versioning, Cloudformation and python code
• Designed EMR/Hadoop/Spark process to convert files to parquet and query on s3 using Athena, SQS and Redshift Spectrum

Confidential

ETL Developer

Responsibilities:

• Created custom schedule orchestration using python and Cloudwatch
• Automated start and stop of EC2 instances using Cloudwatch
• Developed reusable Redshift SQL by reading system views to perform CDC operations
• Performance optimized Redshift tables and SQL

Confidential

Netezza Data Architect

Responsibilities:

• Implemented process for coordinating ongoing data loads for continued ETL testing throughout development projects
• Lead a team of engineers responsible for managing a home grown ETL framework in Netezza
• Lead the design of a custom ETL framework written in bash, python, java and sql responsible for data ingestion, loading and ETL in a Linux/Netezza environment of hundreds of files in formats including JSON, excel, Cobol, XML and others
• Intermittently managed QA defect resolution by coordinating between on shore and offshore teams via JIRA tickets
• Implemented reusable, parameter driven CDC ETL tools in bash and python that dynamically create CDC code in SQL using RDBMS metadata views
• Implemented multi threaded orchestration engine in python for processing various jobs within the linux environment, from file movement to SQL and Informatica execution
• Implemented a python/paramiko messaging architecture to connect an unlimited number of front end administrative GUI’s to a home grown ETL framework as queue subscribers

Confidential

DW Architect

Responsibilities:

• Contributed to how the data models would be designed and participated in identifying the implications of different granularities in the model
• Designed the ETL, logging, error handling, notifications, staging of data, transformation and delta detection, and final processing to a target EDW Kimball project model, most often with Microsoft technologies such as SSIS and SSRS, but sometimes with technologies with Microstrategy and Informatica
• Recruited and managed development teams that included a diversity of resources from software architects to BI developers and infrastructure/systems resources, both off shore and on shore
• Wrote highly complex SQL to populate dimensions and fact tables in data warehouses and in ODS systems
• Designed a significant number of SSIS packages to load data warehouses, including logging, SCD transformations, script tasks using C#, and looping in the control flow to process complex datasets
• Drafted detailed milestone documentation to communicate to the client
• Communicated with the management on the client side when there were issues
• Performance tuned the SQL code, partitioning, indexes, and the model to meet the needs of the client

Confidential

SQL Developer

Responsibilities:

• Reduced several month end T - SQL stored procedure processes by several hours, through code optimization, transaction control, execution plan and dmv analysis
• Introduced new processes to manage and monitor server and job performance
• Lead team collaboration and problem resolution with over 20 people during triage situations
• Successfully implemented partitioning for data management, using a sliding window
• Lead the development and management of an Informatica ETL process with over 80 workflows
• Managed the scheduling of the ETL jobs using Autosys
• Introduced efficiencies and resolved design flaws that reduced monthly job execution from 1 week to 4 hours
• Designed and implemented a partitioning strategy that saved several hours in daily and monthly job processing time, and increased the efficiency of the reporting from taking over 90 minutes to process one report down to less than 5 minutes
• Designed a reconciliation process to reconcile several billion row fact tables with a source AS400 SOR
• Managed estimating timelines, milestones, and completion dates for projects
• Interacted directly with the line of business to maintain communication regarding project deadlines, business needs, issues and data reconciliation for a system ranging in size from 5-10 terabytes.

Confidential

Database Administrator

Responsibilities:

• Developed new ETL processes, implementing SSIS as the administration piece.
• DBA duties included security, encryption and backups
• Began development of performance monitoring dashboards for various sql server instances
• Redesigned and started implementation of a relational hierarchical model for the Confidential HIS data dictionary
• Optimized performance on existing and new servers for existing and new product lines.
• Maintained overall health of servers and made suggestions for ways to improve server architecture.
• Optimized multiple SQL Server instances using SQL Profiler, Database Engine Tuning Advisor, DMV s and PerfMon

Confidential

SQL Developer

Responsibilities:

• Maintained ETL processes and debugged any known issues
• Examined ETL processes for possibly performance improvements as well as possible mistakes in logic
• Provided suggestions for ways to improve the overall data warehouse infrastructure through improved data models, improved ETL’s, or newer technologies
• Researched and resolved data anomalies previously unresolvable

Confidential

ETL/SQL Developer

Responsibilities:

• Implemented maintained SSRS Reporting infrastructure to work seamlessly with pre-existing ETLs and systems
• Created SQL CLR/SSIS process to handle all logging, precedence validation, automatic restarting, email notifications, and several other administrative tasks associated with jobs, packages, and reports that need to run on the server
• Lead the Business Intelligence initiative from a architecture, design, development, and implementation perspective within the Healthcare Economics division
• Implemented processes to automate many previously manual reports, ETLs, and data warehouse functions
• Developed custom CLR stored procedures for automation and error management of SSIS package logs, SQL Server jobs, report schedules, and other miscellaneous data warehouse functions
• Rebuilt several very complex ETLs to provide for automation and various performance improvements
• Managed maintenance of index creation and other basic performance features to improve data warehouse performance
• Created process to automatically loop through all databases on production servers, back them up to a network path, and then immediately restore said backups to a dev box for dev purposes
• Converted DTS packages to SSIS and optimized their performance

Confidential

Business Intelligence/Operations

Responsibilities:

• Implemented SSRS organizational policies to meet the needs of all departments in the company.
• Communicated on multiple projects between approximately 30 people simultaneously
• Developed custom dashboards streaming real time analytical data for performance monitoring
• Developed database structures and systems to allow for SSAS implementation and data warehousing
• Developed ETL farm for harvesting 2005 production environment and XML data types via XPath and reconciling with 2008 warehouse ready environment
• Experience manipulating data inside packages and then loading into SQL Server
• Frequently developed indexes to improve server performance
• Wrote service to iterate through registered servers using SMOApplication object and back up servers every 48 hours
• Implemented complex packages via SSIS to harvest data from a variety of structures into SQL Server 2008 environment
• Contributed in the initial and ongoing development of MOLAP Data Warehouse environment through the design of dimensions, data source views, and cubes
• Coordinated and successfully managed and completed multiple projects simultaneously
• Collected diverse statistical data elements for the purpose of workflow analysis and process improvement for customer service and implemented changes.
• Distributed reports to all levels of management for collaborative analytical purposes
• Identified key technology needs within the company and worked closely with the B.I. team to satisfy those needs through ASP.NET development, database development, Web Services development, data warehouse development and business process changes.
• Developed custom C# ASP.NET applications for process monitoring and internal operations
• Designed systems for moving data from a variety of formats via ETL’s to SQL Server 2005 for the purposes of SSAS implementation
• Developed custom reports in SSRS for different business units within the organization
• Implemented reporting solutions via VBA in Excel, Outlook, and Access 2007