SUMMARY:

I am a well - rounded data engineer who has worked with many technologies. If a big data solution is needed using tools such as Hadoop, AWS, Redshift, Hive, Impala, etc., or an RDBMS solution is needed using SQL and ETL data pipelines, I will produce production ready results. My passion is in big data technologies and I am looking forward to continuing work in the field.

TECHNICAL SKILLS:

Big Data: AWS, Impala, Hive, Hadoop, Redshift

Languages: SQL, T-SQL, PL/SQL, Python, Linux Shell Scripting, Postgres

Database and Reporting Tools: SSMS, SSIS, SSAS, SSRS, SQL Server DTS, IBM DataStage, Cognos/IBM Data Manager SAP Business Warehouse, Oracle, Toad, SQL Plus, SQL Loader, Oracle Reports, Oracle Discoverer, Oracle Data Warehouse Builder, Crystal Reports, Crystal Enterprise Server, Business Objects Web Intelligence, DB2

PROFESSIONAL EXPERIENCE:

Confidential

Senior Data Warehouse Engineer

Responsibilities:

• Developed an automated process in Python to monitor data loads and row counts in SQL Server and send results to Data Dog
• Created big data infrastructure to load log data to S3 using Amazon Web Services (AWS)
• Created external Hive tables and loaded data using HQL
• Queried Hive tables using Impala and Hive
• Used AWS S3 for storage and pointed Hive tables to S3 location
• Created S3 folder structure to support partitioning of Hive tables
• Wrote stored procedures in TSQL to move data to S3
• Developed complex data pipelines to load log data to RDBMS
• Performed all tasks associated with moving data from AWS S3 to Redshift, i.e. Redshift table creation, Linux scripts to run Postgres copy command, and crontab to automate the process
• Write complex stored procedures from scratch in T-SQL for use in data warehouse loads, ad-hoc data pulls, and reports
• Automation of manual tasks using SSIS and SQL Agent jobs
• Develop and deploy reports in SSRS and create report subscriptions
• Monitor data warehouse loads and report subscriptions and fix if necessary
• Tune SQL queries using explain plans, indexes, and temporary tables
• Meet with business associates to discuss and clarify requirements.
• Import and export data through SSIS and SSMS
• Create tables and views as needed

Confidential

Data Warehouse Developer

Responsibilities:

• Work with team to develop best model for the warehouse using Kimball methodology
• Develop initial fact and dimension table ETL load packages in SSIS 2012 for new data warehouse
• Design and code the validation framework and packages for the data warehouse loads using SSMS and SSIS
• Extensive complex T-SQL query development including the use of merge statements to handle type 2 changes
• Create indexing on data warehouse tables as needed
• Write and tune stored procedures to provide data for Cognos reporting team
• Document processes associated with loading the data warehouse and validating the data warehouse
• Collaborate with fellow developers on best practices and share lessons learned

Confidential

Business Intelligence Developer

Responsibilities:

• Perform new development and support for the Quality data warehouse using the Microsoft tool set
• Participated in the development of the data model for the Quality data warehouse using the Kimball method
• Responsible for new development and support of the ODS using Microsoft tool set
• Perform the ETL tasks associated with the Business Intelligence team
• Write stored procedures, functions, and triggers as needed using T-SQL
• Upgrade DTS packages to SSIS as needed
• Development of DataStage packages to automate SAP data pulls
• Manage work requests through Remedy
• Assist team members by performing code reviews and data reviews
• Provide mentoring to team members in my area of expertise (ETL)
• Help team with reporting tasks when help is needed
• Gather business requirements and clarify when unclear
• Provide data per FDA guidelines and requirements associated with the medical device industry

Confidential

Data Warehouse ETL Developer

Responsibilities:

• Responsible for the extraction, the transformation, and the loading of school districts data into a complex data warehouse
• Complete production loads on a rotating schedule
• Perform data loads and updates on very large data sets
• Created the date dimension that includes three different date views from scratch
• Write stored procedures, functions, and triggers as needed using PL/SQL
• Create simple applications in Oracle Apex, specifically to update the date dimension
• Work production tickets through Footprints
• Design, develop, and maintain Data Manager packages
• Develop Pentaho Kettle packages
• Write ANSI SQL to develop complex transformations and derivations
• Implement new school districts as needed
• Ongoing Assessment (TAKS) modeling and development that involved changing requirements on an annual basis
• Assist in minor Cognos report development when needed
• Responsible for logging errors into an ETL event log table
• Optimization of large DML operations by using bulk fetching and loading, and create as select
• Perform code review on a periodic basis
• Write test cases for new development

Confidential

Report Developer

Responsibilities:

• Report Development in SSRS
• Development of stored procedures to provide data for reports
• Held weekly report consumer call to help with super user report development
• Worked reporting related tickets

Confidential, TX

Report Developer III

Responsibilities:

• Responsible for the design, development, deployment, and support of reports using Crystal Reports 10, Crystal

Enterprise Server 10, Business Objects Web Intelligence, and SQL Server Reporting Services

• Developed reports in a regulated environment to verify Sarbanes-Oxley compliance
• Code T-SQL procedures and SQL views to use as data sources for complex reports
• Develop and support system processes related to reporting using SQL Server DTS and SQL Server Agent Jobs
• Follow SDLC methodology and change management procedures using Visual Source Safe and SharePoint
• Participate in testing and quality assurance functions by performing unit testing and creating test cases
• Manage code bug fixes using Mercury Test Director
• Establish standards to ensure consistent look and feel across reporting
• Create and maintain departmental procedures
• Communicate concisely with management and operations through email, meetings, and the company website
• Focus on designing, developing, and deploying high quality work products encompassing all aspects of reporting (appearance, data accuracy, business needs, IT standards, etc.)