Tech Lead/senior Data Engineer Resume
SUMMARY
- To move into a new role as a Senior Data Engineer, utilizing experience in data analytics through a sophisticated and creative application of a variety of emerging technical data analytics technologies as well as my business experience and education.
- I have been at Confidential for the past nine years surviving in a variety of roles.
- Currently I am supporting a Hadoop - based application that incorporates shell scripting, Hive-SQL, and pySpark scripts to ingest large data sets and processes that data for a variety of downstream applications.
- That data is provided to downstream consumers in customized tables as well as XML.
- My role has included launching code to ingest data for new lines of business, stabilizing existing code, and creating new code as we prepare for migration to the cloud (AWS).
- Other roles included developing sophisticated SQL queries to ingest customer data from around company into a central repository to support digital marketing activities.
- Additionally, I have severed in roles providing analytical and coding support.
- That work included migrating new data as well as to resolving complex data issues.
- I also served as the lead developer in the creation of a reporting solution to directly leverage the data in our operational all data store for reporting in near-real-time.
- I am a life-long learner. In the past year I have learned to create interactive data visualizations using Tableau and to perform detailed data analysis and visualization using the language R.
- Additionally, I have continued my learning in the big data space but pursuing training in Python, pySpark, Hive and Hadoop.
- I continue to seek new challenges and I am very excited to work at Confidential at a time when data has become so central to our success
- I believe that my education, my experience, and my desire to find the best solutions to meet our data needs makes me uniquely qualified for this position.
TECHNICAL SKILLS
Languages: Java, C#, R, Python, Spark, pySpark, Unix Shell Scripting, VB.NET, VB 6.0, VBA, XML, ANT, JavaScript, CSS, HTML, jQuery, jQuery Tools, C++, PERL, PHP, VB Script, Classic ASP
Database Development: Hive, Hadoop, Beeswax, SAS SQL, Oracle Database 12c, Oracle PL SQL, MongoDB, MS SQL Studio, MS SQL Reporting Services, Transactional-SQL, MySQL, MS Access, Red Gate SQL Developer Bundle
Web Technologies: WebLogic, MS IIS, AJAX, Web Services, Web Applications, Microsoft SQL Reporting Services (SSRS), Telerik, Reporting, PolicyCenter, E-Commerce Solutions, Web-Based Payment, Processing ( Confidential ), Message Boards, PGP Data Encryption
SAS SAS Enterprise Miner SAS Enterprise Guide:
Application Development: Eclipse, Microsoft Visual Studio 2008 and 2010, XCode, VB 6, Access and Excel
Reporting: Tableau, Microsoft SQL Reporting Services (SSRS), Telerik Reporting
Web Development: MS Visual Studio 2010, Dream Weaver, BBEdit
Test Driven Development: NUnit 2.6
PROFESSIONAL EXPERIENCE
Confidential
Tech Lead/Senior Data Engineer
Responsibilities:
- Support data ingestion, using shell and pySpark scripts, into a Hadoop Database.
- Support includes production support as well as creation of code to ingest data for new lines of business.
- Re-engineered data ingestion pipeline reducing the amount of code to manage.
- Developed complex shell scripts to support the deployment and implementation of updated Hadoop/Hive tables and application functionality.
- Developed complex SQL scripts to not only ingest customer data into the Customer Hub, but to make that data available to make that data available to end users by creating custom extracts.
- Developed PL/SQL solutions to resolve issues with data in Operational Data Store Created a library of reusable types, functions, and procedures provide for developers to be implemented into all new scripts to help ensure script reliability and improve data reliability.
- Helped develop the data ingestion infrastructure for business-facing tool to allow for the quick delivery of customized data Wrote complex queries and stored procedures using PL/SQL for Oracle as well as T-SQL in SQL Server 2005.
- Developed prototypes using new or expanding on existing technologies.
- Worked as part of an Agile development team.
Environment: Oracle databases, Hadoop, Hive, Hive SQL, Spark, pySpark, Python, Unix Shell Scripting, PL/SQL, MS SQL Server 2005, MS Access, MS Excel, MS SQL Reporting Services, Stored Procedures (T-SQL), Telerik ASP .NET Web Controls, Java, WebLogic, C#, Gosu, Eclipse, jQuery, jQuery Tools, JavaScript, Infragistics ASP .NET Web Controls, VB .NET, AJAX, Cascading Style Sheets (CSS), Photoshop, MS Visual Studio 2008, Subversion Source Control, Red Gate SQL Developer Bundle, SSMS SQL Tools, NUnit, MS Word
Confidential
Contract Application Developer
Responsibilities:
- Application Developer Provided application support and bug fixes for production application using Classic ASP web pages, ActiveX controls and an IBM UniVerse database.
- Created and setup virtual servers for testing.
- Worked as part of an Agile development team.
- Developed project requirements to support project development and updates.
Confidential
Application Developer
Responsibilities:
- Web Application Developer, Team Lead Wrote queries and stored procedures using T-SQL in SQL Server 2005/2008. Developed user interfaces from wire-frames to production.
- Researched and implemented an enterprise-wide ecommerce solution.
- Developed a subscription-based online Law Library application.
- Developed customized reports and stored procedures using Telerik Reporting and MS SSRS for accounting to reconcile online purchases.
- Developed project requirements to support project development and updates.
Confidential, Wethersfield, Connecticut
Contract Senior Web Programmer, Project Manager
Responsibilities:
- Web Application Developer, Project Manager Redeployed an online lobbyist registration and reporting tool for the Connecticut Office of State Ethics meeting all project and regulatory deadlines.
- Implemented a health assessment for the Connecticut Department of Health utilizing MS SQL 2005 and VB .NET.
- Responsible for requirements gathering, design and development of database, administrator interfaces, web forms and SQL queries.
- Migrated Crystal Reports to MS SQL Reporting Services
- Served as developer and project manager on projects with varied requirements.
Environment: ASP.NET, VB .NET, Classic ASP, HTML, JavaScript, Confidential Confidential Pro, Windows 2003, SQL Server 2005, MS SQL Reporting Services, Stored Procedures (T-SQL), SQL Server 2005 Reporting Services, Crystal Reports, Laserfiche Document Management System, SOAP, XML, Flash, ASPEncrypt, IIS, Cascading Style Sheets (CSS), Excel, VBA, DSF Web Portal Manager, BaseCamp Web-Based Project Management
Confidential, Newington, Connecticut
Senior Programmer/Systems Analyst
Responsibilities:
- Application Developer, Project Manager Developed custom applications to support custom printing and customer support utilizing a variety of technologies to best fit the client’s need.
- Those technologies include VBA development for Outlook, Access and Excel, VB6 and VB.NET for custom desk-top applications and C++ for a hand-held computing device.
- Provided complex and specialized support for in-house developed code.
- Interfaced with employees and management at all levels.
Environment: VB .NET, VBA, VB6, Access 97/2000, C++, Excel, Outlook, VB .NET, ASP, HTML, JavaScript, Cascading Style Sheets (CSS)