Data Engineer Resume
SUMMARY:
- Extensive work experience as a developer with RDBMS ORACLE, MS SQL Server, and good work knowledge of NoSQL databases MongoDB, Hbase.
- Advanced knowledge of SQL and data extraction, transformation and loading methods.
- Solid work experience with Big Data, HADOOP eco system tools, and AWS.
- Solid understanding of Software Development Lifecycle (SDLC). Many years of industry experience including software design, development, implementation, system and unit testing to ensure and maintain data integrity and quality control of developed program units.
- Extensive experience of designing and developing reports using various reporting tools.
- Proven ability to manage and complete multiple projects under time constraints.
- Strong analytic and problem solving skills, attention to details. Excellent communication skills, including ability to work effectively with both end - users and engineers/programmers.
TECHNICAL SKILLS:
- Linux, Windows 7, Unix
- Oracle 10g,11g, MS SQL Server, PostgreSQL, MongoDB, MySql DB, HBase
- SQL, PL/SQL, XML,Vbscript, shell, Java, Hive, Python, Pig, Spark
- SQL*Plus, Oracle utilities, SQL Developer, Toad, Control-M, Jams, Jenkins, Kafka
- Business Objects Web Intelligence XI R1/R2, Crystal Reports
- AWS(EC2, S3, EMR, RDS), Hadoop (HDFS,HCatalog,Hive, Pig,SQOOP, FLUME,Impala,Spark)
- Clear Case, Eclipse (SVN)
PROFESSIONAL EXPERIENCE:
Data Engineer
Confidential
Environment: Unix, SQL, shell, Hive, Python, Sqoop, Spark, Kafka/MapRStreaming, Hbase, MemSQL
Responsibilities:- Loading Hive tables using Sqoop and Spark. Developing shell scripts to schedule loads and verification that all tables loaded. Copying Hive tables to other cluster on MapR. Applications support.
- Extracting IOT data from TSDB and loading data into Hive data warehouse.
- Loading IOT data from Hive tables into MemSQL using Kafka/MapRStreaming.
- Developing pipelines using StreamSets.
- Extracting IOT data from Hive tables, and loading data into HBase in JSON format.
Senior Developer
Confidential
Environment: Unix, SQL, shell, AWS( S3, RDS, EC2), HIVE, Python, Jenkins, Eclipce(svn), MySQL
Responsibilities:- Development of database model to support new application, DBA responsibilities to maintain database in production and development environments.
- Development of applications based on existing prototype: gathering requirements, researching and designing of strategies, developing Python and Unix shell scripts using analytic logic to process data.
Senior Developer
Confidential
Environment: Unix, Oracle11g, PL/SQL, SQL*Plus, SQL, shell, Toad, Control-M, HADOOP, AWS( S3, EMR, EC2), HIVE, Jenkins, Eclipce(svn), PostgreSQL, JAMS
Responsibilities:- Development of Oracle applications: gathering requirements, researching and designing of strategies, developing PL/SQL and Unix shell scripts in very large distributed database environment.
- Development of Hive scripts to load tables with ETL team for migration projects.
- Development of custom reports for business users.
- Migration of Oracle applications to Hadoop data platform, AWS, Hive, Unix scripting: gathering of requirements, researching and designing of strategies for migration project, coding, unit testing, development of technical documentation.
- Production support: monitoring running applications, analyzing errors, tickets handling (Remedy and Jira), identifying root cause of production issues and developing and implementing the solutions, or proposing an approach to solve the issue.
Software Engineer
Confidential
Environment: Windows 2008, Oracle11g, PL/SQL, SQL*Plus, Java, SQL Server 2008R2, PostgreSQL, Windows Access 2010, Excel 2010, VS2010, T-SQL, Vbscript, SQL*Loader, Toad, Business Objects
Responsibilities:- Upgrade Harris Patient Portal application to expand functions and enhance work with medical records provide analysis of current and new databases to implement changes.
- Develop an upgrade plan, map data, create and test upgrade scripts, create documentation for users. Develop scripts to extract and load data into MSSQL tables, using T-SQL. SQL queries tuning in PostgreSQL. Developing solution for generating HL7 testing data using VS2010.
- Development of Vbscripts, SQL scripts to clean production environment and archiving production logs to assist a production technical support team.
- Develop, test, implement PL/SQL, SQL*Plus scripts, creating tables and external tables, data corrections to resolve production issues. Provide ad-hoc, daily, weekly, and hourly statistic reports about production performance.
- Monitor production issues, correct corrupted documents, back up BFI administrator.
Data Management Analyst
Confidential
Environment: Windows, Unix, Oracle9i, Oracle 10g, PL/SQL, shell, XML,SQL*Plus, SQL*Loader
Responsibilities:- Perform Data Architecture Impact Analysis to recognize and report impact of any database model, changes on the conversion project. DBA role in conversion team testing environments. Oracle baselines deployments to three testing environments to support conversion, and development teams, and business lines testing.
- Develop PL/SQL program unit and triggers, extensive SQL*Plus scripting, scripts for ad-hoc reports, shell scripting. Development of complex master records corrections and data backfills through the full life cycle from inception to Change Order to production deployment.