We provide IT Staff Augmentation Services!

Data (bi) Engineer Resume

4.00/5 (Submit Your Rating)

NJ

SUMMARY:

  • Over 15 years of experience of data engineering utilizing large volumes of data in design, development and analytical capacity implementing reporting applications in BI/Data Warehouse setting.
  • Primary focus is on ETL, Python, AWS, database design, and query optimization. Good communicator.
  • Over 15 years of experience architecting, manipulating and analyzing large volumes of data in a BI/DW context.
  • Over 2 years of data engineering utilizing PySpark and Hive .
  • Experienced in ETL development, data processing, data migration, and data quality.

SKILL:

Databases: Oracle 10G/11G/12c, PostgreSQL

Languages: SQL, PL/SQL, Python, Perl, C/C++, Shell (ksh, bash), and JavaScript

MPP BI Appliance: Exadata V2, Netezza, Vertica, AWS Redshift

ETL: Talend, GETL ( Confidential ETL)

ER Tools: PowerDesigner

Version Control: CVS, Perforce, Git

Oracle: SQL*Loader, DataPump, VLDB, AWR, RAC, Exadata, SQL, PL/SQL

Python: Python 2.x, 3.x, wxPython 2.8, boto, PySpark

AWS: S3, EC2, Lambda, AWS CLI, RDS, Redshift, Glue, Data Pipeline

Reporting: QlikView, Tableau

BigData: PySpark, EMR, Hive, HDFS

EXPERIENCE:

Confidential, NJ

DATA (BI) ENGINEER

Responsibilities:

  • Migrated and reorganized large volumes of data. Created and maintained microbatch pipelines. Analysed cost, performace and storage analysys of data intensive workloads on AWS.
  • Enhanced data collection procedures. Processed, cleansed, and verified data integrity.
  • Implemented ETL pipelines for ingestion from Oracle and Netezza to AWS Redshift.
  • Used PySpark (SQL interface) to convert existing nzPL/SQL ETL pipelines to Spark/Hive.
  • As part of AWS Glue/Kinesis training created end - to-end ETL workflow for data migration POC.

Confidential, MOUNTAIN VIEW, CA

DATA (BI) ENGINEER

Responsibilities:

  • Created application configuration and deployment packages using Python, Shell, and Perforce in compliance with corporate standards.
  • Performed system maintenance like space management, archival backup, performance. Written scripts for large files transfer from external systems.
  • Assisted in operational support and application maintenance efforts. Resolved data validation, job preemption quota, connectivity, cloud weather issues.

Confidential, STAMFORD, CT

ORACLE PL/SQL DEVELOPER

Responsibilities:

  • Also analyzed data requirements for FI clients and designed data feeds, Perl parsers, and PL/SQL APIs for number of FIRC FI applications like: FIPB (Fixed Income Primary Brokerage), Credit Arbitrage, Excalibur, and MarginFlex.
  • Trouble-shouted problems and provided workarounds for them. Tuned SQL and PL/SQL to improve database performance.
  • Performed release peer-reviews. Worked closely with other developers.
  • Created multiple database objects for ETL batch processing and client reporting APIs: tables, sequences, views, materialized views, packages, stored procedures, triggers, synonyms, collections, types, indexes, and Dynamic SQL.
  • Estimated, analyzed, designed, implemented and tested database projects of different scope. Written design and user project documentation.

Confidential, NEWARK, NJ

ORACLE DEVELOPER

Responsibilities:

  • Designed and implemented web UI for testing/simulation of APL trade orders using Python and PL/SQL
  • Documented all existing and new code, presentation and business logic.
  • Performed code, and database changes for PL/SQL, and database design for Oracle
  • Fixed bugs, applied patches and participated in release planning.

Confidential, STAMFORD, CT

ORACLE DEVELOPER

Responsibilities:

  • Analyzed requirements and contributed to data model design.
  • Created multiple database objects for new application: tables, sequences, views, materialized views, PL/SQL packages, stored procedures, triggers, synonyms, collections, types and indexes.
  • Fixed bugs, applied patches and participated in release planning.
  • Tuned SQL and PL/SQL to improve database performance.

We'd love your feedback!