Data (bi) Engineer Resume
NJ
SUMMARY:
- Over 15 years of experience of data engineering utilizing large volumes of data in design, development and analytical capacity implementing reporting applications in BI/Data Warehouse setting.
- Primary focus is on ETL, Python, AWS, database design, and query optimization. Good communicator.
- Over 15 years of experience architecting, manipulating and analyzing large volumes of data in a BI/DW context.
- Over 2 years of data engineering utilizing PySpark and Hive .
- Experienced in ETL development, data processing, data migration, and data quality.
SKILL:
Databases: Oracle 10G/11G/12c, PostgreSQL
Languages: SQL, PL/SQL, Python, Perl, C/C++, Shell (ksh, bash), and JavaScript
MPP BI Appliance: Exadata V2, Netezza, Vertica, AWS Redshift
ETL: Talend, GETL ( Confidential ETL)
ER Tools: PowerDesigner
Version Control: CVS, Perforce, Git
Oracle: SQL*Loader, DataPump, VLDB, AWR, RAC, Exadata, SQL, PL/SQL
Python: Python 2.x, 3.x, wxPython 2.8, boto, PySpark
AWS: S3, EC2, Lambda, AWS CLI, RDS, Redshift, Glue, Data Pipeline
Reporting: QlikView, Tableau
BigData: PySpark, EMR, Hive, HDFS
EXPERIENCE:
Confidential, NJ
DATA (BI) ENGINEER
Responsibilities:
- Migrated and reorganized large volumes of data. Created and maintained microbatch pipelines. Analysed cost, performace and storage analysys of data intensive workloads on AWS.
- Enhanced data collection procedures. Processed, cleansed, and verified data integrity.
- Implemented ETL pipelines for ingestion from Oracle and Netezza to AWS Redshift.
- Used PySpark (SQL interface) to convert existing nzPL/SQL ETL pipelines to Spark/Hive.
- As part of AWS Glue/Kinesis training created end - to-end ETL workflow for data migration POC.
Confidential, MOUNTAIN VIEW, CA
DATA (BI) ENGINEER
Responsibilities:
- Created application configuration and deployment packages using Python, Shell, and Perforce in compliance with corporate standards.
- Performed system maintenance like space management, archival backup, performance. Written scripts for large files transfer from external systems.
- Assisted in operational support and application maintenance efforts. Resolved data validation, job preemption quota, connectivity, cloud weather issues.
Confidential, STAMFORD, CT
ORACLE PL/SQL DEVELOPER
Responsibilities:
- Also analyzed data requirements for FI clients and designed data feeds, Perl parsers, and PL/SQL APIs for number of FIRC FI applications like: FIPB (Fixed Income Primary Brokerage), Credit Arbitrage, Excalibur, and MarginFlex.
- Trouble-shouted problems and provided workarounds for them. Tuned SQL and PL/SQL to improve database performance.
- Performed release peer-reviews. Worked closely with other developers.
- Created multiple database objects for ETL batch processing and client reporting APIs: tables, sequences, views, materialized views, packages, stored procedures, triggers, synonyms, collections, types, indexes, and Dynamic SQL.
- Estimated, analyzed, designed, implemented and tested database projects of different scope. Written design and user project documentation.
Confidential, NEWARK, NJ
ORACLE DEVELOPER
Responsibilities:
- Designed and implemented web UI for testing/simulation of APL trade orders using Python and PL/SQL
- Documented all existing and new code, presentation and business logic.
- Performed code, and database changes for PL/SQL, and database design for Oracle
- Fixed bugs, applied patches and participated in release planning.
Confidential, STAMFORD, CT
ORACLE DEVELOPER
Responsibilities:
- Analyzed requirements and contributed to data model design.
- Created multiple database objects for new application: tables, sequences, views, materialized views, PL/SQL packages, stored procedures, triggers, synonyms, collections, types and indexes.
- Fixed bugs, applied patches and participated in release planning.
- Tuned SQL and PL/SQL to improve database performance.