Data Engineer Resume
Mountain View, CA
SUMMARY
- Extensive software development experience in Python, Java, C and JavaScript
- Extensively worked on database applications with MongoDB, Oracle, SQL and PL/SQL
- Used Python as custom ETL tool and stored the data in Elasticsearch / MongoDB
- Data verification done by Kibana Sense and RESTful API
- Hands on experience in Cucumber testing tool
- Expert in creating BI Dashboards using Hyperion with Java API and JavaScript
- Experience in ETL tools Informatica and Pentaho
- Have knowledge of Hadoop echo system (Map Reduce, HDFS, Hive, Pig and Sqoop)
TECHNICAL SKILLS
Language: Python, Java, C, SQL, PL/SQL
ETL: Pentaho, Informatica
Database: MongoDB, Oracle, mySQL
Scripting: Java Script, Shell Script
Automation: Autosys
Version Control: Subversion, Perforce
Visualization: Kibana Sense, Hyperion
Testing: Cucumber
PROFESSIONAL EXPERIENCE
Data Engineer
Confidential, Mountain View, CA
Responsibilities:
- Developed Python script as an ETL tool to extract data from unformatted data source
- ETL rules were stored in JSON format
- Extracted data was stored in Elasticsearch
- Test cases were created and automated in Bash Shell script
- Elasticsearch data validation were done by Kibana Sense and RESTful API
- Developed security file classification application using Python
- Data was stored in MongoDB using pymongo
- The script used configuration files in JSON format
- Created technical design document for the applications
- Developed Cucumber testing scripts for Java GUI application
- Cucumber steps were developed in Java
- The application was developed in Linux environment
Tools: Python, Java, Elasticsearch, Kibana Sense, RESTful API, MongoDB, Bash Script, Cucumber
Senior Software Engineer
Confidential, San Ramon, CA
Responsibilities:
- Developed DW/ETL/BI solution for a consulting company
- Converted Informatica solution into Pentaho solution
- Used Subversion for managing job/transformation version control
- Developed, tested and implemented mappings using Spoon and Kitchen
- Installed and configured Pentaho spoon for offshore developers
- Used JavaScript to customize transformations
- Converted EDW, Hyperion and Sales Reporting modules in Pentaho
- The ETL jobs were automated in Autosys
- Collaborated with vendors, offshore development team and internal users
Tools: Hyperion, Informatica, Pentaho, Java, JavaScript, Autosys, Oracle SQL, PL/SQL
Senior Software Engineer
Confidential, Santa Clara, CA
Responsibilities:
- Leading SW team involved in Trade Applications
- Involved in cross - functional collaboration and Customer interaction
- Collaborated with offshore development team
- Closely worked with end users and provided time critical information
Tools: Hyperion, JavaScript, Trade Collaborator and Oracle
BI Consultant
Confidential, Pleasant Hill, CA
Responsibilities:
- Built BI solutions for HR Data warehouse
- Designed and developed dashboards for Peoplesoft HR module
- Designed BI solutions for private banking call center applications
- Developed BI solutions for client incentive project
- Created Business & Technical requirements catering to multi-national users.
- Developed dynamic data protection by designing row level security.
Tools: Hyperion, Oracle and Java Script
Senior Software Engineer
Confidential, Santa Clara, CA
Responsibilities:
- Performed the BI technical architect and developer role
- Developed BI solutions for Finance, Order Management, Inventory & HR modules in Oracle ERP.
- Closely worked with finance department to meet the SOX compliance
- Provided user-level training to utilize ad-hoc solutions in order to decentralize the process.
- Performed system administration task
Tools: Hyperion, Oracle and Java Script
BI Consultant
Confidential, San Francisco, CA
Responsibilities:
- Developed BI solutions for Compliance Management to analyze the brokerage transactions.
- The solution helped to achieve SEC compliance
- Closely worked with end users in requirement analysis
- Developed BI solutions for forecast analysis
- Modified existing solutions for performance improvement
- Scheduled and automated the solution
Tools: Brio, SQR, Java Script and Oracle
Technical Project Leader
Confidential, Santa Clara, CA
Responsibilities:
- Designed and developed BI solutions as part of the professional service team
- Performed proof-of-concept which helped to sell the product
Tools: used: Hyperion, Java, Java Script, Oracle, DB2 and SQL Server
