Data Architect/data Engineer Resume
CaliforniA
SUMMARY:
More than 18 years of extensive experience in Software Engineering, Database Design, Development, Implementation and Maintenance. This includes Requirement Gathering and Negotiations, High and Detail Design, Data Modeling and Data Migration. Strong Analytical, Logical and Mathematical skill to arrive at the best Solution. Strong belief in providing a Solution that is Simple, Easy to Maintain, Highly Efficient and with Minimal to No Negative Impact. Exploit the best features of the technology resources provided to get the best Solution. Enjoy challenges and provide Innovative Solutions. Thinking out of the box.
TECHNICAL SKILLS:
Big Data Eco Systems: Cloudera, Hortonworks, Hadoop, HDFS, HBase, Sqoop, Hive, Pig, Impala, MapReduce, Spark, Yarn, Hue
SQL Databases: Oracle 7.3/8/8i/9i/10g/11g, MS SQL Server 2005, MySQL 5.7.17/19/20
NoSQL Databases: MongoDB 3.4.2
SQL, PL/SQL, T: SQL, Shell Scripts, HiveQL, Pig Latin, Scala, Python, Java.
ETL: Talend, Sqoop, Hive
Data Modeling: Generic, Canonical, Dimensional and Snowflake
Messaging: Kafka
GUI: Oracle Application Express 4.0, IBM Sterling Selling and Fulfillment Suite (8.5/9.1), Oracle Forms 4.5/5/6i, Oracle Reports 2.5/3/6i.
Cloud Platform: Google Cloud Platform (GCP).
PROFESSIONAL EXPERIENCE:
Confidential, California
Data Architect/Data Engineer
Responsibility:
- Developed Pipeline to send data to HDFS for reporting/analysis purpose using Sqoop, Hive, Spark, etc.
- Design and Implement Data Lake solution using Big Data Eco System technologies.
- Implemented Spark using Scala and Spark SQL for faster processing and testing of data.
- Converting HiveQL queries into Spark transformations using Spark RDDs, Scala and have a good experience in using Spark - Shell and Spark Streaming.
- Worked on architecture, development, and implementation of Operational Intelligence using Splunk, Kafka, Hadoop, Spark, etc.
- Used Spark Data frames, Spark-SQL, Spark MLLib extensively and developing and designing POC's using Java, Scala, Spark SQL and MLLib libraries
- Designed and Developed real time analytics and ingestion platform using Spark, Spark Kafka streaming and Kafka
- Written scala transformation and actions on Spark, Spark Sql and Data Frames
- Planned and created solutions for constant information ingestion utilizing Kafka, Spark spilling and different NoSQL databases MongoDB and Hbase.
- Design and Implement Data Lake solution using MySQL Multi Source Replication and Talend.
- Designed and Implemented the PII data encryption (redaction) logic based on Database Login access.
- Served as the Technical Lead and Subject Matter expert in various Projects for Migration of existing ATG Database (Oracle Database) data related to Catalog, User Profile, Cart & Check Out to the new Google Cloud Platform (GCP) Database - MongoDB and MySQL. This involved encryption and decryption for secure PII and PCI data during the process of the migration.
- Work with DBA team to setup Site Facing Databases as Micro Services with High Availability (HA).
- Involved in Creation, Maintenance and Customization of Database objects related Site Facing Databases, MDM Databases (Product MDM & Customer MDM).
- Involved in maintaining the MDM related data in sync across dependent Databases. This activity involved data cleansing and migration.
- Designed and Implemented data fix solutions that involved small to very bulk data fixes.
- Participate in and oversee yearly and day-to-day Database Performance Tuning activities.
- Served as the Technical Lead for Data Modeling and Review of all Database related activities.
Confidential, Sunnyvale, California
Data Architect/Data Engineer
Responsibility:
- Created on the fly an Inventory Management System (IMS) solution to keep the order flowing fine when there was a sudden issue that arose on the peak sale event days - Black Friday - Cyber Monday weeks.
- Architected and Designed a Generic Service Solution for OMS (Order Management System) - IBM Sterling Selling and Fulfillment Suite that is even now considered impossible.
- Served as the Technical Lead and Subject Matter expert in the Migration of existing Web Content Management System Database (Oracle Database) data related to Catalog to the new WISE (Walmart Item Setup Enterprise) Platform Database (Oracle Database) and later to STIBO using Oracle and Java.
- Design and Implement Data Lake solution using native Oracle SQL and SQL Loader. Created an Item Setup Dashboard using the Oracle Application Express 4 on this data that integrates with the Web Content Management System as well as the Product Page on the Site.
- Won the 2012 4th Quarterly award “Certificate of Recognition” for the category “Delighting the Customer”.
- Won the 2012 Year Hack Day award “Cash Cow Hack Award” for which a patent is being filed.
- Involved in Creation, Maintenance and Customization of Database objects related Site Facing Databases, MDM Databases (Product MDM) and Data Warehouse.
- Involved in maintaining the MDM related data in sync across dependent Databases. This activity involved data cleansing and migration.
- Designed and Implemented data fix solutions that involved small to very bulk data fixes.
- Participate in and oversee yearly and day-to-day Database Performance Tuning activities.
- Served as the Technical Lead for Data Modeling and Review of all Database related activities.
Confidential, Santa Ana, California
Database Architect/Data Engineer
Responsibility:
- Designed and Implemented the PII encryption logic based on Application User access.
- Design and Implement Data Lake solution for Portal Application that would have access to data from all counties using Oracle Streams
- Participate in and oversee yearly and day-to-day Database Performance Tuning activities.
- Served as the Technical Lead for Data Modeling and Review of all Database related activities.
Confidential, Warren, New Jersey
Senior Developer (Contractor)
Responsibility:
- Designed and Developed backend code in MS SQL Server 2005 using SQL and T-SQL.
Confidential
System Analyst
Responsibility:
- Server as the Technical Lead and Subject Matter expert in Six Sigma project, “Leavers Process”.
- Designed and Implemented a tool “Expert System” that helps support personals resolve issues well within the SLA period and act as a Knowledge Repository.
- Designed and Developed frontend UI in Oracle Forms 6i and Reports 6i.
- Designed and Developed backend code in Oracle 9i/10g using SQL and PL/SQL. This involved using Table, Packages, Functions, Procedures, Triggers, Indexes, Synonyms and Views.
Confidential
Software Design Engineer
Responsibility:
- Designed and Developed frontend UI in Oracle Forms 6i and Reports 6i.
- Designed and Developed backend code in Oracle 8i using SQL and PL/SQL. This involved using Table, Packages, Functions, Procedures, Triggers, Indexes, Synonyms and Views.
Confidential
Software Design EngineerResponsibility:
- Designed and Developed frontend UI in Oracle Forms 5/6i and Reports 3/6i.
- Designed and Developed backend code in Oracle 7.3/8/8i using SQL and PL/SQL. This involved using Table, Packages, Functions, Procedures, Triggers, Indexes, Synonyms and Views.