Cloud Architect & Sr. Data Engineer (hadoop) Resume
PROFILE:
- Self - driven & highly motivated RDBMS expert and aspiring Big
- Data professional, with overall 22+ years of experience spawning multiple areas of expertise including development, performance tuning, testing, administration, migration, consolidation and architecting effective solutions.
- Expert converting traditional applications with rigid/fixed schema designs to evolving schema-less design and deploying it in cloud with infinite scalability at lower cost.
- Hands-on working knowledge with Big Data frameworks
- Hadoop ecosystem (1.x & 2.x)
- Apache Spark (2.2.x)
- Expert understanding of AWS suite of services and experience setting up Big Data Cloud infrastructure & migrating applications and database to AWS Cloud
- Hands-on with Big Data tools
TECHNICAL SKILLS:
Oracle RDBMS: 7.x to 12c
Oracle Development: SQL, PL/SQL, Stored Procedures, Packages, Edition based Deployment, Apex, XMLDB, JSon Processing within DB, RAC-aware development & deployment, Self-documenting code with instrumentation for instant real-time tracing, Oracle Database Appliance (ODA)
Oracle HA Solutions: RAC, DataGuard, GoldenGate
Oracle Performance Tuning: OEM, Diag+Tuning pack, Statspack etc
Oracle Administration: DB Installation, upgrades & migrations, pro-active & real-time monitoring for issues.
Virtualization: Oracle VirtualBox, VMWare
PROFESSIONAL EXPERIENCE:
Confidential
Cloud Architect & Sr. Data Engineer (Hadoop)
Responsibilities:
- Leading technical discussions with clients on gathering requirements & accessing transition efforts and benefits on moving into existing infrastructure into cost-effective distributed Big Data frameworks
- Developing prototypes and PoCs & demonstrate clients to impart confidence on migrating their existing process over to Cloud and/or Big Data platforms.
- Feasibility study on migration into AWS cloud & cost analysis.
- Well versed in Hadoop, SPARK & AWS ecosystem and related tools, with specialized interest and demonstrated experience in processing huge volumes of data and solving complex analytical problems in Hive & Spark SQL
- Experienced migrating projects from RDBMS to Hadoop & SPARK frameworks
- Experience setting up multi-node cluster from scratch & ingesting data from multiple sources primarily using SQOOP
- Experienced in evaluating health check of Hadoop cluster/stack and tune configurations of each component as needed & optimize it for reducing overlaps between resource consumers.
- Certified AWS Solution Architect Associate
Confidential
Tools: Apache Hadoop 2.6, Apache Hive 1.2.0, Spark SQL 2.0
Sr. Data Engineer/Analyst
Responsibilities:
- For most data processing and analytical needs across projects, our primary tools of choice were Hive & Spark SQL.
- After the data gets stored in Data Lake, external tables were created from Hive & used for further deep dive analysis.
- Depending on the requirement & resources available, we usually experiment storing data across different formats & most optimal gets used.
- Effective Partitioning techniques (mostly dynamic partitioning with bucketing) were used for faster loading and quicker analysis of Big Data.
- Data Analyzed was again persisted back in HDFS and shared with BI/Visualization team for presentation needs.
Confidential
Platforms: AWS, Private Cloud (running Hadoop)
Cloud Architect
Responsibilities:
- For customers who are looking to migrate their Big Data projects into cloud, a "cloud fit" assessment study gets done, following up with a report delivered with options compared (listing tools and features) and costs involved.
- Typically, cost of running enterprise databases in-house is compared and contrasted against equivalent AWS or open source solutions (Oracle to AWS Aurora/Mysql, Database to HBase/DynamoDB, Database storage to S3/HDFS etc).
- AWS server types were considered analyzed in detail for different workloads.
Confidential
Sr. Oracle Consultant
Responsibilities:
- Also, patching, upgrading, installing new RAC were accepted and performed as part of regular work-routines.
- Technical work covered but not limited to these tasks - Designing DB, Reviewing Application Architecture, DBA tasks, Performance Tuning Root cause analysis and follow-up Fixes, Database Installs, upgrades & migrations, Schema Modeling ( Physical & Logical) Dimensional Model, SQL & Instance Tuning, Storage & OS Metrics collecting and reviewing, Training DB/DBA team at customer sites.
Confidential
Lead Oracle DBA-Developer
Responsibilities:
- Responsible for maintaining database health for all Production databases across entire enterprise and performing upgrades & patching routines.
- In addition, catering to development teams like participation in application review session, addressing performance issues & providing clone databases whenever needed were performed. When needed, was also involved in code review to fix issues ( mostly SQL in Java and crystal reports & PLSQL in PLM modules).
Confidential
Technical Consultant
Responsibilities:
- Responsibilities included Performance benchmarking during development phase & pro-active monitoring during after "live" phase for a very highly visible & mission critical application, Application tuning, Performing Database health checks,
- Replication monitoring participating and raising key questions benefitting the client during Vendor discussions dealing with infrastructure and technology stack changes and proposals, Reviewing Code, Architecting and designing & running Proof-of-concept runs for proposed changes.
- Expert knowledge in deep core concepts of Oracle RDBMS and was able to solve variety of problems
- Maintained an AWR repository single handedly for many years & was instantly able to spot changes and reasons behind (Schema changes Vs code changes Vs Infrastructure Changes).
- Had a good handle on licensing cost and was able to workaround extra-licensing cost options (within Oracle DB) whenever possible.
- Key contributor and educator on solving data problems within database itself without having pull out data using 3 rd party tools. (Data Analysis & Reporting)
- Was able to communicate & prioritize and get work done across multiple different organizational departments including Business Users, DBA group, Application Dev group, Infrastructure Group)
- Was an active and Key contributing member of Oracle ACS team