Technical Lead Resume

SUMMARY

A versatile and skilled IT professional specializing in Big data and Hadoop wif over 10 years of rich experience.
4+ years of experience in designing and developing Big Data applications using Hadoop, MapReduce, Pig, Hive, Sqoop, Flume, Spark, Kafka, Cassandra and Oozie.
Hortonworks certified Developer.
Extensive experience on Cloudera and Hortonworks Distribution.
Good experience on cloud technologies - AWS, S3, EMR and Redshift.
Experience on Python and Scala.
Good experience on SOLR search engine and Drools rule engine.
Excellent experience wif Java, Spring MVC, Hibernate, Angular.js, JavaScript.
Extensive experience in Design, Execution, Delivery of complex projects using various Microsoft.Net Technologies such as C#, ASP.Net MVC.
Good experience in handling databases like SQL SERVER, Oracle, and MySQL.
Excellent domain noledge in Banking and Finance, Retail and Industrial Automation.
Good experience on Agile (Scrum) process.

TECHNICAL SKILLS

Big Data: Hadoop, Map Reduce, Pig, Hive, Sqoop, Flume, Cassandra, Spark, AWS

Languages: C#, MC++, Java, Scala

Web Technologies: Spring MVC, JavaScript, AngularJS, JQuery, HTML

Database: SQL Server, Oracle, MySQL

Scripting: Shell Scripting, Python

Configuration Management: TFS, ClearCase, SVN and Git

Tools: Maven, Sonar, Jenkin

PROFESSIONAL EXPERIENCE

Confidential

Technical Lead

Responsibilities:

Loaded Teradata and SAP Hana data to hive using Sqoop.
Converted Hana procedures to hive queries.
Performance optimization of hive queries.
Developed Data Validator tool using Spark and Scala to validate Teradata/Hana and hive data.
Developed user interface and REST api for data validation tool.

Confidential

Technical Lead

Responsibilities:

Collect data from different sources of Confidential like Confidential .com, Sam’s club and Confidential store and loaded into hive table.
Wrote hive queries for different business cases.
Performance optimization of hive queries.
Convert hive queries to Spark to minimize load process time to teh final table.
Performance tuning of Spark jobs.
Loaded Teradata and SAP Hana data to hive using Sqoop.
Developed Data Validator tool using Spark and Scala to validate Teradata/Hana and hive data.
Worked on Pig script for parsing JSON files.
Worked on python to auto parsing JSON files and loaded into hive tables.\

Confidential

Lead Engineer

Responsibilities:

Developed metadata management tool Data Registry for validation of files before pushing into HDFS.
Developed multiple REST APIs for different use cases.
Wrote Map Reduce job for data quality check.
Wrote Hive queries for analytics purpose.
Worked on Cloudera Navigator for data lineage and tracking purpose.
Worked on Solr for searching metadata registered in data registry application.
Worked on Spark and Scala for implementing data profiling job.
Worked on Pig for multiple file format creation such as Parquet.
Worked on drools and decision table for Data Quality check of raw data.
Worked on AWS to run Data quality map reduce jobs on S3 and EMR.
Worked on Python for automatic data profiling.
Wrote shell script to migrate MySQL data to hive tables.

Confidential

Sr. Software Developer

Responsibilities: