Spark Developer Resume

SUMMARY

Hadoop developer with overall 5 years of experience in software development and 2 years of extensive experience as Hadoop Developer and Big Data Analyst. Primary technical skills in HDFS, MapReduce, YARN, Pig, Hive,Sqoop, HBase, Flume, Oozie, Zookeeper, Spark.
Involved in building all domain pipelines using Spark data frame and Spark batch processing
Strong technical, administration, & mentoring knowledge in Linux and Bigdata/Hadoop technologies.
Hands on experience on major components in Hadoop Ecosystem like Hadoop Map Reduce, HDFS, HIVE, PIG, Pentaho, Hbase, Zookeeper, Sqoop, Oozie, Flume and Avro.
Experience in applying the latest development approaches including applications in Spark using Scala to compare the performance of Spark with Hive and SQL/Oracle.
Thorough knowledge with the data extraction, transformation and load in Hive, Pig and HBase
Hands on experience in coding Map Reduce/Yarn Programs using Java, Scala for analyzing Big data.
Worked with Apache Spark which provides fast and general engine for large data processing integrated with functional programming language Scala.
Hands on experience in ETL, Data Integration and Migration and Extensively used ETL methodology for supporting Data Extraction, transformations and loading.
Experience working on various Cloudera distributions like (CDH 4/CDH 5), Knowledge of working on Horton works.
Expertise in implementing and maintaining an Apache Tomcat /MySQL/PHP, LDAP, LAMP web service environment.
Experience in all phases of Software development life cycle (SDLC).

TECHNICAL SKILLS

Big Data Ecosystems: SPARK, Hadoop, MapReduce, HDFS, HBase, Zookeeper, Hive, Pig, Sqoop, Cassandra, Oozie, Flume and Cloudera.

Programming Languages: Java, C/C++

Scripting Languages: PHP, JavaScript, XML, HTML

Databases: NoSQL, mysql

UNIX Tools: Apache, Yum, RPM

Tools: Eclipse, Netbeans.

Platforms: Windows(2000/XP), Linux, Solaris.

Application Servers: Apache Tomcat 5.x 6.0, Jboss 4.0

Testing Tools: NetBeans, Eclipse, WSAD, RAD

PROFESSIONAL EXPERIENCE

Confidential

Spark Developer

Responsibilities:

Responsible for daily analysis of complex business data and collaborating with stakeholders, thereby increasing sales revenue by 20% over the last two years.
Developed a new pipeline Spark technique which help the company in efficient data processing and analytics.
Involved in building all domain pipelines using Spark Data Frames, Spark steaming and Spark batch processing.
Improving the performance and optimization of existing algorithms in Hadoop using Spark context, Spark - SQL and Spark YARN using Scala.
Implemented Spark Core in Scala to process data in memory.
Involved in creating Distribute cache, join and filtering.
Implemented test scripts to support test driven development and continuous integration.
Responsible for Spark Streaming configuration based on type of Input Source
Importing and exporting data into HDFS, Hive and HBase using SQOOP.
Involved in converting Hive/SQL queries into Spark transformations using Spark RDDs and Scala.
Performed job functions using Spark API's in Scala for real time analysis and for fast querying purposes.
Develop and maintain several batch jobs to run automatically depending on business requirements.
Developed scripts and automated data management from end to end and sync up b/w all the clusters.
Shared responsibility in Hadoop administration activities such as installation, configuration of clusters using Cloudera Manager, Apache Ambari, and troubleshooting using Hadoop ecosystem components in HDP.
Worked on Cloudera to analyze data present on top of HDFS
Responsible for managing data from multiple sources.

Confidential

PHP Developer

Responsibilities:

Develop complicated application using MVC architecture in PHP
Successfully managed the design and development of e-automation software, increasing customer satisfaction.
Prepared use cases, designed and developed object models and class diagrams
Developed SQL statements to improve back-end communications.
Incorporated custom logging mechanism for tracing errors, resolving all issues and bugs before deploying the application in the Apache Tomcat
Received praise from users for developing a highly interactive and intuitive UI using PHP AJAX and JQuery technique.

We provide IT Staff Augmentation Services!

We'd love your feedback!

Resume Categories

Client Services

Job Seekers

Visa Sponsorship