We provide IT Staff Augmentation Services!

Technical Lead/senior Spark Developer Resume

Tampa, FL

SUMMARY:

  • More than 10 years of work experience in Enterprise Application Development.
  • Experienced Apache Spark Developer having strong background knowledge in Big Data Systems.
  • Expertise in Spark SQL, Spark Streaming and Spark Job Server
  • Strong in Hadoop Technologies - Apache MapReduce, YARN, Hive, HBase, HDFS, Kafka and Oozie
  • Expertise in Functional Programming and Unit Testing in Scala
  • Worked on 60 node Hadoop Cluster, running on Hadoop 2.6 CDH 5.2
  • Worked with structured and Semi structured data of 90 TB in size
  • Expertise in Object Oriented Programming using Java
  • Worked in web related technologies - J2EE, Spring, Hibernate, Swagger, Tomcat
  • Object Oriented Design, Modeling, Programming and Unit Testing in Java
  • Sound Knowledge in Relational Databases - SQL Server, MySQL, PostgresDB
  • Practicing Agile with Scrum, Test Driven Development and Continuous Integration
  • Experience in all phases of software development life cycle.
  • Strong knowledge in Design Patterns
  • Worked extensively on various flavors of UNIX operating system like Linux, Solaris.
  • Hands on experience in VPN, Putty, winSCP,etc.
  • Strong analytical skills with ability to quickly understand client’s business needs.
  • Worked as Technical Lead and Senior Developer
  • Research-oriented, motivated, proactive, self-starter with strong technical, analytical and interpersonal skills.

TECHNICAL SKILLS:

Programming Languages: Scala, Java, Objective C, SQL

Big Data Technologies: Spark, Spark Job Server, Kafka, MapReduce, HDFS, Hive, Impala, HBase, Oozie

Web Technologies: Spring, Jersey framework, Hibernate

Frameworks: Spark SQL, Spark Streaming, Hibernate 3.0, Spring 2.0

Tools: & Utilities: Eclipse, Scala IDE, winSCP, Putty

Application/Web Servers: Apache Tomcat.

RDBMS: Postgres DB, MySql 4.0, MS SQL Server 7.0, MS Access.

Source Control: Git, SVN

Operating Systems: Windows 8, Linux, Mac OS X, UNIX

PROFESSIONAL EXPERIENCE:

Confidential, Tampa, FL

Technical Lead/Senior Spark Developer

Responsibilities:

  • Extensively worked in developing transformation engine using Spark SQL with Scala
  • Developed the Grouping and Mapping transformations component in Spark
  • Developed Data Preparation component to read datasets from data lake hosted in Hive
  • Implemented different User Defined Functions (UDFs) in Spark SQL to support transformations.
  • Implemented Publish Component in Spark, to persist the dataset back to data lake.
  • Implemented performance tuning steps on Spark Components.
  • Involved in design, development and testing phases of project.
  • Involved in design, analysis and architectural meetings. Created Architecture Diagrams class diagram and sequence diagram with Gliffy.
  • Followed Agile software development practices paired programming, test driven development and Scrum.
  • Involved in web service development with Spring, Jersey and Hibernate frameworks.
  • Responsible for co-ordinate with peer scrum teams and other program development teams.
  • Implemented unit test cases with JUnit and Scala Test.
  • Used Eclipse Integrated Development Environment (IDE) and Scala IDE in entire project development.
  • Worked on tools like Gliffy, Git, SVN, Jenkins and JIRA

Environment: Spark, Scala, Hadoop, Spark Job Server, Hive, Oozie, Java, Hibernate, Spring, Web Services, Log4j, Eclipse, Scala IDE, Git, JIRA, Gliffy, JSON, Postgresql, Apache Tomcat, Windows and Linux.

Confidential

Technical Lead/Senior Hadoop Developer

Responsibilities:

  • Developed a Consumption Engine, which consumes all real time domain specfic twitter data.
  • Developed data transformation module for structuring and standardization of twitter data provided by GNIP
  • Implemented Match Analysis module to provide live trends, tag cloud, user activity and user sentiment during every three minutes.
  • Involved in design, development and testing phases of project.
  • Involved in design, analysis and architectural meetings. Created Architecture Diagrams class diagram and sequence diagram with Gliffy.
  • Followed Agile software development practices paired programming, test driven development and Scrum.
  • Involved in web service development with Spring, Jersey and Hibernate frameworks.
  • Responsible for coordinating other program development teams.
  • Implemented unit test cases with JUnit.
  • Used Eclipse Integrated Development Environment (IDE) in entire project development.
  • Worked on tools like Gliffy, Git

Environment: Hadoop, MapReduce, HBase, Kafka, Oozie, Java, Hibernate, Spring, Postgres DB, Git, Tomcat, Linux.

Confidential

Technical Lead/Senior Developer

Responsibilities:

  • Involved in design, development and testing phases of project.
  • Involved in design, analysis and architectural meetings. Created Architecture Diagrams class diagram and sequence diagram with Gliffy.
  • Followed Agile software development practices paired programming, test driven development and Scrum.
  • Responsible for guiding the team members.
  • Implemented unit test cases..
  • Used Xcode in entire project development.
  • Worked on tools like Gliffy, Git

Environment: Objective C, Cocoa Touch, XCode, iOS, Mac OSX, svn, JIRA

Confidential

Senior Software Engineer

Responsibilities:

  • Involved in design, development and testing phases of project.
  • Involved in design, analysis and architectural meetings. Created Architecture Diagrams class diagram and sequence diagram with Gliffy.
  • Followed Agile software development practices paired programming, test driven development and Scrum.
  • Responsible for guiding the team members.
  • Implemented unit test cases..
  • Used Xcode in entire project development.
  • Worked on tools like Gliffy, Git

Environment: Objective C, Cocoa Touch, XCode, iOS, Mac OSX, svn, JIRA

Hire Now