Technical Lead/senior Spark Developer Resume
Tampa, FL
SUMMARY:
- More than 10 years of work experience in Enterprise Application Development.
- Experienced Apache Spark Developer having strong background knowledge in Big Data Systems.
- Expertise in Spark SQL, Spark Streaming and Spark Job Server
- Strong in Hadoop Technologies - Apache MapReduce, YARN, Hive, HBase, HDFS, Kafka and Oozie
- Expertise in Functional Programming and Unit Testing in Scala
- Worked on 60 node Hadoop Cluster, running on Hadoop 2.6 CDH 5.2
- Worked with structured and Semi structured data of 90 TB in size
- Expertise in Object Oriented Programming using Java
- Worked in web related technologies - J2EE, Spring, Hibernate, Swagger, Tomcat
- Object Oriented Design, Modeling, Programming and Unit Testing in Java
- Sound Knowledge in Relational Databases - SQL Server, MySQL, PostgresDB
- Practicing Agile with Scrum, Test Driven Development and Continuous Integration
- Experience in all phases of software development life cycle.
- Strong knowledge in Design Patterns
- Worked extensively on various flavors of UNIX operating system like Linux, Solaris.
- Hands on experience in VPN, Putty, winSCP,etc.
- Strong analytical skills with ability to quickly understand client’s business needs.
- Worked as Technical Lead and Senior Developer
- Research-oriented, motivated, proactive, self-starter with strong technical, analytical and interpersonal skills.
TECHNICAL SKILLS:
Programming Languages: Scala, Java, Objective C, SQL
Big Data Technologies: Spark, Spark Job Server, Kafka, MapReduce, HDFS, Hive, Impala, HBase, Oozie
Web Technologies: Spring, Jersey framework, Hibernate
Frameworks: Spark SQL, Spark Streaming, Hibernate 3.0, Spring 2.0
Tools: & Utilities: Eclipse, Scala IDE, winSCP, Putty
Application/Web Servers: Apache Tomcat.
RDBMS: Postgres DB, MySql 4.0, MS SQL Server 7.0, MS Access.
Source Control: Git, SVN
Operating Systems: Windows 8, Linux, Mac OS X, UNIX
PROFESSIONAL EXPERIENCE:
Confidential, Tampa, FL
Technical Lead/Senior Spark Developer
Responsibilities:
- Extensively worked in developing transformation engine using Spark SQL with Scala
- Developed the Grouping and Mapping transformations component in Spark
- Developed Data Preparation component to read datasets from data lake hosted in Hive
- Implemented different User Defined Functions (UDFs) in Spark SQL to support transformations.
- Implemented Publish Component in Spark, to persist the dataset back to data lake.
- Implemented performance tuning steps on Spark Components.
- Involved in design, development and testing phases of project.
- Involved in design, analysis and architectural meetings. Created Architecture Diagrams class diagram and sequence diagram with Gliffy.
- Followed Agile software development practices paired programming, test driven development and Scrum.
- Involved in web service development with Spring, Jersey and Hibernate frameworks.
- Responsible for co-ordinate with peer scrum teams and other program development teams.
- Implemented unit test cases with JUnit and Scala Test.
- Used Eclipse Integrated Development Environment (IDE) and Scala IDE in entire project development.
- Worked on tools like Gliffy, Git, SVN, Jenkins and JIRA
Environment: Spark, Scala, Hadoop, Spark Job Server, Hive, Oozie, Java, Hibernate, Spring, Web Services, Log4j, Eclipse, Scala IDE, Git, JIRA, Gliffy, JSON, Postgresql, Apache Tomcat, Windows and Linux.
Confidential
Technical Lead/Senior Hadoop Developer
Responsibilities:
- Developed a Consumption Engine, which consumes all real time domain specfic twitter data.
- Developed data transformation module for structuring and standardization of twitter data provided by GNIP
- Implemented Match Analysis module to provide live trends, tag cloud, user activity and user sentiment during every three minutes.
- Involved in design, development and testing phases of project.
- Involved in design, analysis and architectural meetings. Created Architecture Diagrams class diagram and sequence diagram with Gliffy.
- Followed Agile software development practices paired programming, test driven development and Scrum.
- Involved in web service development with Spring, Jersey and Hibernate frameworks.
- Responsible for coordinating other program development teams.
- Implemented unit test cases with JUnit.
- Used Eclipse Integrated Development Environment (IDE) in entire project development.
- Worked on tools like Gliffy, Git
Environment: Hadoop, MapReduce, HBase, Kafka, Oozie, Java, Hibernate, Spring, Postgres DB, Git, Tomcat, Linux.
Confidential
Technical Lead/Senior Developer
Responsibilities:
- Involved in design, development and testing phases of project.
- Involved in design, analysis and architectural meetings. Created Architecture Diagrams class diagram and sequence diagram with Gliffy.
- Followed Agile software development practices paired programming, test driven development and Scrum.
- Responsible for guiding the team members.
- Implemented unit test cases..
- Used Xcode in entire project development.
- Worked on tools like Gliffy, Git
Environment: Objective C, Cocoa Touch, XCode, iOS, Mac OSX, svn, JIRA
Confidential
Senior Software Engineer
Responsibilities:
- Involved in design, development and testing phases of project.
- Involved in design, analysis and architectural meetings. Created Architecture Diagrams class diagram and sequence diagram with Gliffy.
- Followed Agile software development practices paired programming, test driven development and Scrum.
- Responsible for guiding the team members.
- Implemented unit test cases..
- Used Xcode in entire project development.
- Worked on tools like Gliffy, Git
Environment: Objective C, Cocoa Touch, XCode, iOS, Mac OSX, svn, JIRA
