Senior Spark Scala Developer Resume
SUMMARY
- Experienced and result oriented Senior Big Data developer and Senior Scala Developer with 9+ years of experience in System Analysis, Design and Development, Quality, maintenance and Production Support of Software Applications.
- 9+ years of experience in banking domain for TIER - 1 banks across 3 different countries.
- Highly skilled, efficient and detail oriented experience in development and deployment of Enterprise applications inSpark and Scala, Javaand J2EE Technologies i.e. CoreJava, Servlets, Spring MVC, Spring boot, Hibernate, JSP, JavaBeans,JavaScript, JDBC,JavaMail, XML, HTML and CSS, SOAP and REST Web services.
- Extensive in depth experience in Spark ecosystem and programming languages, software design fundamentals and utilizing analytical skills to identify, test and debug program faults and complete development requests.
- Well versed in all the phases of SDLC in various SDM including Scrum, Agile, Iterative and Waterfall.
- Certified professional scrum master (PSM I). - Scrum.org
- Extensively involved in requirement gathering phase, writing Test Cases, Test Plans, and Unit testing, logging using Log4J, Integration Testing and System Testing and closing activities as a unit.
- Current Status in Canada: - Permanent resident. Willing to relocate as per business needs.
TECHNICAL SKILLS
Technologies: Spark, Scala, Hadoop, Core Java, Spring MVC, Hibernate, JavaScript, JQuery, PL/SQL, HTML5 & CSS3, JSON, XML, SOAP, REST Web Services, Kendo, JSF, and JSP.
Database: Hive, Oracle, SQL Server, MYSQL, Mongo.
Tools: / Products: Eclipse(IDE), Net Beans, Toad, Golden32,Mongo Chef, Text Pad, Notepad++, JIRA, MKS, CVS, SVN, VSS, GIT, Maven, Jenkins, Firestone, Putty, Tech-Online, Win-merge, Beyond-Compare, Microsoft Visio, Rational Rose 3.0,IBM Clear Quest and WAS IBM,Solace, Jupyter.
Testing: HP ALM, Paros Proxy tool.
Application Servers: JBoss4.2.2 GA, Apache Tomcat, Glassfish 4.0. 4.
Operating Systems: All Windows Platforms, Linux (Fedora 14).
PROFESSIONAL EXPERIENCE
Confidential
Senior Spark Scala Developer
Responsibilities:
- Developed production Spark ETL jobs using Scala API's to performance ETL for Confidential NY exchange messages.
- Delivered Electronic trading Spark ETL jobs that are currently processing 100 million records in less than 30 mins
- Implemented Spark using Scala and Spark SQL for faster testing and processing of data.
- Designed and ingested data to Hive external tables from the raw parquet files
- Imported data from kerberized hadoop cluster Hive and HDFS in parquet/csv. Expert knowledge of Spark framework.
- Worked with various HDFS file formats like Avro, Sequence File and various compression formats like Snappy.
- Used Scala libraries to process XML data that was stored in HDFS and processed data was stored in HDFS.
- Involved in converting Hive/SQL queries into Spark transformations using Spark RDDs, Scala and Python.
- Involved in converting MapReduce programs into Spark transformations using Spark RDD in Scala.
- Developed Spark scripts by using Scala Shell commands as per the requirement.
- Implemented Spark using Scala and utilizing Data frames with Spark SQL API, Spark streaming with kafka for faster processing of data. Also loaded all the ingested ETL outputs to tableau for analysis.
- Used Avro, Parquet and ORC data formats to store in to HDFS.
- Importing and exporting data into HDFS and Hive using Sqoop
Environment: Hadoop, HDFS, Spark, MapReduce, Hive, Scala, Python, Java, JSON, SQL Scripting and Linux Shell Scripting, Avro, Parquet, Hortonworks.
Confidential
Lead Java Developer
Responsibilities:
- Design and develop MIFID II Trading application regulatory processing features and products using Core Java, multi-threading, spring and Hibernate frameworks. Professional Expert in Core java /Spring / Hibernate
- Achieved the rank of STAR java developer which is given to one in 15 developers. Closely worked at client locations at New jersey/ India and London
- Single handedly responsible for developing application based on Spring MVC design pattern and using various other spring modules Spring IOC/AOP and Spring boot.
- Exhibited Strong debugging and problem solving skills. Support calls for production bugs and providing fixes to be deployed on production servers which are used by end user 24X7
- Working on Web Services to consume SOAP/REST Web Services of the external systems.
- Used Hibernate, (ORM) and JDBC technique of mapping data representation from MVC model to RDBMS & Mongo
- Leading and mentoring a team of 5 developers for design, TDD implementation and test estimates. Ensures design and development incorporate reliability, security, usability and performance factors.
- Driving Daily scrum meetings, Iteration planning and Backlog grooming.
- Won Client Manager Appreciation for excellence in project execution as per delivery well before the SLA and consistent performance in a fast-paced Environment.
Confidential
Lead Java Developer
Responsibilities:
- Designed new toolbox components to fit in the already existing architecture using coreJava, multi-threading. Closely worked at client locations at Canada and India.
- Track defects in JIRA and quality assurance for “NO” slippages completed the planning and execution phase in agreed timeline ensuring time to time delivery. Extensive exp in Core java spring IOC/MVC/AOP and Spring Boot
- Lead onshore for 4 Developers and offshore team coordination and work delegation for project development and delivery.
Confidential
Senior Systems Engineer
Responsibilities:
- Had been involved in the gathering client requirement, overall design change and implementation of the functionality, Test-driven development, review and unit testing, integration and regression testing of code, fixing the bugs, delivery and maintenance of the software product in Core java.
- Extensive use of Frameworks like Spring/REST/SOAP Web Services and Microservices (HTTP, XML, REST, SOAP, WSDL, UDDI) with JBOSS/Pramati/Glassfish/Linux servers. Track JIRA defects and checked in code to CVS and SVN repos and implemented design patterns.