Bigdata developer

TECHNICAL SKILLS:

Tools/IDE: Hadoop/Big Data HDFS, MapReduce, HBase, Pig, Hive, Sqoop, SparkScala,Kafka, Zookeeper,Impala, flume, Storm, Oozie MongoDB and Cassandra.

Methodologies: Agile, UML, Design Patterns (JavaSE and J2EE)

Programming: Java, J2EE, XML, Unix Shell scripting, HTML.

Java/J2EE Technologies: JDBC, JSON, JSTL, RMI, JMS, Java Script, JSP, Servlets, EJBJSF, jQuery.

Operating Systems: Windows 7/8/10, UNIX, Linux, Ubuntu, Mac

PROFESSIONAL EXPERIENCE:

Confidential

Bigdata developer

Responsibilities:

Be a trusted technical advisor to customers and solve complex Cloud technical challenges
Create and deliver best practice recommendations, tutorials, blog articles, sample code, and technical presentations adapting to the different levels of key business and technical stakeholders.
Worked on Hadoop cluster scaling from 4 nodes in development environment to 8 nodes in pre - production stage and up to 24 nodes in production.
Involved in complete Implementation lifecycle, specialized in writing custom MapReduce, Pig and Hive programs.
Involved in loading and transforming large sets of structured, semi structured and unstructured data from relational databases into HDFS using Sqoop imports.
Developed Sqoop scripts to import export data from relational sources and handled incremental loading on the customer, transaction data by date.
Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.
Extensively used Hive/HQL or Hive queries to query or search for a particular string in Hive tables in HDFS.
Experience in developing customized UDF's in java to extend Hive and Pig Latin functionality.
Created HBase tables to store various data formats of data coming from different sources.
Good knowledge on building Apache spark applications using Scala.
Performed advanced procedures like text analytics and processing, using the in-memory computing capabilities of Spark using Scala
Used Apache Oozie for scheduling and managing the Hadoop Jobs. Knowledge on HCatalog for Hadoop based storage management.
Expert in creating and designing data ingest pipelines using technologies such as spring Integration, Apache Storm-kafka
Dumped the data from HDFS to MYSQL database and vice-versa using SQOOP

Confidential

Senior Java developer

Responsibilities:

Used AGILE methodology for developing the application.
As part of the lifecycle development prepared class model, sequence model and flow diagrams by analysing Use cases using Rational Tools.
Extensive use of SOA Framework for Controller components and view components.
Involved in writing the exception and validation classes using Struts validation rules.
Involved in writing the validation rules classes for general server side validations for implementing validation rules as part observer J2EE design pattern.
Used OR mapping tool Hibernate for the interaction with database. Involved in writing Hibernate queries and to specific configuration and mapping files.
Developed EJB tier using Session Facade, Singleton and DAO design patterns, which contains business logic, and database access functions.
Developed web services using SOAP and WSDL with Apache Axis 2.
Developed SQL stored procedures and prepared statements for updating and accessing data from database
Used Jenkins to deploy JAR
Used JUNIT for testing and check API performance. Involved in fixing bugs and minor enhancements for the front-end modules. Responsible for troubleshooting issues, monitoring and guiding team members to deploy and support the product.
Used GIT Version Control for Project Configuration Management.
Fine tuning SQL queries for maximum efficiency to improve the performance

We provide IT Staff Augmentation Services!

We'd love your feedback!

Resume Categories

Client Services

Job Seekers

Visa Sponsorship