Sr. Hadoop Developer Resume
N, A
SUMMARY
- Over 5 years of Professional IT experience which includes 4+ years of experience as a Hadoop Developer.
- Strong Knowledge onHadooparchitecture and various components such asHDFS Job Tracker Task Tracker, Name Node, Data NodeandMapReduceprogramming.
- Real - time experience in installing, configuring and using Hadoop ecosystem components like HadoopMapReduce, HDFS, HBase, Hive, Impala, Pig, Zookeeper,Flume and Sqoop.
- Good Exposure on developing HadoopMap Reduceprogramming in java for data cleaning and preprocessing.
- Analyzed data by performing HIVE querying (HiveQL) and running PIG scripts (PIG Latin).
- Hands on experience in HIVE. Creating Internal and External tables, Partitioning tables, bucketing tables in Hive.
- Schedule jobs using Oozie workflows.
- Good experience on Cloudera distributions and Hadoop environments.
- Hands on experience in UNIX.
- Hands on experience in various Databases which includeOracle, DB2, Netezza, PostgreSQL, SQLServer andMy SQLdatabase.
- Excellent understanding and knowledge of NoSQL databases likeHBase.
- Knowledge on complete Software Development life cycle(SDLC) like analysis, design, development, testing and implementation of Client Server andWeb applications.
- Knowledge in developing User Interface applications using HTML, JavaScript.
- Used Rational Rose to design UML diagrams (Use Case Diagrams, Class diagrams and Sequence diagrams).
- Developed Java Applications using advanced Java concepts like Servlets, JDBC, JavaScript.
- Hands on experience on Autosys scheduling tool.
- Hands on experience in IDE tools like Eclipse, Visual Studio.
- Excellent problem-solving skills, high analytical skills, good communication and interpersonal skills.
TECHNICAL SKILLS
Big Data Ecosystem: Hadoop, HDFS, MapReduce, Pig, Hive, Impala, Flume, Sqoop, Zookeeper, Oozie, Spark, Hue.
Environments: Linux, Unix, Windows XP
Languages: C, C++, Java, SQL, Javascript.
Database: Oracle, HBASE, Netezza, DB2, PostgreSQL, My SQL and SQL Server.
Tools: Eclipse, Autosys, HP Application Lifecycle Management, UFT, ARD, EggPlant, Mainframe tool Rumba.
PROFESSIONAL EXPERIENCE
Confidential, N.A
Sr. Hadoop Developer
Responsibilities
- Requirement Study and Creation of designs and developing models to deal with the large customer database.
- Using Pig and Hive queries created simple to complex map reduce jobs.
- Used Pig Latin to analyze data and perform transformation according to business requirements.
- Developed Hive Queries to analyze the delinquency history and retrieve the offers from the Offer Utility.
- Created UDF’s using Java in both PIG and HIVE.
- Performed various transformations using Hive, MapReduce on the data that is imported from various sources and loaded the data into HDFS and finally extracted the data from MySQL into HDFS using Sqoop.
- Dynamic Partitions, Bucketing and Compression techniques are implemented in Hive external tables to improve the query performance.
- Ran the jobs from mainframe systems to enable the customer to perform payments.
- Used Spark streaming to import data from Kafka into HBase.
- DevelopedOozieworkflow for scheduling jobs as and when necessary.
- Developed and executed test scripts as a part of Unit testing.
Environment: Java, SQL, Hadoop, MapReduce, HDFS, Hive, Pig, Sqoop, Flume, Oozie, Spark, Kafka, Cloudera Manager, HBase, Eclipse and Unix/Linux.
Confidential, N.A
Hadoop Developer
Responsibilities:
- Involved in review of functional and non-functional requirements.
- Performed data ingestion using Flume.
- Imported data usingSqoopto load data fromMySQLto HDFS on regular basis.
- Involved in creating tables, dropping and altered at run time without blocking updates and queries using HBase and Hive.
- Analyzed and transformed data using Pig Latin.
- Created UDFs using java in PIG.
- WrittenHive queriesfor data analysis to meet the business requirements.
- CreatedHive tablesand worked on them usingHive QL.
- Analyzed the daily reports generated while data transfer.
- Reviewed the Hadoop logs on daily basis.
- Involved in status meetings on daily basis to discuss the progress of the project.
Environment: Apache Hadoop, Hive, Map Reduce, Pig, HBase, Sqoop, Oozie, Linux, Java.
Confidential
Java Developer
Responsibilities:
- Involved in analysis, design, development and maintenance of the web application.
- Involved in detailed design and development of use cases and various diagrams using UML which include Class, Sequence and use case diagrams.
- Developed the wen interface using HTML and CSS.
- Used servlets for client server request and responses.
- Used JDBC connectivity to enable the server to respond to the client with accurate data.
- Worked with Model- View- Controller architecture.
- Stored data in Oracle DB.
- Performed duties as a project SPOC and made sure team accomplished the task on time.
Environment: HTML, XML, Java Script, Java, J2SE, Servlets, JSP, Tomcat Server, SQL Server, Eclipse.