Hadoop Developer Resume
Houston, TX
SUMMARY
- Around 6+years of IT experience in software Development in Big Data Technologies and Analytical Solutions with2+ years of hands - on experience in development and design of Java and related frameworks and 1+ years’ experience in design, architecture, and data modeling as database developer.
- Around 2+ year’s experienceas Hadoop Developer with good knowledge of Hadoop framework, Hadoop Distributed file system and Parallel processing implementation.
- Experience in Hadoop Ecosystems HDFS, Map Reduce, Hive, Pig, HBase, Sqoop.
- Excellent understanding / knowledge of Hadoop architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and Map Reduce programming paradigm.
- Good Exposure on Apache Hadoop Map Reduce programming, Hive, PIG scripting and HDFS.
- Experience in managing and reviewing Hadoop log files.
- Hands on experience in Import/Export of data using Hadoop Data Management tool SQOOP.
- Strong experience in writing Map Reduce programs for Data Analysis. Hands on experience in writing custom practitioners for Map Reduce.
- Performed data analysis using Hive and Pig.
- Excellent understanding and knowledge of NOSQL databases like Mongo DB, HBase, and Cassandra.
- Experience with distributed systems, large-scale non-relational data stores, RDBMS, NoSQL map-reduce systems, data modeling, database performance, and multi-terabyte data warehouses.
- Experience in Software Development Life Cycle (Requirements Analysis, Design, Development, Testing, Deployment and Support).
- Hands on experience in application development using Java, RDBMS, and Linux shell scripting.
- Experience working with JAVA J2EE, JDBC, ODBC, JSP, Java Eclipse, Java Beans, EJB, Servlets.
- Experience in using IDEs like Eclipse, Net Beans and Maven.
- Development experience in DBMS like Oracle, MS SQL Server, Teradata and MYSQL.
- Strong knowledge of data warehousing, including Extract, Transform, and Load Processes.
- Hands on experience on writing Queries, Stored procedures, Functions and Triggers by using SQL.
- Support development, testing, and operations teams during new system deployments.
- Evaluate and propose new tools and technologies to meet the needs of the organization.
- An excellent team player and self-starter with good communication skills and proven abilities to finish tasks before target deadlines.
TECHNICAL SKILLS
Hadoop ECO Systems: Hadoop, MapReduce, HDFS, HBase, Hive, Pig, Sqoop, ZooKeeper.
NO SQL: Mongo DB, Cassandra
Data Bases: MS SQL Server 2000/2005/2008/2012, MY SQL, Oracle 9i/10g, MS access, Teradata TeradataV2R5
Languages: Languages Java JDK1.4 1.5 1.6 (JDK 5 JDK 6), C/C++, SQL, Teradata SQL, PL/SQL.
Operating Systems: Windows Server 2000/2003/2008, Windows XP/Vista, Mac OS, UNIX, LINUX
Java Technologies: Servlets, JavaBeans, JDBC, JNDI, JTA, JPA, E
Frame Works: Jakarta Struts 1.1, JUnit and JTest, LDAP.
IDE’s & Utilities: Eclipse, Maven, NetBeans.
SQL Server Tools: SQL Server Management Studio, Enterprise Manager, Query Analyser, Profiler, Export & Import (DTS).
WebDev. Technologies: ASP.NET, HTML,XML
Testing Tools: Bugzilla, QuickTestPro(QTP)9.2, Selenium, Quality Center, Test Link
PROFESSIONAL EXPERIENCE
Confidential, Houston, TX
Hadoop Developer
Responsibilities:
- Evaluated business requirements and prepared detailed specifications that follow project guidelines required to develop written programs.
- Responsible for building scalable distributed data solutions using Hadoop.
- Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.
- Developed Simple to complex Map reduce Jobs using Hive and Pig
- Optimized Map Reduce Jobs to use HDFS efficiently by using various compression mechanisms
- Handled importing of data from various data sources, performed transformations using Hive, MapReduce, loaded data into HDFS and Extracted the data from MySQL into HDFS using Sqoop
- Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team
- Extensively used Pig for data cleansing.
- Created partitioned tables in Hive.
- Managed and reviewed Hadoop log files.
- Involved in creating Hive tables, loading with data and writing hive queries which will run internally in MapReduce way.
- Used Hive to analyze the partitioned and bucketed data and compute various metrics for reporting.
- Installed and configured Pig and also written Pig Latin scripts.
- Developed Pig Latin scripts to extract the data from the web server output files to load into HDFS.
- Load and transform large sets of structured, semi structured and unstructured data.
- Responsible to manage data coming from different sources.
- Worked with application teams to install operating system, Hadoop updates, patches, version upgrades as required.
Environment: Hadoop, MapReduce, HDFS, Hive, Pig, Java, SQL, Sqoop, Java (jdk 1.6), Eclipse.
Confidential
Hadoop Developer
Responsibilities:
- Worked on analyzing Hadoop cluster using different big data analytic tools including Pig,Hive, and Map Reduce.
- Worked on debugging, performance tuning of Hive & Pig Jobs.
- Implemented test scripts to support test driven development and continuous integration.
- Worked on tuning the performance Pig queries.
- Involved in loading data from LINUX file system to HDFS.
- Importing and exporting data into HDFS and Hive using Sqoop.
- Experience working on processing unstructured data using Pig and Hive.
- Supported MapReduce Programs those are running on the cluster.
- Gained experience in managing and reviewing Hadoop log files.
Environment: Hadoop, HDFS, Pig, Hive, MapReduce, Sqoop, LINUX, and Big Data.
Confidential, Columbus, OH
Java/J2ee Developer
Responsibilities:
- Understanding and analysing the project requirements.
- Analysis and Design with UML and Rational Rose.
- Created Class Diagrams, Sequence diagrams and Collaboration Diagrams
- Used the MVC architecture.
- Worked on Jakarta Struts open framework.
- Developed Servlets in order to deal with requests for account activity,
- Developed Controller Servlets and Action Servlets to handle the requests and responses.
- Developed Servlets and created JSP pages for viewing on a HTML page.
- Developed the front end using JSP.
- Developed various EJB's to handle business logic.
- Designed and developed numerous Session Beans deployed on Web logic Application Server.
- Implemented Database interactions using JDBC with back-end Oracle.
- Worked on Database designing, Stored Procedures, and PL/SQL.
- Created triggers and stored procedures using PL/SQL.
- Written queries to get the data from the Oracle database using SQL.
Environment: J2EE, Servlets, JSP, Struts, Spring, Hibernate, Oracle, TOAD, Web logic Server
Confidential, Boston, MA
SQL/JAVA Developer
Responsibilities:
- Involved in complete requirement analysis, design, coding and testing phases of the project.
- Implemented the project according to the Software Development Life Cycle (SDLC).
- Developed JavaScriptbehavior code for user interaction.
- Used HTML, JavaScript, and JSP and developed UI.
- Used JDBC and managed connectivity, for inserting/querying& data management including stored procedures and triggers.
- Designed the logical and physical data model, generated DDL scripts, and wrote DML scripts for Sql Server database.
- Part of a team which is responsible for metadata maintenance and synchronization of data from database.
- Involved in the design and coding of the data capture templates, presentation and component templates.
- Developed an API to write XML documents from database.
- Used JavaScript and designed user-interface and checking validations.
- Developed JUnit test cases and validated users input using regular expressions in JavaScript as well as in the server side.
- Developed complex SQL stored procedures, functions and triggers.
- Mapped business objects to database using Hibernate.
- Wrote SQL queries, stored procedures and database triggers as required on the database objects.
Environment: Java, spring, XML, Hibernate, SQL Server, Maven2, JUnit.
Confidential
SQL Server Developer
Responsibilities:
- Actively involved in different stages of Project Life Cycle.
- Documented the data flow and the relationships between various entities.
- Actively participated in gathering of User Requirement and System Specification.
- Created new Database logical and Physical Design to fit the new business requirement and implemented the same using SQL Server.
- Created Clustered and Non-Clustered Indexes for improved performance.
- Created Tables, Views and Indexes on the Database, Roles and maintained Database Users.
- Followed and maintained standards and best practices in database development.
- Provided assistance to development teams on Tuning Data, Indexes and Queries.
- Developed new Stored Procedures, Functions, and Triggers.
- Implemented Backup and Recovery of the databases.
- Actively participated in User Acceptance Testing, and Debugging of the system.
Environment: Windows 2000 adv. server, Windows 2000/XP, MS SQL Server 2000, IIS, MS Visual Studio.
