Hadoop Developer Resume
Houston, TX
SUMMARY:
- 9 years of experience in a variety of industries, which includes hands on experience in Big Data technologies.
- In - depth knowledge on Hadoop framework/architecture and eco-system components like Hive, Pig and Sqoop.
- Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice-versa.
- Experience in analyzing large data sets using HiveQL and MapReduce programs efficiently.
- Experience in Hadoop Shell and MapReduce programs.
- Experience in handling structured arrangement of data using Partitions and Bucketing in Hive.
- Hands on experience in application development using Java and Unix shell.
- Strong experience with ingestion, storage, querying, processing and analysis of big data.
- Involved in the analysis, design, coding and testing as per the client requirement.
- Experience in data analysis using HiveQL, Pig Latin, HBase and custom Map Reduce programs in Java.
- Good understanding of NoSQL database HBase.
- Very good experience in complete project life cycle (design, development, testing and implementation).
- Worked in large and small teams for systems requirement, design & development.
- Key participant in all phases of Confidential life cycle including application coding, configuring, testing, production support & maintenance projects.
- Experience in using IDEs like Eclipse, PLSQL Developer.
- Strong team player with good communication, analytical, presentation and inter-personal skills.
- Ability to quickly learn and adapt to changing dynamics of projects/assignments .
SKILL:
Big Data/Hadoop Technologies: Hadoop, HDFS, MapReduce, Hive, Sqoop, Pig, Spark, Oozie, Flume.
NO SQL Databases: HBase
Languages: Core Java, SQL, HiveQL, Pig Latin, PERL, Shell Scripting, Scala.
Java technologies: Java, Web services, Spring, JDBC.
Databases: MySQL, Oracle, HBase
Scripting and Query Languages: Unix Shell Scripting, PERL, SQL
Operating Systems: UNIX, Windows, LINUX
Development Tools: Eclipse, PLSQL Developer
Billing tools: Geneva (Versions: 5.3), Infinys RBM (2.2, 4.0, 4.3)
EXPERIENCE:
Hadoop Developer
Confidential, Houston, TX
Responsibilities:
- Working for Customer Knowledge & Insights - Real-time Analytics
- Selecting and integrating Big Data tools and frameworks required to provide requested capabilities.
- Implementation of Big data infrastructure and technologies and dataflow processes including data extraction and ETL processes to populate Data Lake.
- Builds and architect next-generation Big Data analytics framework developed on a group of core technology.
- Working with Data Scientists to ensure availability of needed data sets.
- Codes, tests, and documents new or modified data systems to create robust and scalable applications for data analytics.
- Understands customer's business needs and translate needs into IT specific requirements.
- Apply knowledge of the customer's functions and processes to develop business case and business requirement documents.
- Demonstrate knowledge of all key business functions in the enterprise and the technologies supporting and integrating them.
- Worked on analyzing Hadoop cluster using different big data analytic tools including Hive, Pig and MapReduce.
- Importing and exporting data into HDFS and Hive using Sqoop.
- Hands on experience in HiveQL.
- Involved in loading data from LINUX file system to HDFS.
- Processed the raw data using Hive jobs.
- Implemented Partitioning, Dynamic Partitions, Buckets in Hive.
- Implemented test scripts to support test driven development and continuous integration.
- Actively involved in code review and bug fixing for improving the performance.
- Involved in development, building, testing, and deploy to Hadoop cluster in distributed mode.
- Created HBase tables to store data from different sources.
- Created Pig Latin scripts to sort, group, join and filter the enterprise wise data.
Environment : Hadoop, MapReduce, HDFS, Pig, Hive, Sqoop, HBase, Oozie, MySQL.
System Analyst
Confidential, Lake Mary, FL
Responsibilities:
- Hadoop installation, configuration of multiple nodes in Cloudera Platform.
- Setup and optimize Stand-alone/Psuedo-Distributed/Distributed clusters.
- Develop simple to complex MapReduce jobs.
- Analyzing data with Hive, Pig.
- Handled importing of data from data sources, performed transformations using Hive and loaded data into HDFS.
- Extracted data from RDBMS into HDFS using Sqoop analyzed the data by performing Hive queries and running Pig scripts to study customer behavior.
- Load data from Linux file system into HDFS.
- Install and configure Hive and write Hive UDFs.
- Create tables, load data and write queries in Hive.
- Importing data into HDFS and Hive and vice-versa using Sqoop.
- Codes, tests, and documents new or modified data systems.
- Understand a customer's business needs and translate needs into IT specific requirements.
Environment : Hadoop, MapReduce , HDFS , Hive, HQL, SQOOP, UNIX
Software Prog/Analyst
Confidential
Responsibilities:
- Developed, tested, implemented and maintained application software working with established processes.
- Built, tested and deployed software products.
- Waterfall systems development life cycle.
- Worked closely with clients to establish problem specifications and system designs.
- Identified and resolved production and non-production application issues.
- Developed and executed unit test plans.
- Provided support for testing phase during the testing phase.
Environment : Java, web services, Spring, Oracle, Unix, Eclipse
Software Program/Analyst
Confidential
Responsibilities:
- Appointed as the Primary Contact for Confidential Wholesale Rating and Billing Operations from India center.
- Proactively worked on writing different new scripts (using Shell Scripting and PERL) like monitors for different processes and worked on modifying various existing scripts for improving the operational efficiencies.
- Running Rating and Billing for all the customers and achieved an excellent client satisfaction.
- Perform Production Readiness Test prior implementation of various patches in production.
- Wrote complex SQL statements providing back-end solutions to production issues, monitoring, and reporting.
- Maintain effective relationships with various system administrators and development teams.
- Understanding the business requirements of the client and implementing them successfully in production.
- Monitoring all the alerts and fix the problem arise during production.
- Leading various maintenance windows for various Patches in Production.
- Instrumental in resolving various complex issues which arose in Production.
- Co-ordinating among various business teams for resolving various complex issues for timely resolution.
- Provide training to various new employees and assist with expert knowledge on all production processes.
Environment: Unix Shell scripting, PERL, SQL, Oracle 9i, PLSQL Developer, Infinys RBM 4.0
Associate (Prog/Analyst)
Confidential
Environment: Unix Shell scripting, PERL, SQL, Oracle 9i, PLSQL Developer, Infinys RBM 2.2
Responsibilities:
- Proactively worked on writing different new scripts like monitors for different processes and worked on modifying various existing scripts for performance improvement.
- Assist the development and testing teams to provide timely support to reach the solutions on time.
- Performing day-to-day tasks for Rating and Billing for running the operations efficiently and effectively.
- Identifying various problems/bugs during pre- and post-production and escalate to the concerned teams for timely solutions.
- Worked on tracking various issues during pre- and post-production.
- Document all production processes and resolve all issues and answer all requests.
- Monitor all performance metrics for various production systems and identify root cause for all technical issues and recommend solutions.
- Leading the maintenance windows for patch application.
- Instrumental in successful day-to-day smooth operations in production.
Associate (Prog/Analyst)
Confidential
Environment: Unix Shell scripting, SQL, Oracle 9i, PLSQL Developer, Geneva 5.3
Responsibilities:
- Performing day-to-day Rating and Billing tasks efficiently and effectively.
- Monitor all performance metrics of production system.
- Worked on maintenance windows for patch application.
