SUMMARY

• 7 years of overall IT experience and comprehensive experience in ApacheHadoopDeveloper. Expertise in writing HadoopJobs for analyzing data using Hive, Pig and Oozie.
• Good knowledge ofHadoopArchitecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and MapReduce concepts.
• Experience in working with MapReduce programs using Hadoopfor working with Big Data.
• Experience in analyzing data using Hive QL, Pig Latin and custom MapReduce programs in Java.
• Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice - versa.
• Working experience on designing and implementing complete end-to-end Hadoop Infrastructure including PIG, HIVE, Sqoop, Oozie and zookeeper.
• Experience in providing support to data analyst in running Pig and Hive queries.
• Developed Map Reduce programs to perform analysis.
• Performed Importing and exporting data into HDFS and Hive using Sqoop.
• Experience in writing shell scripts to dump the Sharded data from MySQL servers to HDFS.
• Experience in designing both time driven and data driven automated workflows using Oozie.
• Experience in building up Hadoop cluster to improve the map reduce performance.
• Experience in performance tuning the Hadoop cluster by gathering and analyzing the existing infrastructure.
• Experience in automating the Hadoop Installation, configuration and maintaining the cluster by using the tools like puppet.
• Experience in working with flume to load the log data from multiple sources directly into HDFS.
• Strong debugging and problem solving skills with excellent understanding of system development methodologies, techniques and tools.
• Good knowledge of No-SQL databases- HBASE, Cassandra and Horton works.
• Worked in complete Software Development Life Cycle (analysis, design, development, testing, implementation and support) in different application domain involving different technologies varying from object oriented technology to Internet programming on Windows NT, Linux and UNIX/ Solaris platforms and RUP methodologies.
• Familiar with RDBMS concepts and worked on Oracle 8i/9i, SQLServer 7.0., DB2 8.x/7.x
• Involved in writing shell scripts, Ant scripts for Unix OS for application deployments to production region.
• Exceptional ability to quickly master new concepts and capable of working in-group as well as independently with excellent communication skills.

TECHNICAL SKILLS

• SQL
• UNIX
• Core Java
• Hadoop
• MapReduce
• Hive
• HTML
• XML
• XPATH
• XQUERY
• XSD
• SOAP
• WSDL
• HP QC
• Unix
• MySql
• Oracle
• MS Office Suite
• Cramer 6.0
• Web logic 8.1.4.0
• Toad 9.0
• Eclipse
• SDK
• Service Fulfillment
• SDLC
• IBM RSA
• Microsoft Visio
• Telecom Domain Experience
• Agile Methodology
• Tableau
• Rapid Miner
• Subversion.

PROFESSIONAL EXPERIENCE

Confidential, Dallas, TX

Hadoop Developer

Responsibilities:

• Experience in dealing with Apache Hadoop components like HDFS, MapReduce, HiveQL, HBase, Pig, Sqoop, Ozzie, Mahout, Cassendra, Mongo db, Big Data and Big Data Analytics.
• Good understanding/knowledge of Hadoop Architecture and various components such as HDFS, JobTracker, Task Tracker, NameNode, DataNode, Secondary Namenode, and MapReduce concepts.
• Written Hive UDF to sort Structure fields and return complex data type.
• Used Maven extensively for building jar files of MapReduce programs and deployed to Cluster.
• Created POC to store Server Log data into HBase to identify System Alert Metrics
• Used Spark for test data analytics
• Analyzed the performance to identify bottlenecks.
• Extracted the data from MySQL, Oracle, Sql Server using Sqoop and loaded data into Cassandra.
• Used Cassandra nodetool to manage Cassandra cluster.
• Worked on tuning Bloom filters and configured compaction strategy based on the use case.
• Written MapReduce jobs for processing the data over Cassandra cluster.
• Familiar with Cassandra load balancing.
• Worked on Linux shell scripts for business process and loading data from different interfaces to HDFS.
• Evaluated business requirements and prepared detailed specifications that follow project guidelines required to develop the application.
• Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.
• Installed, configured Pig and also written Pig Latin scripts.
• Experienced in writing Custom UDFs in PIG.
• Created partitioned and bucketed tables in Hive.
• Involved in creating Hive internal and external tables, loading with data and writing hive queries which involves multiple join scenarios.
• Developed Pig Latin scripts to extract the data from the web server output files to load into HDFS.
• Experienced in writing Custom UDFs in PIG.
• Created partitioned and bucketed tables in Hive.
• Involved in creating Hive internal and external tables, loading with data and writing hive queries which involves multiple join scenarios.
• Developed Pig Latin scripts to extract the data from the web server output files to load into HDFS. reated Map Reduce programs in Java for parsing the crude information and populating arranging tables.
• Used Maven extensively for building MapReduce jar files and deployed it to Amazon Web Services (AWS) using EC2 virtual Servers in the cloud and Experience in build scripts to do continuous integrations systems like Jenkin
• Actualized Bland writable to consolidate various information sources into reducer to execute suggestion based reports utilizing Map Reduce programs
• Involvement in overseeing and inspecting Hadoop log files.
• Advanced Map Reduce Occupations to utilize HDFS proficiently by utilizing different compression components
• Experience with Horton works distribution of
• Setup Hadoop cluster using EC2 (Elastic MapReduce) on managed Hadoop Frame Work.
• Used S3 Bucket to store the jar's, input datasets and used DynamoDB to store the processed output from the input data set

Confidential - Chicago, IL

Hadoop Developer

Responsibilities:

• Responsible for building scalable distributed data solutions using Hadoop
• Analyze the issue and bring the insights out of data.
• Designing a sustainable data-ingestion solution to maintain data lineage for long term viability
• Data cleansing and transformations
• Setting up the big data environment to perform the analysis.
• Configuration of new Hadoop cluster using Cloudera CDH 5.2
• Created scripts to form EC2 clusters and for processing to the internal resources.
• Responsible for running Hadoop streaming jobs to process terabytes of XML's data.
• Load and transform large sets of structured, semi structured and unstructured data using Hadoop/Big Data concepts.
• Developed and delivered quality services on-time and on-budget. Solutions developed by the team use Java, XML, HTTP, SOAP, Hadoop, Pig and other web technologies.
• Installed Oozie workflow engine to run multiple Hive and Pig jobs which run independently with time and data availability
• Developed MapReduce programs to parse the raw data, populate staging tables and store the refined data in partitioned tables in the EDW.
• Created HBase tables to load large sets of structured, semi-structured and unstructured data coming from UNIX, NoSQL and a variety of portfolios.
• Enabled speedy reviews and first mover advantages by using Oozie to automate data loading into the Hadoop Distributed File System and PIG to pre-process the data.