We provide IT Staff Augmentation Services!

Hadoop Technical Lead/architect Resume

Milpitas, CA

PROFESSIONAL SUMMARY:

  • 16 year of IT experience, worked as a Big Data, Hadoop and J2EE professional across industry domains.
  • Having 5 years of experience in Big Data and Hadoop Ecosystems.
  • Strong experience with Spark, MapReduce, Confidential, Hive, Pig, Sqoop.
  • Developed streaming data using Kafka, Storm.
  • Strong experience with Linux, Python and Scala to write scripts.
  • Strong experience with Google Cloud Platform( Confidential ), Cloudera Distribution for Hadoop (CDH) and Hortonworks Data Platform(HDP).
  • Strong experience in NoSQL Databases: HBase, MongoDB, Cassandra.
  • Strong experience in Jenkins, BitBucket, GitHub, ANT and Maven tools.
  • Exposure on Amazon Web Service components like EC2, EMR, S3 etc.
  • Aggressive problem diagnosis and creative problem - solving skills.
  • Proficient in development methodologies such as Waterfall, ALM, SAFe, Scrum and Agile.
  • Strong experience in understand the key business and product objectives, how they relate to the needs of the end-users and how they translate into technical requirements.
  • Excellent experience in Splunk tool error trend for high availability apps.
  • Exposure on MapR distribution to run and execute Hadoop and Big Data scripts.
  • Exposure on R programming for big data analytics.
  • Exposure on Microsoft Azure for build, deploy and manage applications.

PROFESSIONAL EXPERIENCE:

Confidential, Milpitas, CA

Hadoop Technical Lead/Architect

Responsibilities:

  • Worked on Confidential (Google Cloud Platform) to implement Confidential ecommerce project for Kohl’s.
  • Implemented Sqoop in shell scripts to ingest data from MySQL to Confidential bucket as a raw layer.
  • Worked on project design and implemented use cases to develop hive and pig scripts.
  • Team mentoring and providing technical solutions for Confidential requirements.

Environment: Google Cloud Platform( Confidential ), Confidential, Hortonworks, MapReduce, Hive, Sqoop, Pig, Git, Gerrit, Jenkins, Agile and Scrum model, Linux Shell, Tonomi, Azkaban, MySQL, Teradata, EDW, Scala

Confidential, O’ Fallon, MO

Senior Hadoop Developer/ Architect

Responsibilities:

  • Implemented Python and Shell scripts for classification of Confidential jobs.
  • Created hive scripts and integrated with the Shell scripts.
  • Worked on Regex filters which are developed in Python to process raw data sets.
  • Involved in migrating MapReduce code into Spark to improve performance of application.
  • Developed Spark scripts in Scala language.

Environment: Confidential, Cloudera distribution, Scala, MapReduce, Spark, Hive, Sqoop, Oozie, Git, BitBucket, Jenkins, SAFe, Agile and Scrum model, RHEL and Linux Shell, Pgql, Impala, Python, AWS

Confidential, Chicago, IL |

Senior Hadoop Developer/Architect

Responsibilities:

  • Designed work flow diagrams from BGW IBM DB2 to Confidential by Sqoop import and Data load from Confidential to Hive Data base for consumption.
  • Developed Sqoop and Hive automated scripts by using Linux Schell programming.
  • Sqoop, Hive, Audit Frame work and History jobs scheduled by Zena tool.

Environment: Confidential, HDP, MapReduce, Hive, Pig, HBase, Sqoop, GitHub, Agile and Scrum model, RHEL and Linux Shell, IBM DB2, Zena Scheduler, Teradata, Talend, Hortonworks

Confidential, Bloomington, IL

Senior Big Data Developer

Responsibilities:

  • Working on data ingestion tools with Sqoop, Flume.
  • Working with HBase NoSQL database.
  • End to end development using Hive, Pig, HBase.
  • Analyzing and transforming data with Hive and Pig.

Environment: Hadoop, Cloudera, MapReduce, Hive, Impala, Pig, HBase, Sqoop, Solr, Flume, Oozie, Java

Confidential, Bloomington, IL |

Senior Big Data Developer

Responsibilities:

  • Involved in architecture design, development and implementation of Hadoop.
  • Involved in multiple POC’s at the inception state of the project.
  • Experience in defining job flows.
  • Coordinates with customers to understand the deep insights of data.
  • Used Sqoop to move the data from relational databases to Confidential .

Environment: Hadoop, Map Reduce, Cloudera, Hive, Cassandra, Pig, Sqoop, Oozie, Java, Maven, Splunk, RHEL, Java, Java, HTML, CSS

Confidential, Bloomington, IL

Lead Big Data Developer

Responsibilities:

  • Design and developed the dedup logic for different source systems using PIG scripts.
  • Developed a POC (proof Of Concept) with Talend Big Data Integration.
  • Developed multiple MapReduce jobs for data cleansing and preprocessing huge volumes of data.
  • Involved in Planning and Design by following approved life-cycle methodologies.
  • Request fulfillments for different service areas.

Environment: JDK1.6 and JDK 1.7, JSP, Spring MVC Frame work, IBM Web Sphere 6.1 Application Server, Hadoop, Confidential, Hive, Pig, MapReduce, Sqoop, Cloudera

Confidential, Iowa

Senior Java and J2EE Consultant

Responsibilities:

  • Worked on R411, R112, R212 and whole sale development and JIRA’s.
  • Involved in Designing and Preparing the Technical Specification document from the functional Specifications.
  • Involved in Analysis and Design of the Project, which is based on MVC (Model-View-Controller) Architecture and Design Patterns.
  • Developed Use Case Diagrams, Class Diagrams, Object Diagrams and Activity Diagrams using My Eclipse.

Environment: JDK1.5, JDK1.6, JSP, Spring MVC Frame work, JBoss 7.0 Application Server, Oracle 11g, Eclipse3.3, XMI, SVN 1.5 and WinMerge, JIRA, Windows 7

Confidential

Project Lead/Programmer Analyst

Responsibilities:

  • Work closely with the business team for gathering requirements Risk Analysis.
  • Designing and implementing technical solutions for new products and features.
  • Worked on business process management to identify real time business rules.

Environment: JDK1.6, JSP, Struts Frame work (MVC model), Apache Tomcat 6.0, MySQL 5.x, Eclipse3.3, AJAX, AXIS Frame work, WinCvs and WinMerge, Bugzilla, MS SQL, Linux

Confidential

Technical Lead

Responsibilities:

  • Implemented server-side coding using action and helper classes.

Environment: Java and J2EE, Struts, Java Script, Web logic 10.0, Eclipse3.3, Oracle, WinCVS

Confidential, Sacramento, CA

System Analyst

Responsibilities:

  • Worked with Higher level management to understanding of all the services and provide the estimates.
  • Participated actively in Agile methodologies (discussions, reviews, demos and scrums).
  • Worked on BItools to update the data.
  • Analysis of complex problems.

Environment: CRD tools, BItools, Oracle 9.2 and Batch update tools and Windows

Confidential

System Analyst (Team Lead)

Responsibilities:

  • Designing and implementing technical solutions for new products and features.
  • Worked closely with team members from across all functions.
  • Implementing features in a manner which is robust, efficient and readable.

Environment: JDK1.5/Swing, Forte5.2.1.19, Web logic 9.2, Oracle 9.2, Eclipse3.1, WinCvs, WinMerge, Spring Frame work, beyond compare, f2jwrapper tool, Linux

Confidential

Sr. Software Engineer

Responsibilities:

  • Coding and code review.
  • Controlling build release and source merging.

Environment: Windows XP, Eclipse3.0, Java5.0, Java Socket Programming, JSF, jsp, Sybase, html, dhtml, WinCvs and Tomcat 5.0

Confidential

Senior Software Engineer

Responsibilities:

  • Handling HyperJaxb tool and Coding.
  • Code review.

Environment: Windows XP, Eclipse3.0, J2sdk1.4, Java Socket Programming, HyperJaxb, XML, XML Spy, Spring, Hibernate3, Quartz and WinCVS

Confidential

Senior Software Engineer

Responsibilities:

  • Design and Development.
  • Implementing business logic by using Beans.

Environment: Windows 2000 Prof., Struts1.1, IntelliJ IDEA 4.0.3, J2sdk1.4, JSP, Servlets, Html, Dhtml, Weblogic8.1, WinCvs, Live link, IE5.0, TOAD and Oracle 8i

Confidential

Senior Software Engineer

Responsibilities:

  • Implementing business logic by using Beans.
  • Unit testing and Integration testing of Module.

Environment: Windows 2000 Prof., IntelliJ IDEA 4.0.3, J2sdk1.4, JSP, Servlets, Html, Dhtml, JavaScript

Hire Now