We provide IT Staff Augmentation Services!

Senior Hadoop Developer Resume

3.00/5 (Submit Your Rating)

San Ramon, CaliforniA

SUMMARY:

  • More than 10+ years in the software industry and worked with major MNCs and midsized employers.
  • Recently got through DE - 575(one of the difficult Cloudera examination)
  • Possess hands on experience and great level of understanding of the big data platform like Hadoop and related tools/implementations like MapReduce, PIG, HIVE, NoSQL (HBase), ZooKeeper, Oozie, Sqoop, FLUME etc.
  • Possess hand on experience with Cloudera- Commercial hadoop distribution.
  • Experience with Setup, Management and Troubleshooting of Hadoop clusters.
  • Possess strong Technical/Architecture skills. Worked with the major languages- JAVA, C#
  • Good aptitude and excellent Problem solving skills. Always been a ‘go to person’ in the team when it comes to resolving complex issues.
  • Spent quite a bit of time with Healthcare domain projects involving HIPAA EDI data exchanges. Hence possess good understanding of the US healthcare ecosystem.
  • Exceptional analytical skill.
  • Good team player and a quick learner.

TECHNICAL SKILLS:

Operating System: LINUX(Ubuntu), UNIX, Windows

Shell Scripting: UNIX shell scripting, MS-DOS

IDEs: Eclipse, NetBeans, MS Visual Studio

Programming Languages/Technologies: Java, MVC, Web Services, Java Script, JQuery, C#, Mono for android

Databases & Tools: PL/SQL, NoSQL (HBase), MySQL, MS-SQL Server 7.0/ 2000/ 2005/2008 , MS-ACCESS and Oracle9i, SQL Server Integration Services (SSIS), SQOOP, SQL Server Analysis Services.

Big Data Platform/Tools: Hadoop, MapReduce, PIG, HIVE, FLUME, Sqoop, HBase, ZooKeeper, Oozie

TDD Framework: MRUnit, MSUnit

Tools: Subversion, CVS, Maven, ANT, SoapUI, Jenkins

Hadoop Distributions: Cloudera (CDH v5.x)

Versioning Tool: Visual Source Safe (VSS), Clear Case and TFSReporting Tools Crystal Reports 10.0, Data Reports

PROFESSIONAL EXPERIENCE:

Confidential, San Ramon, California

Senior Hadoop Developer

Responsibilities:

  • Hold frequent meetings with the business and related stakeholders to go over the requirement and the feasibility.
  • Responsible for setting up multi-node cluster, cluster maintenance, adding and removing cluster nodes, cluster monitoring and troubleshooting, manage and review data backups, manage and review Hadoop log files.
  • Handled ETL’ing data from various data sources, performed transformations using Hive, MapReduce, loaded data into HDFS and Extracted the data from Teradata into HDFS using Sqoop.
  • Analyzed the data by performing Hive queries and running Pig scripts to know user behavior.
  • Load and transform large sets of structured, semi structured and unstructured data.
  • Responsible for managing data coming from different sources.
  • Experience in managing Hadoop processes using Init scripts and manually
  • Experience in HDFS and Mapreduce maintenance tasks involving adding a datanode/tasktracker, checking filesystem integrity using fsck, balancing HDFS block data
  • Experience in working on production support and maintenance related projects
  • Exposure to Maven/Ant, Git along with Shell Scripting for Build & Deployment Process
  • Experience in using HCatalog for Hive, Pig and Hbase
  • Exposure to NoSQL databases Cassandra
  • Experience working on Jenkins CI
  • Experience in writing Mapreduce joins like Map-side joins using Distributed Cache API
  • Experience in planning, designing and developing applications spanning full life cycle of software development from writing functional specification, designing, implementing, documentation, unit testing and support.
  • Perform analysis on the Data based on the requirement given by the business.
  • Hold meeting with the Business team to get to know about their expectations and look for possibilities to exceed it all the time.
  • Designing, developing, coding, testing of new use cases and making changes to the existing ones.
  • Plan for deployment.

BI Pro Environment: Hadoop, Eclipse IDE, JDK, MapReduce, Hive, Sqoop, PIG, FLUME, Sqoop, Oozie, Linux

Database & Tools: SQL Server 2010.

Confidential, San Francisco, California

Senior Hadoop Developer

Responsibilities:

  • Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.
  • Implemented best income logic using Pig scripts.
  • Participate in requirement gathering and analysis phase of the project in documenting the business requirements by conducting workshops/meetings with various business users.
  • Managing and scheduling Jobs on a Hardtop cluster using Oozie.
  • Involved in moving all log files generated from various sources to HDFS for further processing through Flume.
  • Involved in loading data from UNIX file system to HDFS.
  • Worked on Hue interface for querying the data.
  • Created Hive tables to store the processed results in the intended format.
  • Created HBase tables to store variable data formats of data coming from different portfolios.
  • Involved in transforming data from Mainframe tables to HDFS, and HBASE tables using Sqoop and Pentaho Kettle.
  • Developed Simple to complex Map/reduce Jobs using Hive and Pig
  • Optimized Map/Reduce Jobs to use HDFS efficiently by using various compression mechanisms
  • Handled importing of data from various data sources, performed transformations using Hive, MapReduce, loaded data into HDFS and Extracted the data from MySQL into HDFS using Sqoop
  • Analyzed the data by performing Hive queries and running Pig scripts to study customer behavior
  • Used UDF's to implement business logic inHadoop
  • Implemented test scripts to support test driven development and continuous integration.
  • Responsible to manage data coming from different sources.
  • Experienced on loading and transforming of large sets of structured, semi structured and unstructured data.
  • Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.
  • Have deep and thorough understanding of ETL tools and how they can be applied in a Big Data environment.

Environment: Java, Eclipse, Hadoop, Map Reduce, HDFS, Sqoop, FLUME, Oozie, HBASE, WinScp, LINUX, UNIX Shell Scripting, HIVE, PIG, ZooKeeper, Cloudera(Hadoop distribution)

Confidential, San Francisco, California

Senior Developer

Responsibilities:

  • Architecting and developing EPAI outbound QA automation solution.
  • Drafted the conceptual, logical, and physical model for the solution.
  • Came out successfully with the solution besides the tight deadline for delivering the same.
  • Did the coding with efficiency and conformance to SFHPs coding standard.
  • Developed reusable tools for configuring trading partners, test cases and the mapping between the two.
  • Simultaneously unit tested the module as and when they were completed.
  • Designed and developed web application using HTML, CSS, JQuery, Struts, Tag libraries.
  • Used DWR (Direct Web Remoting) for browsers using java script to call java code.
  • Responsible for implementing Struts validation and Action classes.
  • Developed all the application modules based on Spring IOC pattern.
  • Developed Hibernate ORM mapping and wrote JPA queries.
  • Worked on frameworks that use Maven dependencies.
  • Worked on SQL scripts for Data Access such as selection, Insertion and Deletion of Data from Oracle Database.
  • Involved in execution of development standards and wrote several common functions and procedures to be utilized by other team members.
  • Developed Log4J logging API to log errors and messages.

Programming Languages: JQuery, Java, Apache Tomcat, Struts, Servlets, DWR, JUnit, LDAP, Active Directory, Spring, Maven, XML, Webservices, SVN, Oracle 11g C#.Net, XML, Html 5, JavaScript, XSLT, CSS, ASP.Net MVC 4, JQuery, AJAX

Database & Tools: SQL Server 2010, Redgate DB App Suite.

Confidential, Nashville

Technical Lead

Responsibilities:

  • Architecting and developing an ASP.NET 4.0 / 4.5 MVC application in C# using the MVC features, jQuery, and SQL Server 2008.
  • Requirement analysis for the new payer implementations using the IS Engine.
  • Analyzed the requirements and prepared the technical and functional specification documents for 270, 276, 274 and 278 transactions.
  • The actual IntelliSearch solution was a Web Service developed in C#. Recently it was migrated to WCF framework. It makes use of Invoke and WinHttp assemblies to talk with the WWW and then later takes the HTML and converts back to xml using XPath, XQuery. There is also a web portal developed in ASP.Net using C# and MVC 4.0 architecture, JavaScript, and CSS wherein all the credentials of the Providers which was used to log-in to the payer portals were managed.
  • The portal is a 100% MVC based solution wherein there was a clear bifurcation between the View, Data and corresponding controllers.
  • All payer wise configurations go into SQL Server 2008 DB server.
  • Successfully Designed, Developed, united tested payer implementation and also managed change requests, code defects and data configuration bugs for all real time transactions.
  • Driving the offshore development team of 10 members
  • Helped the offshore DEV team in Design, Development, and Testing for solving complex Issues.
  • Involved in Code review, release management, Production support and other high productive activities.
  • Also actively took part in developing some of innovative tools/app for IntelliSearch.
  • Managed Code Integration and Versioning of Application using SVN.
  • Prepared Test Data, Test Case document and performed unit testing and integration testing for 270
  • Recently developed a tool called IS Visualize(Win app) which is used a debugging tool to trouble shoot issues related to real-time transaction processing with IntelliSearch. It also bagged the “Innovation award” given by the Healthcare Vertical.

Programming Languages: C#.Net, Web Services, WCF, XSD, XML, Html 5, JavaScript, XSLT, CSS, ASP.Net MVC 4, JQuery, AJAX

Database & Tools: SQL Server 2008

Tools: used: Symphonia, Mozilla add-ons

Confidential

Associate - Projects

Responsibilities:

  • Analyzed the requirements and prepared the technical and functional specification documents for 270, 276, 274 and 278 transactions.
  • Incorporated 271/274/276/278 (X217, X215, X216) response business logic in C#.Net, Stored Procedures and handled transactions from and to database using ADO.Net and Microsoft Application Block SQLHelper.
  • Implemented SSIS Packages and thereby tuning the performance of 5010 payer data load (270 and 276) process from 36 hours to 12 hours for a set of 165 files.
  • Incorporated the response building logic in stored procedure using advance SQL server 2008 XML features.
  • Successfully managed the change requests, code defects and data configuration bugs for all real time transactions.
  • Helped the 5010 real time business Actuarial Team, Production Support Team and Testing Team in solving the complex Issues.
  • Managed Code Integration and Versioning of Application by Team Foundation Server(TFS).
  • Prepared Test Data, Test Case document and performed unit testing and integration testing for 270, 276 and 278(X217, X215 and X216).

Programming Languages: VB.Net,C#.Net, Web Services, Windows Services, XSD, XML, Html, JavaScript, XSLT, CSS, ASP.Net

Database & Tools: SQL Server 2008 & Sql Server Integration Services

Tools: used: Symphonia

Confidential

Technical Support Expert

Responsibilities:

  • Played the role of Technical Support Specialist for a Healthcare product called Clarus. As part of Product Support activities I engage myself in activities like getting assigned the Support tickets, analyzing them, resolving, testing and delivering it. We stay in constant touch with clients to get to know about their feedback on product usage and issue resolution.

Programming Languages: .Net 1.1, C#.NET, VB.NET, ADO.NET, VS.NET 2003, XML, XSLT, XSD, Xpath, Visual Source Safe

Database & Tools: SQL Server 2000

We'd love your feedback!