We provide IT Staff Augmentation Services!

Senior Hadoop Developer Resume

4.00/5 (Submit Your Rating)

CaliforniA

SUMMARY:

  • More than 10+ years in the software industry and worked with major MNCs and midsized employers.
  • Recently got through DE - 575(one of the difficult Cloudera examination)
  • Possess hands on experience and great level of understanding of the big data platform like Hadoop and related tools/implementations like MapReduce, PIG, SPARK, HIVE, NoSQL (HBase), ZooKeeper, Oozie, Sqoop, FLUME etc.
  • Possess hand on experience with Cloudera- Commercial hadoop distribution.
  • Experience with Setup, Management and Troubleshooting of Hadoop clusters.
  • Possess strong Technical/Architecture skills. Worked with the major languages- JAVA, C#
  • Good aptitude and excellent Problem solving skills. Always been a ‘go to person’ in the team when it comes to resolving complex issues.
  • Spent quite a bit of time with Healthcare domain projects involving HIPAA EDI data exchanges. Hence possess good understanding of the US healthcare ecosystem.
  • Exceptional analytical skill.
  • Good team player and a quick learner.

TECHNICAL SKILLS

Operating System: LINUX(Ubuntu), UNIX, Windows

Shell Scripting: UNIX shell scripting, MS-DOS

IDEs: Eclipse, NetBeans, MS Visual Studio

Programming Languages/Technologies: Java, MVC, Web Services, Java Script, JQuery, C#, Mono for android

Databases & Tools: PL/SQL, NoSQL (HBase), MySQL, MS-SQL Server 7.0/ 2000/ 2005/2008, MS-ACCESS and Oracle9i, SQL Server Integration Services (SSIS), SQOOP, SQL Server Analysis Services.

Big Data Platform/Tools: Hadoop, MapReduce, PIG, SCALA, SPARK Streaming, HIVE, FLUME, Sqoop, HBase, ZooKeeper, Oozie

TDD Framework: MRUnit, MSUnit

Tools: Subversion, CVS, Maven, ANT, SoapUI, Jenkins

Hadoop Distributions: Cloudera (CDH v5.x)

Versioning Tool: Visual Source Safe (VSS), Clear Case and TFS

Reporting Tools: Crystal Reports 10.0, Data Reports

PROFESSIONAL EXPERIENCE

Confidential, California

Senior Hadoop Developer

Roles and Responsibilities:

  • Hold frequent meetings with the business and related stakeholders to go over the requirement and the feasibility.
  • Responsible for setting up multi-node cluster, cluster maintenance, adding and removing cluster nodes, cluster monitoring and troubleshooting, manage and review data backups, manage and review Hadoop log files.
  • Handled ETL’ing data from various data sources, performed transformations using Hive, MapReduce, loaded data into HDFS and Extracted the data from Teradata into HDFS using Sqoop.
  • Analyzed the data by performing Hive queries, SPARK and running Pig scripts to know user behavior.
  • Load and transform large sets of structured, semi structured and unstructured data.
  • Responsible for managing data coming from different sources.
  • Experience in managing Hadoop processes using Init scripts and manually
  • Experience in HDFS and Mapreduce maintenance tasks involving adding a datanode/tasktracker, checking filesystem integrity using fsck, balancing HDFS block data
  • Experience in working on production support and maintenance related projects
  • Exposure to Maven/Ant, Git along with Shell Scripting for Build & Deployment Process
  • Experience in using HCatalog for Hive, Pig and Hbase
  • Exposure to NoSQL databases Cassandra
  • Experience working on Jenkins CI
  • Experience in writing Mapreduce joins like Map-side joins using Distributed Cache API
  • Experience in planning, designing and developing applications spanning full life cycle of software development from writing functional specification, designing, implementing, documentation, unit testing and support.
  • Perform analysis on the Data based on the requirement given by the business.
  • Hold meeting with the Business team to get to know about their expectations and look for possibilities to exceed it all the time.
  • Designing, developing, coding, testing of new use cases and making changes to the existing ones.

BI Pro Environment: Hadoop, Eclipse IDE, JDK, MapReduce, Hive, Sqoop, PIG, FLUME, Sqoop, Oozie, Linux

Confidential, San Francisco, California

Responsibilities:

  • Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.
  • Implemented best income logic using Pig scripts.
  • Participate in requirement gathering and analysis phase of the project in documenting the business requirements by conducting workshops/meetings with various business users.
  • Managing and scheduling Jobs on a Hardtop cluster using Oozie.
  • Involved in moving all log files generated from various sources to HDFS for further processing through Flume.
  • Involved in loading data from UNIX file system to HDFS.
  • Worked on Hue interface for querying the data.
  • Created Hive tables to store the processed results in the intended format.
  • Created HBase tables to store variable data formats of data coming from different portfolios.
  • Involved in transforming data from Mainframe tables to HDFS, and HBASE tables using Sqoop and Pentaho Kettle.
  • Developed Simple to complex Map/reduce Jobs using Hive and Pig
  • Optimized Map/Reduce Jobs to use HDFS efficiently by using various compression mechanisms
  • Handled importing of data from various data sources, performed transformations using Hive, MapReduce, loaded data into HDFS and Extracted the data from MySQL into HDFS using Sqoop
  • Analyzed the data by performing Hive queries and running Pig scripts to study customer behavior
  • Used UDF's to implement business logic inHadoop
  • Implemented test scripts to support test driven development and continuous integration.
  • Responsible to manage data coming from different sources.
  • Experienced on loading and transforming of large sets of structured, semi structured and unstructured data.
  • Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.
  • Have deep and thorough understanding of ETL tools and how they can be applied in a Big Data environment.

Environment: Java, Eclipse, Hadoop, Map Reduce, HDFS, Sqoop, FLUME, Oozie, HBASE, WinScp, LINUX, UNIX Shell Scripting, HIVE, PIG, ZooKeeper, Cloudera(Hadoop distribution)

Confidential, San Francisco, California

Senior Developer

Roles and Responsibilities:

  • Architecting and developing EPAI outbound QA automation solution.
  • Drafted the conceptual, logical, and physical model for the solution.
  • Came out successfully with the solution besides the tight deadline for delivering the same.
  • Did the coding with efficiency and conformance to SFHPs coding standard.
  • Developed reusable tools for configuring trading partners, test cases and the mapping between the two.
  • Simultaneously unit tested the module as and when they were completed.
  • Designed and developed web application using HTML, CSS, JQuery, Struts, Tag libraries.
  • Used DWR (Direct Web Remoting) for browsers using java script to call java code.
  • Responsible for implementing Struts validation and Action classes.
  • Developed all the application modules based on Spring IOC pattern.
  • Developed Hibernate ORM mapping and wrote JPA queries.
  • Worked on frameworks that use Maven dependencies.
  • Worked on SQL scripts for Data Access such as selection, Insertion and Deletion of Data from Oracle Database.
  • Ingested Data about Provider QOS data into the Hadoop platform and performed extensive analytics to come up with result that talks about Provider Practice Improvement metrics and pointers.
  • Involved in execution of development standards and wrote several common functions and procedures to be utilized by other team members.
  • Developed Log4J logging API to log errors and messages.

Programming Languages: JQuery, Java, Hadoop, HIVE,PIG, FLUME, SPARK Apache Tomcat, Struts, Servlets, DWR, JUnit, LDAP, Active Directory, Spring, Maven, XML, Webservices, SVN, Oracle 11g, XML, Html 5, JavaScript, XSLT, CSS, MVC 4, JQuery, AJAX

Confidential, Nashville, USA

Technical Lead

Responsibilities:

  • Architecting and developing an MVC application using the MVC features, jQuery, and SQL Server 2008.
  • Requirement analysis for the new payer implementations using the IS Engine.
  • Analyzed the requirements and prepared the technical and functional specification documents for 270, 276, 274 and 278 transactions.
  • The actual IntelliSearch solution was a Windows Service developed in java. Recently it was migrated to WCF framework. It talks with the WWW and then later takes the HTML and converts back to xml using XPath, XQuery. There is also a web portal developed based on MVC architecture, JavaScript, and CSS wherein all the credentials of the Providers which was used to log-in to the payer portals were managed.
  • The portal is a 100% MVC based solution wherein there was a clear bifurcation between the View, Data and corresponding controllers.
  • All payer wise configurations go into SQL Server 2008 DB server.
  • Successfully Designed, Developed, united tested payer implementation and also managed change requests, code defects and data configuration bugs for all real time transactions.
  • Driving the offshore development team of 10 members
  • Helped the offshore DEV team in Design, Development, and Testing for solving complex Issues.
  • Involved in Code review, release management, Production support and other high productive activities.
  • Also actively took part in developing some of innovative tools/app for IntelliSearch.
  • Involved in bringing up Hadoop environment for a pioneer project for the first time in the client premises and helped them analyze large scale X12 transaction data and come up with intelligence data to take the business to new direction and set foot in new areas.
  • Managed Code Integration and Versioning of Application using SVN.
  • Prepared Test Data, Test Case document and performed unit testing and integration testing for 270
  • Recently developed a tool called IS Visualize(Win app) which is used a debugging tool to trouble shoot issues related to real-time transaction processing with IntelliSearch. It also bagged the “Innovation award” given by the Healthcare Vertical.

Programming Languages/ Tools: Java, Maven, Eclipse, Hadoop, HIVE, FLUME, Windows Services, WCF, XSD, XML, Html 5, JavaScript, XSLT, CSS, MVC 4, JQuery, AJAX

Confidential

Associate - Projects

Roles and Responsibilities

  • Analyzed the requirements and prepared the technical and functional specification documents for 270, 276, 274 and 278 transactions.
  • Incorporated 271/274/276/278(X217, X215, X216) response business logic in C#.Net, Stored Procedures and handled transactions from and to database using ADO.Net and Microsoft Application Block SQLHelper.
  • Implemented SSIS Packages and thereby tuning the performance of 5010 payer data load (270 and 276) process from 36 hours to 12 hours for a set of 165 files.
  • Incorporated the response building logic in stored procedure using advance SQL server 2008 XML features.
  • Successfully managed the change requests, code defects and data configuration bugs for all real time transactions.
  • Helped the 5010 real time business Actuarial Team, Production Support Team and Testing Team in solving the complex Issues.
  • Managed Code Integration and Versioning of Application by Team Foundation Server(TFS).
  • Prepared Test Data, Test Case document and performed unit testing and integration testing for 270, 276 and 278(X217, X215 and X216).

Programming Languages: VB.Net,C#.Net, Web Services, Windows Services, XSD, XML, Html, JavaScript, XSLT, CSS, ASP.Net

Confidential

Technical Support Expert

Responsibilities:

  • Cver 30 applications involving clinical and financial solutions delivers a complete integrated solution, which includes the Electronic Patient Record, Financial, Clinical, Ancillary, Home Health and health clinic integration. Having taken the size of the Project into consideration, it has lot of functionalities and a big process flow with a customer count of more than 20 in various states of U.S.
  • Clarus was developed to meet the need for a HIPAA-ready integrated system that comprised a full complement of financial, clinical and departmental applications in a native Windows® environment, centered on an enterprise-wide Master Patient Index (EMPI).
  • Played the role of Technical Support Specialist for a Healthcare product called Clarus. As part of Product Support activities I engage myself in activities like getting assigned the Support tickets, analyzing them, resolving, testing and delivering it. We stay in constant touch with clients to get to know about their feedback on product usage and issue resolution.

Programming Languages: .Net 1.1, C#.NET, VB.NET, ADO.NET, VS.NET 2003, XML, XSLT, XSD, Xpath, Visual Source Safe

Confidential

Software Engineer

Responsibilities:

  • Involved in gathering Business Requirements and preparing functional and technical specification and System Design document for UHS.
  • Preparing the document for all business analysis algorithms for UHS.
  • Designed and documented flows and functional diagrams using Visio
  • Designed and implemented user-interface using XML and custom build page generator application.
  • Incorporated business logic Stored Procedures and handled transactions from and to database.
  • Involved in Unit test cases preparation and performed unit testing and integration testing.
  • Deployment of Application on Test and Production Server

Programming Languages: XML, SQL Server, C#.NET, JSP, NT Service, Visual Source Safe.

Confidential

Developer/ Team Member

Roles and Responsibilities

  • Involved in regular project meetings for project and issue discussion.
  • Developed the GUI interface using C#.Net
  • Clarus as such was purely a suite of windows based applications catering to the needs of a typical mid-sized healthcare provider. In other words, it’s like a healthcare ERP product.
  • Incorporated business logic into the Application using C#.Net and Procedures using SQL Server 2005
  • Developed Business Objects using Crystal Reports.
  • Analysed, developed and fixed and major issue that were raised from the client end.
  • Involved in Unit test cases preparation and performed unit testing and integration testing.

Programming Languages: .Net 1.1, ASP.NET, C#.NET, VB.NET, ADO.NET, Winforms,VS.NET 2003, VSS & UML.

Confidential

Developer/ Team Member

Responsibilities:

  • RIS receives orders from the Order Management application and enables technologists and radiologists to process imaging studies efficiently in both film-based and film-less environments.
  • Results are seamlessly sent back to the patient’s electronic medical record and charges flow automatically to the patient’s bill.
  • Clarus as such was purely a suite of windows based applications catering to the needs of a typical mid-sized healthcare provider. In other words, it’s like an healthcare ERP product
  • Involved in regular project meetings for project and issue discussion.
  • Developed the GUI interface using C#.Net
  • Incorporated business logic into the Application using C#.Net and Procedures using SQL Server 2005
  • Developed Business Objects using Crystal Reports.
  • Analyzed, developed and fixed and major issue that were raised from the client end.
  • Involved in Unit test cases preparation and performed unit
  • Developed a web based Reporting portal for radiologist and integrated that with Clarus Healthcare Suite. They can extract all Business intelligence related details from this portal by browsing through various reports built using Crystal reports ranging from Orders by physician, by Specialty, by radiologists etc.

Programming Languages: .Net 1.1, VB.NET, WinForms, ADO.NET, VS.NET 2003, ASP

We'd love your feedback!