Hadoop Developer Resume
San Jose, CA
SUMMARY
- Over 8 years of professional experience in IT, including 2+ years of work experience in Hadoop Eco system.
- In depth understanding/noledge of Hadoop Architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and MapReduce concepts.
- Well versed in installation, configuration, supporting and managing of Big Data and underlying infrastructure of Hadoop Cluster.
- Hands on experience on major components in HadoopEcosystem like HadoopMap Reduce, HDFS, HIVE, PIG, HBase, Sqoop, Oozie and Flume.
- Experience with Oozie Workflow Engine in running workflow jobs with actions that run Hadoop Map/Reduce and Pig jobs.
- Experience in managing and reviewingHadoop Log files.
- Extending Hive and Pig core functionality by writing custom UDFs.
- Experience inHadoopadministration activities such as installation and configuration of clusters using Apache and Cloudera.
- Hands on experience in designing and coding web applications using Core Java and J2EE technologies.
- Experienced the integration of various data sources like Java, RDBMS, Shell Scripting, Spreadsheets, and Text files.
- Experience in Web Services using XML, HTML and SOAP.
- Excellent Java development skills using J2EE, J2SE, JUnit, JDBC and C++.
- Extensive experience in developing components using JDBC, Java, Oracle, XML and UNIX Shell Scripting.
- Ability to blend technical expertise with strong Conceptual and Analytical skills to provide quality solutions and result - oriented problem solving technique and leadership skills.
TECHNICAL SKILLS
Big-Data /Hadoop Technologies: HadoopEcosystem HDFS, Map Reduce Hive, Pig, HBase, Zookeeper, Sqoop, Oozie, Flume and Avro, Tableau.
Web Technologies: Java, JDBC, XML, AJAX, SOAP
Methodologies: Agile, UML, Design Patterns (Core Java and J2EE)
Programming Languages: Java, C++, XML, Unix Shell scripting, HTML.
Database Systems: Oracle 11g/10g, MS-SQL Server, MySQL, MS-Access
Web Services: Web Logic, Web Sphere, Apache Tomcat
Operating Systems: Windows-8/7/XP/2000/NT, UNIX, Linux (CentOS, Ubuntu), and DOS, Eclipse IDE, Visual Studio
PROFESSIONAL EXPERIENCE
Confidential, San Jose, CA
Hadoop Developer
Responsibilities:
- Successfully completed the POC and created that into a project for data migration and analysis.
- Sqooped the required business views from Teradata and loaded into respective table into hive and MapR DB.
- Developed Hive queries for the business use case and optimized the queries.
- Implemented partitioning and dynamic partitioning on hive tables for faster search.
- Benchmarked Impala to Hive on performance for the respective business use case.
- Integrated Hive table with MapR DB tables for OLTP transactions.
- Created a UI which fetches data from the MapR DB table and updates it if modified in the UI and reflect back in the search.
- Scheduled sqoop jobs for the incremental load based on the business requirement from Teradata.
- Written shell scripts for automation of the queries to a certain point in the business use case.
- Projected the results on Tableau Dashboard connected to the Hive tables and prepared reports for delivery.
- Written QA test cases as a part of Agile unit testing process for processing of data and persistence.
- Trained team members with non-hadoop background to understand the work flow and tools involved.
Environment: Teradata, Sqoop, Hive, MapR DB, Tableau, Platfora, Java, Shell scripting, Impala.
Confidential, San Diego, CA
Hadoop Developer
Responsibilities:
- Experienced with Hive queries to categorize data of different networks.
- Used Hive, Pig to perform weekly processing
- Integrated the Hive warehouse with HBase.
- Involved in loading data from LINUX file system to HDFS.Written customized Hive UDFs in Java where the functionality is too complex.
- Implemented Partitioning, Dynamic Partitions, Buckets in Hive.
- Designing and creating Hive external tables using shared Meta-store instead of derby with partitioning, dynamic partitioning and buckets.
- Responsible to manage the test data coming from different sourcesReviewing peer table creation in Hive, data loading and queries.
- Experienced in data wrangling, data Modeling, data Cleaning, mode performance & visualization
- Monitored System health and logs and respond accordingly to any failure conditions.
- Gained experience in managing and reviewing Hadoop log files.
- Involved in scheduling Oozie workflow engine to run multiple Hive and Pig jobsinvolved unit testing, interface testing, system testing and user acceptance testing of the workflow tool.
Environment: Hadoop, HDFS, Hive, Map Reduce, Core Java, Pig, MySQL, Tableau.
Confidential
Responsibilities:
- Windows Multimedia Radio Interface Layer driver is interface between MSFT-RilProxy and QCOMM-Modem.
- Involved in feature design, development, and integration and fixing bugs for WMRIL on Window Phone (C++, WIN32). Created off target and on target test cases as required.
- Involved in code development to process modem indications, IHVRIL design changes and CRs.
- Hands-on experience on WMRIL debugging with WCDMA, LTE, CDMA, WLAN, IMS on OTA, Agilent
- As bring up guy for WMRIL made device to camp on network and make voice call, sms with/without UI for all chipsets. Did for both 32bit/64bit processors much ahead of timelines.
- Owns and drives the WMRIL component integration with Continuous Integration system
- Did complex configurations on devices to camp on 3gpp, 3gpp2 networks using QCN on OTA, Agilent
- Experienced in creation and configuration of unit test automation for nightly execution on driver code.
- Involved in code development, integration and fixing bugs for MMRIL, WMRIL on Window Phone7 (C++, WIN32).
- Owns and drives the MMRIL, WMRIL component integration with Continuous Integration system
- Did Dev12 and Dev14 movement of WMRIL project transition involve making changes to code and project files with new dev compiler and WPK tools.
- Ramped up very quick on making Voice Call for new WP7 OS, less than 6 weeks.
- Reachable team member for all new development, configuration, and device setup, network camping, automation issues, log triage.
Environment: C++, Windows Phone, WOA, VS2013
Confidential, Warren, NJ
Software Engineer/Consultant
Responsibilities:
- Involved in remediating, development of the requirements for the Sync and Connect Application.
- Led the development of SnC for different targets like Android, WebOS, WM
- Analyzing and identifying the current requirements architecture, design and remediation.
- Coordinator for SyncML client implementation for Android, Windows Mobile
Environment: Android, Windows Mobile, PalmOS, Eclipse, SQLite
Confidential, Irving, TX
Software Engineer/Consultant
Responsibilities:
- SDE in SSPGUI, Development of new enhancements and CR fixing.
- Identified the root cause for the issues, fixing the code-defects, led the team of three for providing assistance to the Client team in implementing web based migration project for the same SSPGUI.
- Involved in technical write up of the root cause of the issues/ solution for the issue.
- Contributed in resolving the customer support issues in quick turnaround time.
- Involved in requirements gathering, design of new enhancements which keeps on coming quarterly basis w.r.to market plan/package, billing logic changes.
- Also part of SSPGUI support team for production environment support, involves fixing and redeployment of code within production environment.
Environment: C#, Windows GUI, SQL Server
Confidential
Senior Software Engineer/Consultant
Responsibilities:
- Worked on CCAD Features enhancement and OEM customization.
- Responsible for technical delivery for CCAD, MailMgr, Outbound calls, Voice, Email enhancements.
- Had good rapport with customers although the project development and migration
- Has worked on bringing down the defects to less than 10 in the components me own.
- Ensured all deliverables are executed across the software development life cycle.
- Worked with clients of Nortel to support CCMA, CCT, CCAD application deployment and bug fixing.
- Has used Nortel tools IDCE, Clarify, Contact Scanner, CMF Viewer, CS2001 Switch.
- Performed Unit testing, Interface testing, System testing, Regression Testing, Performance analysis and memory leak checks as an integral task
- Led the team of four with delivery responsibility of client assigned tasks.
- Travelled to Ireland to understand Nortel CCAD environment, to showcase the technical capabilities of the team and responsible for deployment of same environment at India development center.
Environment: C++, C#, JAVA, SQL Server2000, VS2003
Confidential
Senior Software Development Engineer
Responsibilities:
- Part of the bring up team and executed prototype for Next Generation Platform
- Showcased synchronization of contacts from phone to desktop application and net portal.
- Used different protocols like SyncML, OBEX, and Bluetooth to implement the solution.
- Involved in Requirements study, design, Coding, UT of synchronization of contacts, images.
- Had a very good experience in coding for socket programming and SyncML protocol in dis project and also the interface design experience which me think is crucial.
- Involved in developing the module for different phases for 7 months.
- Performed Unit testing, Interface testing, System testing, Regression Testing, Performance analysis and memory leak checks as an integral task
Environment: VC++, C#.NET, Socket Programming, VS2005, Confidential specific devices
Confidential
Senior Software Development Engineer
Responsibilities:
- Configuration Module for the Vista XPS Filter Driver based on Printer Abstraction Layer framework
- Responsible for Developing COM based Plugin using XPS path interfaces
- Implemented interfaces to Integrate with existing Confidential printer driver code
- Coded transformations of data item mappings of legacy print items to Vista specific driver required elements.
- Responsible for Development of Winfx application using C#.Net Responsible for Configuring DTM controller, Client, Cruise Control.
- Coded parsers to code/decode data elements of XAML, MSXML.3.0 print filters.
Environment: VC++, C++, COM, C#.Net, VS2005, Vista Beta2, Vista RC1
Confidential
Software Development Engineer
Responsibilities:
- The application enables pre-selling & van selling with logistics planning, collecting of data inside a store, multi-point delivery, setting and tracking of seller goals, best order suggestion, product allocation etc., with Microsoft.Net supported mobile device like Pocket PC2003.
- Responsible for Developing Synchronization module using xml templates
- Implemented client side Connection manager using TCP/IP, http, https, to synchronize data between servers and client (device) database.
- Coded UI and database layer on PPC2003 using C# CF.
- Responsible for coding SSL authorization and authentication module using EVC++
- Created system test cases, Unit Test cases, participated in design reviews, code reviews.
Environment: C# Compact Framework, Windows CE, POCKET PC SDK 2003, EVC++, Visual SourceSafe, SQL Server 2000, SQL Server CE