Hadoop Developer Resume
San Jose, CA
SUMMARY
- Over 8 years of professional experience in IT, including 2+ years of work experience in Hadoop Eco system.
- In depth understanding/knowledge of Hadoop Architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and MapReduce concepts.
- Well versed in installation, configuration, supporting and managing of Big Data and underlying infrastructure of Hadoop Cluster.
- Hands on experience on major components in HadoopEcosystem like HadoopMap Reduce, HDFS, HIVE, PIG, HBase, Sqoop, Oozie and Flume.
- Experience wif Oozie Workflow Engine in running workflow jobs wif actions that run Hadoop Map/Reduce and Pig jobs.
- Experience in managing and reviewingHadoop Log files.
- Extending Hive and Pig core functionality by writing custom UDFs.
- Experience inHadoopadministration activities such as installation and configuration of clusters using Apache and Cloudera.
- Hands on experience in designing and coding web applications using Core Java and J2EE technologies.
- Experienced teh integration of various data sources like Java, RDBMS, Shell Scripting, Spreadsheets, and Text files.
- Experience in Web Services using XML, HTML and SOAP.
- Excellent Java development skills using J2EE, J2SE, JUnit, JDBC and C++.
- Extensive experience in developing components using JDBC, Java, Oracle, XML and UNIX Shell Scripting.
- Ability to blend technical expertise wif strong Conceptual and Analytical skills to provide quality solutions and result - oriented problem solving technique and leadership skills.
TECHNICAL SKILLS
Big-Data /Hadoop Technologies: HadoopEcosystem HDFS, Map Reduce Hive, Pig, HBase, Zookeeper, Sqoop, Oozie, Flume and Avro, Tableau.
Web Technologies: Java, JDBC, XML, AJAX, SOAP
Methodologies: Agile, UML, Design Patterns (Core Java and J2EE)
Programming Languages: Java, C++, XML, Unix Shell scripting, HTML.
Database Systems: Oracle 11g/10g, MS-SQL Server, MySQL, MS-Access
Web Services: Web Logic, Web Sphere, Apache Tomcat
Operating Systems: Windows-8/7/XP/2000/NT, UNIX, Linux (CentOS, Ubuntu), and DOS, Eclipse IDE, Visual Studio
PROFESSIONAL EXPERIENCE
Confidential, San Jose, CA
Hadoop Developer
Responsibilities:
- Successfully completed teh POC and created that into a project for data migration and analysis.
- Sqooped teh required business views from Teradata and loaded into respective table into hive and MapR DB.
- Developed Hive queries for teh business use case and optimized teh queries.
- Implemented partitioning and dynamic partitioning on hive tables for faster search.
- Benchmarked Impala to Hive on performance for teh respective business use case.
- Integrated Hive table wif MapR DB tables for OLTP transactions.
- Created a UI which fetches data from teh MapR DB table and updates it if modified in teh UI and reflect back in teh search.
- Scheduled sqoop jobs for teh incremental load based on teh business requirement from Teradata.
- Written shell scripts for automation of teh queries to a certain point in teh business use case.
- Projected teh results on Tableau Dashboard connected to teh Hive tables and prepared reports for delivery.
- Written QA test cases as a part of Agile unit testing process for processing of data and persistence.
- Trained team members wif non-hadoop background to understand teh work flow and tools involved.
Environment: Teradata, Sqoop, Hive, MapR DB, Tableau, Platfora, Java, Shell scripting, Impala.
Confidential, San Diego, CA
Hadoop Developer
Responsibilities:
- Experienced wif Hive queries to categorize data of different networks.
- Used Hive, Pig to perform weekly processing
- Integrated teh Hive warehouse wif HBase.
- Involved in loading data from LINUX file system to HDFS.Written customized Hive UDFs in Java where teh functionality is too complex.
- Implemented Partitioning, Dynamic Partitions, Buckets in Hive.
- Designing and creating Hive external tables using shared Meta-store instead of derby wif partitioning, dynamic partitioning and buckets.
- Responsible to manage teh test data coming from different sourcesReviewing peer table creation in Hive, data loading and queries.
- Experienced in data wrangling, data Modeling, data Cleaning, mode performance & visualization
- Monitored System health and logs and respond accordingly to any failure conditions.
- Gained experience in managing and reviewing Hadoop log files.
- Involved in scheduling Oozie workflow engine to run multiple Hive and Pig jobsinvolved unit testing, interface testing, system testing and user acceptance testing of teh workflow tool.
Environment: Hadoop, HDFS, Hive, Map Reduce, Core Java, Pig, MySQL, Tableau.
Confidential
Responsibilities:
- Windows Multimedia Radio Interface Layer driver is interface between MSFT-RilProxy and QCOMM-Modem.
- Involved in feature design, development, and integration and fixing bugs for WMRIL on Window Phone (C++, WIN32). Created off target and on target test cases as required.
- Involved in code development to process modem indications, IHVRIL design changes and CRs.
- Hands-on experience on WMRIL debugging wif WCDMA, LTE, CDMA, WLAN, IMS on OTA, Agilent
- As bring up guy for WMRIL made device to camp on network and make voice call, sms wif/wifout UI for all chipsets. Did for both 32bit/64bit processors much ahead of timelines.
- Owns and drives teh WMRIL component integration wif Continuous Integration system
- Did complex configurations on devices to camp on 3gpp, 3gpp2 networks using QCN on OTA, Agilent
- Experienced in creation and configuration of unit test automation for nightly execution on driver code.
- Involved in code development, integration and fixing bugs for MMRIL, WMRIL on Window Phone7 (C++, WIN32).
- Owns and drives teh MMRIL, WMRIL component integration wif Continuous Integration system
- Did Dev12 and Dev14 movement of WMRIL project transition involve making changes to code and project files wif new dev compiler and WPK tools.
- Ramped up very quick on making Voice Call for new WP7 OS, less TEMPthan 6 weeks.
- Reachable team member for all new development, configuration, and device setup, network camping, automation issues, log triage.
Environment: C++, Windows Phone, WOA, VS2013
Confidential, Warren, NJ
Software Engineer/Consultant
Responsibilities:
- Involved in remediating, development of teh requirements for teh Sync and Connect Application.
- Led teh development of SnC for different targets like Android, WebOS, WM
- Analyzing and identifying teh current requirements architecture, design and remediation.
- Coordinator for SyncML client implementation for Android, Windows Mobile
Environment: Android, Windows Mobile, PalmOS, Eclipse, SQLite
Confidential, Irving, TX
Software Engineer/Consultant
Responsibilities:
- SDE in SSPGUI, Development of new enhancements and CR fixing.
- Identified teh root cause for teh issues, fixing teh code-defects, led teh team of three for providing assistance to teh Client team in implementing web based migration project for teh same SSPGUI.
- Involved in technical write up of teh root cause of teh issues/ solution for teh issue.
- Contributed in resolving teh customer support issues in quick turnaround time.
- Involved in requirements gathering, design of new enhancements which keeps on coming quarterly basis w.r.to market plan/package, billing logic changes.
- Also part of SSPGUI support team for production environment support, involves fixing and redeployment of code wifin production environment.
Environment: C#, Windows GUI, SQL Server
Confidential
Senior Software Engineer/Consultant
Responsibilities:
- Worked on CCAD Features enhancement and OEM customization.
- Responsible for technical delivery for CCAD, MailMgr, Outbound calls, Voice, Email enhancements.
- Had good rapport wif customers although teh project development and migration
- Have worked on bringing down teh defects to less TEMPthan 10 in teh components me own.
- Ensured all deliverables are executed across teh software development life cycle.
- Worked wif clients of Nortel to support CCMA, CCT, CCAD application deployment and bug fixing.
- Have used Nortel tools IDCE, Clarify, Contact Scanner, CMF Viewer, CS2001 Switch.
- Performed Unit testing, Interface testing, System testing, Regression Testing, Performance analysis and memory leak checks as an integral task
- Led teh team of four wif delivery responsibility of client assigned tasks.
- Travelled to Ireland to understand Nortel CCAD environment, to showcase teh technical capabilities of teh team and responsible for deployment of same environment at India development center.
Environment: C++, C#, JAVA, SQL Server2000, VS2003
Confidential
Senior Software Development Engineer
Responsibilities:
- Part of teh bring up team and executed prototype for Next Generation Platform
- Showcased synchronization of contacts from phone to desktop application and net portal.
- Used different protocols like SyncML, OBEX, and Bluetooth to implement teh solution.
- Involved in Requirements study, design, Coding, UT of synchronization of contacts, images.
- Had a very good experience in coding for socket programming and SyncML protocol in dis project and also teh interface design experience which me think is crucial.
- Involved in developing teh module for different phases for 7 months.
- Performed Unit testing, Interface testing, System testing, Regression Testing, Performance analysis and memory leak checks as an integral task
Environment: VC++, C#.NET, Socket Programming, VS2005, Confidential specific devices
Confidential
Senior Software Development Engineer
Responsibilities:
- Configuration Module for teh Vista XPS Filter Driver based on Printer Abstraction Layer framework
- Responsible for Developing COM based Plugin using XPS path interfaces
- Implemented interfaces to Integrate wif existing Confidential printer driver code
- Coded transformations of data item mappings of legacy print items to Vista specific driver required elements.
- Responsible for Development of Winfx application using C#.Net Responsible for Configuring DTM controller, Client, Cruise Control.
- Coded parsers to code/decode data elements of XAML, MSXML.3.0 print filters.
Environment: VC++, C++, COM, C#.Net, VS2005, Vista Beta2, Vista RC1
Confidential
Software Development Engineer
Responsibilities:
- Teh application enables pre-selling & van selling wif logistics planning, collecting of data inside a store, multi-point delivery, setting and tracking of seller goals, best order suggestion, product allocation etc., wif Microsoft.Net supported mobile device like Pocket PC2003.
- Responsible for Developing Synchronization module using xml templates
- Implemented client side Connection manager using TCP/IP, http, https, to synchronize data between servers and client (device) database.
- Coded UI and database layer on PPC2003 using C# CF.
- Responsible for coding SSL authorization and autantication module using EVC++
- Created system test cases, Unit Test cases, participated in design reviews, code reviews.
Environment: C# Compact Framework, Windows CE, POCKET PC SDK 2003, EVC++, Visual SourceSafe, SQL Server 2000, SQL Server CE