Hadoop Solution Architect Resume
Pal Alto, CA
SUMMARY:
- Eighteen (18) years of experience in Software Architect, Design, Development, Testing and Implementation of Bigdata, Mobile, Cloud, Data Warehousing, Business Intelligence, Web, Client, Server Application.
- Expertise in Hadoop, Map Reduce, Spark, Yarn, SparkStream Hive, Pig, HBase, Kafka, Cassandra, Oracle, TeraData, AWS, EC2, S3, SNS, SQS, Cloud Watch, RESTful API, Machine Learning, Pentaho,Anroid, SDK, NDK, JNI, iPhone SDK, iPad.
- Expertise in C, C++, Java, J2EE, Scala, Python, CDH, EMR, TCP/IP, Bluetooth, Android SDK, Communication Drivers and Application software.
- Hands - on experience with major components in Hadoop Ecosystem including Hive, HBase, Hive, PIG, Sqoop, Flume, Avro, Oozie, Zookeeper and MapReduce frameworks, Cassandra, TeraData.
- Projects covered, BigData, Media platform, Smart phone connectivity, Connected-Vehicle, CAN Info, GPS, Compass, Accelerometer, Mobile Device Android/IOS, iPhone, iPad, Device Driver communication, Entertainment, Factory Automation, SCADA, FAB300MM, Internet and Engineering
- Expertise in Object Oriented Design, OOA/OOD, UML, Rational Rose and Visio.
- Expertise in Linux, MAC, Windows Architecture, RS232/RS485, USB, TCP/IP Communication, Bluetooth, USB over TCP/IP.
- Experience in Ajax, HTML5, appcelerator, Python, CSS, RESTful API, HTTP, HTTPS, Web Services, Java Script, JQuery, Node Js, JSon, Xml, WebGl, Ruby on Rails, Text to Speech, Voice Recognition and Audio Playback.
- Expertise in Oracle, NoSQL, My SQL, MS SQL Server, SQLite, Crypto API, HTML, DHTML, and other Internet Technologies.
- Strong noledge of Data Mining and MLib, Mahout Machine learning tecniques, Mongo DB.
- Expertise in Design Patterns.
- Good exposure to OpenStack, Good Data, Zoom Data, Flowing Data, Google Analytics, Micro Strategy, Tableau, Phonegap, Titanium, Linux API MPEG-2, MPEG-4, H.264, SIP, RTP.
- Outstanding SQL programming skills, with ability to write advanced queries involving table alterations, creating views, triggers PL/SQL stored procedures, selects, inner and outer joins, and optimized queries.
- Excellent communication skills, interpersonal skills, problem solving skills a very good team player along with a can do attitude and ability to effectively communicate with all levels of teh organization such as technical management and customers
- Interpersonal, communication, planning, Organizational and Computer Skills
- Work on multiple projects with efficiency and prioritize work and manage daily workload.
- Defined and developed best practices in Hadoop
- Worked in various operating systems like Linux, Mac and Android, IOS, Windows 7/Vista, Windows Mobile, Windows XP/NT/2000/
TECHNICAL SKILLS
Operating System: Linux, MAC, Android, iOS, WP7, Windows Vista/NT/2000/XP, Windows 7, Windows CE,Languages Java, C, C++, Scala, Objective-C, Android SDK, iOS SDK, iPhone SDK, Java EE, Linux API, Visual C++, C# (Win 32 SDK, STL, Crypto API, WCF).
Big data Hadoop: Mapreduce, Hive, HBase, Pig, Flume, Avro, HDFS, Cloudera, Solr, Spark, Spark Stream, SQOOP, Cassandra, NoSQL, AWS, EC2, S3, SNS, SQS, Cloud Watch.
Special Software/Tools: Eclipse, Rubymine, Flash Builder, Good Data, Pentaho, Micro Strategy, Tableau, Visual Studio 2010, Rational Rose, Front Page, Toad, Resharper, Xcode, MS Active Directory, Install Shield, Wise, MS Visio 2000, Flash Player, NUnit, XCode 4.x, Titanium
Internet Technologies: Ruby on Rails, Play framework, JDBC, Web services, JSP, Python, XML, PHP.
RDBMS: NoSQL My SQL, Oracle, Cassandra, SQLite, PL/SQL, MS SQL Server, Access
Networks: RS232/RS485, TCP/IP, HTTP, UDP, FTP, SIP, RTP Windows Socket Programming
Source Control: Perforce, Git hub, PVCS, SVN, Team Tracking, CVS.
PROFESSIONAL EXPERIENCE
Confidential, Pal Alto,Ca
Hadoop Solution Architect
Responsibilities:
- Design and develop Map reduce/Yarn programs
- Data analysis through Pig, Map Reduce, Hive.
- Design and develop DataIngestion component.
- Cluster coordination services through Zookeeper
- Import of data using Sqoop from Oracle to HDFS
- Import and export of data using Sqoop from or to HDFS and Relational DB Teradata, DB2
- Implement Flume, Spark, Spark Stream framework for real time data processing.
- Hands on experience in installing, configuring and using eco-System components like Hadoop MapReduce, HDFS, Hbase, Pig, Flume, Hive and Sqoop.
- Develope analytical component susing Scala, Spark and Spark Stream.
- Develope BI reports and dashboards using Tableau 8.x.
Languages: Java, Scala, Python, J2EE, Hadoop, SPark, Cassandra, HBase, Hive, Pig, Sqoop, MySQL, TeraData, DB2, Tableau 8.X
Confidential
Hadoop Architect
Responsibilities:
- Design and develop Mapreduce/Yarn programs
- Kerberos security was implemented to safeguard teh cluster
- Data analysis through Pig, Map Reduce, Hive.
- Cluster coordination services through Zookeeper
- Developed POS analytical Component.
- Import and export of data using Sqoop from or to HDFS and Relational DB Teradata, DB2
- Implement Flume, Spark, Spark Stream framework for real time data processing.
- Hands on experience in installing, configuring and using eco-System components like Hadoop MapReduce, HDFS, Hbase, Pig, Flume, Hive and Sqoop.
- Developed Social Media component to store data in Casandra.
- Develope analytical component susing Scala, Spark and Spark Stream.
Languages: Java, Scala, Python, J2EE, Hadoop, SPark, Cassandra, HBase, Hive, Pig, Python, Sqoop, MySQL, TeraData, DB2, Pentaho.
Confidential, Sunnyvale, CA
Lead Architect/Hadoop Architect
Responsibilities:
- Design and develop DataIngestion component.
- Design and develop Mapreduce applications for data analysis.
- Implement Flume based framework for data ingestion.
- Integration of Hadoop with BI tools like Alpine Data, Tableau.
- Develop Java Restful API.
- Implemented Solar search
- Setup and monitoring of Hadoop deveopment envirmonment
- Setup Hadoop Cluster on Amazon EC2
- Setup Kafka Cluster.
- Data Refinedment through Pig and HIVE.
- Data migration between RDBMS and Hadoop through sqoop
Languages: Java,, Python, Play, J2EE, Ruby on Rails, Hadoop, AWS, S3, EC2, SNS, SQS, Cloud Watch, Cassandra, HBase, Hive, Sqoop, MySQL,, Android, NDK.
Source Control: Github.
Tools: Micro Strategy, TableauOperating System: Linux, Mac, Android, Windows 7 32/64bit.
Confidential
Lead Architect/Hadoop Architect
Responsibilities:
- Design teh Confidential analytics componet in teh Hadoop eco system.
- Design and Develop Custom Filesystem plugin for Hadoop
- Develop MapReduce programs
- Setup MySQL for Hive Metastore.
- RDBMS, HDFS integration through Sqoop
- Developed Location Services component to record/play location specific voice notes
- Develop WebServices, voice notes search componenteta Store
- Performed query optimization through views, indexing, partitoning, bucketing.
- Develop custom mappers and reducers for Hive
Languages: Java, J2EE, Hadoop, HBase, Hive, Sqoop, MySQL, HTML5, Android, NDK.
Source Control: Git, SVN.
Operating System: Linux, Android, Windows 7 32/64bit,.
Confidential
Lead Architect/Sr Hadoop, Mobile Software developer
Responsibilities:
- Design and Developed analytics component for Confidential Data analytics, platform.
- Consulting on Hadoop ecosystem: Hadoop, MapReduce, Hive, HBase.
- Setup and Benchmarked Hadoop/HBase cluters for internal use.
- Developed data ingestors and MapReduce programs
- Worked with different SDK of Google Android, IOS SDK, and Cloud API.
- Developed navigation system using google Map, Speech to Text API, Telenav API, with text to speech API, Audio Playback, Bluetooth API, Location Service(LBS), GPS, SensorManager, Compass, Accelerometer and BroadCastReceiver.
- Develop customtoolbar using notification changes in batter levels, Wi-Fi, GPS, Bluetooth for Android and iPhone
- Integrated with Facebook Graph API, twitter API and Pioneet kit API for iPhone/Android.
- Developed Dual Screen using Pioneet kit API, Can info for iPhone and Anroid.
- Developed Confidential toolbar/ Confidential home page using Webkit, Ruby on Rails, HTML5, CSS3.
Operating System: Linux, Mac, Android, iOS5.x, iPhone Device, iPhone Simulator, iPad Device, iPad Simulator, appcelerator, Windows 7 32/64bit.
Languages: Hadoop, MapReduce, Hive, Hbase, Mongo DB, Java(Android SDK, NDK, Google API, IOS SDK ), C++, Java, J2EE, Linux API, Objective-C, Xcode, Interface Builder, Eclipse, Xcode, Interface Builder, Titanium, JavaScript, Jquery, Node Js, HTML5, CSS3, Facebook API, Phonegap, My SQL, WebGl
Confidential, San Jose, CA
Lead Sr. Software Engineer
Responsibilities:
- Design and Developed Curvone.
- Worked with different SDK of Google Android.
- Interface with native code using NDK, OpenGL Es.
- Devloped Navigation Bar and integrated with Cloud service.
- Devloped Activity, content provider, Intent.
- Developed connectivity component using USB
- Integrated with Facebook API.
Operating System: Linux, Mac, Android, iOS, Windows phone7, iPhone Device, iPhone Simulator, iPad Device, iPad Simulator, Windows 7 32/64bit.
Languages: Java(Android SDK, NDK, Google API, IOS SDK), J2EE, C++, Objective-C, Silverlight for Phone, Xcode, Interface Builder, Eclipse,Xcode, Interface Builder, JavaScript, Jquery, HTML5, CSS, Amazon S3, Facebook API, Ruby on Rails, Git, SVN.
Confidential, San Jose, CA
Lead Sr. Software Engineer
Responsibilities:
- Develop USB communication driver using C++, STL
- Develop Confidential Communicator/SoundStation using C++, MFC, SIP.
- Integrated Confidential communicator in Skype.
- Used an Agile development and Scrum model
- Develop UI automation using Python.
Operating System: Windows XP, Windows Vista/7, Linux, Adroid.
Confidential, Sunnyvale, CA
Sr. Software Engineer and Team Lead
Responsibilities:
- Developed teh content management UI using WPF.
- Developed file transfer component
- Developed Shell extension component using C++ and COM
- Used an Agile development and Scrum model
Operating System: Linux, Windows XP, Windows Vista, Windows 7, Windows CE, Microsoft ActiveSync, Windows Mobile Device Center, Android.
Confidential
Sr. Software Engineer
Responsibilities:
- Developed teh TinyBird player UI using MFC, Wind32, and C#
- Developed multi threaded application and Timeshift Bar using C++
- Developed next generation player using Silver light and C#
- Used an Agile development and Scrum model
