Hadoop Solution Architect Resume
Pal Alto, CA
SUMMARY:
- Eighteen (18) years of experience in Software Architect, Design, Development, Testing and Implementation of Bigdata, Mobile, Cloud, Data Warehousing, Business Intelligence, Web, Client, Server Application.
- Expertise in Hadoop, Map Reduce, Spark, Yarn, SparkStream Hive, Pig, HBase, Kafka, Cassandra, Oracle, TeraData, AWS, EC2, S3, SNS, SQS, Cloud Watch, RESTful API, Machine Learning, Pentaho,Anroid, SDK, NDK, JNI, iPhone SDK, iPad.
- Expertise in C, C++, Java, J2EE, Scala, Python, CDH, EMR, TCP/IP, Bluetooth, Android SDK, Communication Drivers and Application software.
- Hands - on experience with major components in Hadoop Ecosystem including Hive, HBase, Hive, PIG, Sqoop, Flume, Avro, Oozie, Zookeeper and MapReduce frameworks, Cassandra, TeraData.
- Projects covered, BigData, Media platform, Smart phone connectivity, Connected-Vehicle, CAN Info, GPS, Compass, Accelerometer, Mobile Device Android/IOS, iPhone, iPad, Device Driver communication, Entertainment, Factory Automation, SCADA, FAB300MM, Internet and Engineering
- Expertise in Object Oriented Design, OOA/OOD, UML, Rational Rose and Visio.
- Expertise in Linux, MAC, Windows Architecture, RS232/RS485, USB, TCP/IP Communication, Bluetooth, USB over TCP/IP.
- Experience in Ajax, HTML5, appcelerator, Python, CSS, RESTful API, HTTP, HTTPS, Web Services, Java Script, JQuery, Node Js, JSon, Xml, WebGl, Ruby on Rails, Text to Speech, Voice Recognition and Audio Playback.
- Expertise in Oracle, NoSQL, My SQL, MS SQL Server, SQLite, Crypto API, HTML, DHTML, and other Internet Technologies.
- Strong knowledge of Data Mining and MLib, Mahout Machine learning tecniques, Mongo DB.
- Expertise in Design Patterns.
- Good exposure to OpenStack, Good Data, Zoom Data, Flowing Data, Google Analytics, Micro Strategy, Tableau, Phonegap, Titanium, Linux API MPEG-2, MPEG-4, H.264, SIP, RTP.
- Outstanding SQL programming skills, with ability to write advanced queries involving table alterations, creating views, triggers PL/SQL stored procedures, selects, inner and outer joins, and optimized queries.
- Excellent communication skills, interpersonal skills, problem solving skills a very good team player along with a can do attitude and ability to effectively communicate with all levels of the organization such as technical management and customers
- Interpersonal, communication, planning, Organizational and Computer Skills
- Work on multiple projects with efficiency and prioritize work and manage daily workload.
- Defined and developed best practices in Hadoop
- Worked in various operating systems like Linux, Mac and Android, IOS, Windows 7/Vista, Windows Mobile, Windows XP/NT/2000
TECHNICAL SKILLS
Operating System: Linux, MAC, Android, iOS, WP7, Windows Vista/NT/2000/XP, Windows 7, Windows CE,Languages Java, C, C++, Scala, Objective-C, Android SDK, iOS SDK, iPhone SDK, Java EE, Linux API, Visual C++, C# (Win 32 SDK, STL, Crypto API, WCF).
Big data Hadoop: , Mapreduce, Hive, HBase, Pig, Flume, Avro, HDFS, Cloudera, Solr, Spark, Spark Stream, SQOOP, Cassandra, NoSQL, AWS, EC2, S3, SNS, SQS, Cloud Watch.
Special Software/Tools: Eclipse, Rubymine, Flash Builder, Good Data, Pentaho, Micro Strategy, Tableau, Visual Studio 2010, Rational Rose, Front Page, Toad, Resharper, Xcode, MS Active Directory, Install Shield, Wise, MS Visio 2000, Flash Player, NUnit, XCode 4.x, Titanium
Internet Technologies: Ruby on Rails, Play framework, JDBC, Web services, JSP, Python, XML, PHP.
RDBMS /NoSQL: My SQL, Oracle, Cassandra, SQLite, PL/SQL, MS SQL Server, Access
Networks: RS232/RS485, TCP/IP, HTTP, UDP, FTP, SIP, RTP Windows Socket Programming
Source Control : Perforce, Git hub, PVCS, SVN, Team Tracking, CVS.
PROFESSIONAL EXPERIENCE
Confidential, Pal Alto,Ca
Hadoop Solution Architect
Responsibilities:
- Design and develop Map reduce/Yarn programs
- Data analysis through Pig, Map Reduce, Hive.
- Design and develop DataIngestion component.
- Cluster coordination services through Zookeeper
- Import of data using Sqoop from Oracle to HDFS
- Import and export of data using Sqoop from or to HDFS and Relational DB Teradata, DB2
- Implement Flume, Spark, Spark Stream framework for real time data processing.
- Hands on experience in installing, configuring and using eco-System components like Hadoop MapReduce, HDFS, Hbase, Pig, Flume, Hive and Sqoop.
- Develope analytical component susing Scala, Spark and Spark Stream.
- Develope BI reports and dashboards using Tableau 8.x.
Languages: Java, Scala, Python, J2EE, Hadoop, SPark, Cassandra, HBase, Hive, Pig, Sqoop, MySQL, TeraData, DB2, Tableau 8.X
Confidential
Hadoop Architect
Responsibilities:
- Design and develop Mapreduce/Yarn programs
- Kerberos security was implemented to safeguard the cluster
- Data analysis through Pig, Map Reduce, Hive.
- Cluster coordination services through Zookeeper
- Developed POS analytical Component.
- Import and export of data using Sqoop from or to HDFS and Relational DB Teradata, DB2
- Implement Flume, Spark, Spark Stream framework for real time data processing.
- Hands on experience in installing, configuring and using eco-System components like Hadoop MapReduce, HDFS, Hbase, Pig, Flume, Hive and Sqoop.
- Developed Social Media component to store data in Casandra.
- Develope analytical component susing Scala, Spark and Spark Stream.
Languages: Java, Scala, Python, J2EE, Hadoop, SPark, Cassandra, HBase, Hive, Pig, Python, Sqoop, MySQL, TeraData, DB2, Pentaho.
Confidential, Sunnyvale, CA
Lead Architect/Hadoop Architect
Responsibilities:
- Design and develop DataIngestion component.
- Design and develop Mapreduce applications for data analysis.
- Implement Flume based framework for data ingestion.
- Integration of Hadoop with BI tools like Alpine Data, Tableau.
- Develop Java Restful API.
- Implemented Solar search
- Setup and monitoring of Hadoop deveopment envirmonment
- Setup Hadoop Cluster on Amazon EC2
- Setup Kafka Cluster.
- Data Refinedment through Pig and HIVE.
- Data migration between RDBMS and Hadoop through sqoop
Languages: Java,, Python, Play, J2EE, Ruby on Rails, Hadoop, AWS, S3, EC2, SNS, SQS, Cloud Watch, Cassandra, HBase, Hive, Sqoop, MySQL,, Android, NDK.
Confidential
Lead Architect/Hadoop Architect
Responsibilities:
- Design the Confidential analytics componet in the Hadoop eco system.
- Design and Develop Custom Filesystem plugin for Hadoop
- Develop MapReduce programs
- Setup MySQL for Hive Metastore.
- RDBMS, HDFS integration through Sqoop
- Developed Location Services component to record/play location specific voice notes
- Develop WebServices, voice notes search componenteta Store
- Performed query optimization through views, indexing, partitoning, bucketing.
- Develop custom mappers and reducers for Hive
Languages: Java, J2EE, Hadoop, HBase, Hive, Sqoop, MySQL, HTML5, Android, NDK.
Confidential
Lead Architect/Hadoop ArchitectResponsibilities:
- Design and Developed analytics component for Honda Data analytics, platform.
- Consulting on Hadoop ecosystem: Hadoop, MapReduce, Hive, HBase.
- Setup and Benchmarked Hadoop/HBase cluters for internal use.
- Developed data ingestors and MapReduce programs
- Worked with different SDK of Google Android, IOS SDK, and Cloud API.
- Developed navigation system using google Map, Speech to Text API, Telenav API, with text to speech API, Audio Playback, Bluetooth API, Location Service(LBS), GPS, SensorManager, Compass, Accelerometer and BroadCastReceiver.
- Develop customtoolbar using notification changes in batter levels, Wi-Fi, GPS, Bluetooth for Android and iPhone
- Integrated with Facebook Graph API, twitter API and Pioneet kit API for iPhone/Android.
- Developed Dual Screen using Pioneet kit API, Can info for iPhone and Anroid.
- Developed Honda toolbar/Honda home page using Webkit, Ruby on Rails, HTML5, CSS3.
- Design and Developed Curvone.
- Worked with different SDK of Google Android.
- Interface with native code using NDK, OpenGL Es.
- Devloped Navigation Bar and integrated with Cloud service.
- Devloped Activity, content provider, Intent.
- Developed connectivity component using USB
- Integrated with Facebook API.
Languages: Java(Android SDK, NDK, Google API, IOS SDK), J2EE, C++, Objective-C, Silverlight for Phone, Xcode, Interface Builder, Eclipse,Xcode, Interface Builder, JavaScript, Jquery, HTML5, CSS, Amazon S3, Facebook API, Ruby on Rails, Git, SVN.
Confidential, San Jose, CA
Lead Sr. Software Engineer
Responsibilities:
- Develop USB communication driver using C++, STL
- Develop Polycom Communicator/SoundStation using C++, MFC, SIP.
- Integrated polycom communicator in Skype.
- Used an Agile development and Scrum model
- Developed the content management UI using WPF.
- Developed file transfer component
- Developed Shell extension component using C++ and COM
- Used an Agile development and Scrum model
- Developed the TinyBird player UI using MFC, Wind32, and C#
- Developed multi threaded application and Timeshift Bar using C++
- Developed next generation player using Silver light and C#
- Used an Agile development and Scrum model
