Big Data Architect Resume
0/5 (Submit Your Rating)
San Mateo, CA
SUMMARY
- 7+ years of experience as a developer. 4+ years as Hadoop leader that possesses rich Hadoop experience with ETL, BI and Rules Engine background.
- Experience with all flavor of Hadoop distributions, including Cloudera, Hortonworks and MapR.
- Total 4+ years of leading, architecture and design and development experience of Big Data applications, which involves Apache Hadoop Map/Reduce, HDFS, Hive, Pig, Oozie, Ambari and HBase.
- TOGAF and Sun Certified, Hadoop Architect with experience specializing in architecture and design of Hadoop/HDFS/HBase, EDW SOA and Cloud based applications using HDFS, Hive, Sqoop, Oozie and Pig
- As an architect, designed and implemented large Hadoop/HDFS/HBase application to support analytics platform.
- Experience in Enterprise Application Development, Web Applications, Client - Server Technologies, Web Programming with various languages and tools like Java, J2EE, SOAP and REST webservices..
- Extremely hands-on, who utilizes his experience to resolve any critical business or development issues.
TECHNICAL SKILLS
- Hadoop
- Mapreduce
- Hive
- Pig and Hbase
- R on Hadoop
- MySQL
- PL/SQL
- Java
- J2EE
- Talend
- Struts
- Hibernate
- R Script
- Java Script
- HTML5
- MicroStrategy
- Optumera
- Maven
- Velocity
PROFESSIONAL EXPERIENCE
Confidential, San Mateo, CA
Big Data Architect
Responsibilities:
- Support architecture, design review, code review, and best practices to implement a Hadoop architecture
- Assess current and future ingestion requirements; review data sources; data formats and recommend processes for loading data into Hadoop
- Design data storage, schema and partitioning system
- Provide design patterns for a pre-determined inventory of data processing jobs and analytic workflows based on Hadoop and appropriate tools such as Sqoop, Hive, Pig, Impala or other Cloudera technology
- Provide architecture and design expertise for a Netezza to Hadoop migration effort.
- Provide guidance to a three-person developer team.
- Provide technical leadership and expertise on Big Data/Hadoop/Spark projects.
- Support sales engineering activities including POCs leveraging Apache Spark.
- Support internal development activities on Visa’s technology frameworks and best practices including developing services capabilities for data warehouse off-loading.
Confidential, Austin Texas
Lead Technical Hadoop
Responsibilities:
- Architect, Design and Develop Components in Hadoop
- Design and Develop Java Map Reduce applications for calculating/identifying outcomes, resources, track performance, and compare data.
- Design and Develop Pig, Hive Sqoop jobs to perform the ETL of hospital analytics
- Designed, Developed jobs using Oozie Workflows and custom workflow scheduler to run the jobs.
- Performance Tuning and CDH migration of the application.
- Acted as a Core Technical Lead to the project and successfully delivered to production.
- An Implementation of Spark with Java in one of the Use Cases.
- Plan to migrate the implementation to Spark with Scala on CDH5.2
- Created a Groovy Config Slurper script to dynamically create properties for the jobs to different environments
- Worked with RAM/RAF to deploy hadoop projects in automation.
- Experience with Kerberos and workflow scheduling using Oozie Rest Web Services
- Gained some experience with Liquibase to deploy database DDLs,DMLs etc using RAM/RAF
- Helping with other teams, and coordinating the progress within the team, Agile, Scrum etc.
- Design and Development of the application Lightspeed which includes Service Order Inventory and Provisioning.
- Implemented the UI pages using IceFaces, Flex, GWT.
- Implemented Services and designed and developed persistence using Spring, EJB, Pure MVC, Open JPA.
- Application Deployment using Oracle Weblogic Server.
- Involved in Agile continuous iterative development of the application Lightspeed.
- Other tools such as Apache Camel, Maven, Hudson, Cruise Control, Xplanner were implemented.
Confidential, Dallas, Texas
Developer
Responsibilities:
- Design and Development of the application Lightspeed which includes Service Order Inventory and Provisioning.
- Implemented the UI pages using IceFaces, Flex, GWT.
- Implemented Services and designed and developed persistence using Spring, EJB, Pure MVC, Open JPA.
- Application Deployment using Oracle Weblogic Server.
- Involved in Agile continuous iterative development of the application Lightspeed.
- Other tools such as Apache Camel, Maven, Hudson, Cruise Control, Xplanner were implemented.
- Expertise on telecom services such as SELT, CVOIP, Service Assurance, Provisioning.
