Big Data Solution Architect Resume
SUMMARY
- Over 20 years of Work Experience in teh IT Industry
- 4 years of Big Data Solution Architect
- 4 years of Big Data Administration
- 10+ years of Application Architect experience
- 10+ years of Project Management experience
- 15+ years of experience with Oracle / Java / C++/ UNIX and Pl/Sql.
- 15+ years of experience with Infrastructure Management
- 15+ years of experience with Release Management
- 15+ years of Team Management
- MBA from Confidential Confidential
TECHNICAL SKILLS
Cloud: AWS, Mesos, Mesosphere DCOS, Docker, VPC, S3
Big Data: Hadoop, Hortonworks, Cloudera, Kafka, DC/OS, Mesosphere, Spark, Scala, Spark Streaming, Hive Many More
Hardware: AIX, IBM Mainframe, HP/UX, DEC VAX, Sun
Operating Systems: Unix, OS/390, Windows (NT, 2000 etc), VMS, OS/2, Solaris
Programming Languages: PL / SQL, Unix Scripts, C, C+ +, Java, J2EE, Perl, HTML, XML
Application Servers: Tomcat, Weblogic, Websphere
Configuration Management: Jenkins, GIT, Subversion, Clearcase, PVCS, ENDEVOR
Databases: ORACLE, DB2, UDB, Sybase, sQl Server
PROFESSIONAL EXPERIENCE
Confidential, New York, NY
Big Data Solution Architect, Mesosphere DC/OS Engineer, Release Manager
Responsibilities:
- As Solution Architect of high volume device log aggregation system. Designed and implemented a resilient and highly available solution dat will allow high volume message streaming about 10TB per day . With Peak volumes of a million messages per second. Teh data is collected by Spark and persisted in Hbase . We used Kafka Mirror Maker, HBase Replication and BRD in order to implement our DR solution.
- As Solution Architect architected, designed and helped in teh implementation of multiple Hadoop Ecosystem projects including Cloudera Hadoop, Spark, Kafka, HBase, Elasticsearch, Hive, Pig, Sqoop, Map Reduce, Yarn, Flume, Oozie . Multiple projects have been successfully implemented on Big Data Platform.
- As Hadoop Engineer developed user scenarios using Spark, Scala, and big data ecosystem products and recommended appropriate solutions to teh customers as part of initial onboarding.
- As Hadoop Engineer provided installation steps and configuration steps to system administrations.
- Provided training and guidance to Customers on Hadoop and big data ecosystem products during initial on boarding.
- As Mesosphere DC/OS Engineer enhanced and implemented multiple frameworks like Spark, Nifi, Alluxio, Lucidworks fusion, within private cloud using Mesosphere DC/OS. Enhanced teh docker images to add features and security.
- As Hadoop Administrator (5+ people) managed 3500 servers in Hadoop clusters running Hadoop, Cloudera/Hortonworks across 60 clusters. Was responsible to develop monitoring tools and provide necessary 24x7 support to customers.
- As Datacenter Migration Project Manager (10+ people) me was responsible for teh successful migration of teh Application (150 Servers, 14x2 for Production) from One datacenter to another datacenter. RTO improved from 24hrs to 2hrs. dis spanned one+ years. dis included upgrade of Hardware type (Virtual to Physical), Aix to Linux 6.5, Oracle 10 to 11gR2. Migration and build - out of multiple 2Dev/3SIT/3QA/3UAT envs.
- As teh Release Manager developed automated release management system using Jenkins, DB and ETL(using self developed tools/scripts). me migrated teh TRS application from Maven1, ClearCase to Self Service Jenkins, GIT, Maven3.
Environment: Hadoop, Cloudera, Spark, Kafka, HBase, Elasticsearch, Nifi, DC/OS, Mesosphere Pig, Scoop, Hive, Flume, Informatica , SVN, GIT, Stash, Maven 3, Java, Jenkins, J2EE, Oracle, PL/Sql, Unix, Perl, BuildForge
Confidential, Warren, NJ
Release Manager, Environment Support Manager
Responsibilities:
- A ORACLE Certified Professional s teh Release Manager me designed and oversaw teh processes dat would track teh release from Source to Production. me automated teh process.
- Set up Continuous integration using Cruise Control
- Set up and administered SVN (subversion) for teh source code control.
- Developed a database change deployment system (supported multiple databases )
- As Weblogic Administrator created domains multiple environments and domains.
- Set up monitoring of Processes and Logs using GeneOS Netagent .
Environment: SVN, Maven, RPM, Java, J2EE, Oracle, PL/Sql, Unix, Perl, Weblogic, .net
Confidential, Whippany, NJ
Release Manager, Team Leader
Responsibilities:
- As Release Manager planned and executed teh build and deployment system.
- We were a team of 2 persons. ( Ant, Maven, Unix Shell, Perl ).
- Weblogic domains were automated ( WLST / Jython scripts and Token Replacement).
Environment: Clearcase, Weblogic, Java, Ant, Maven, Oracle, Sybase, Db2, J2EE, PL/Sql, Unix, Perl, Autosys
Confidential, New York, NY
Release Manager, Team Leader
Responsibilities:
- As a Release Manager Designed and Implemented teh Release Management Plan from scratch (Clearcase, Labeling, Branching, Shell Scripting, Ant, Perl and Autosys) .
- Designed, Developed, Tested and Implemented a Batch ETL System to move Legacy Data from VAX to Oracle( Unix KSH (scripts), Java (parsers), PL/SQL )
Environment: Clearcase, Java, Ant, Oracle, AIX, J2EE, PL/Sql, UNIX, Perl, Autosys
Confidential
Configuration Manager, Project Manager
Responsibilities:
- Created standards and processes for Configuration Management.
- Used Visual Source Safe for Visual Basic, ASP applications.
Environment: PVCS, Visual Source Safe, C++, Visual Basic, InstallShield, PGSql, UNIX