Mapr Hadoop Administrator/engineer Resume
4.00/5 (Submit Your Rating)
Mclean, VirginiA
SUMMARY
- Candidate’s experienced includes recent creation of an Apache Hadoop Common implementation on a fully - distributed cluster install using HDFS, MapReduce and its various sub-projects, Apache HBase, Pig, Hive and Oozie.
- Expert with Apache Drill, HDFS and MapReduce in a Linux OS. An Electrical Engineer with extensive communication systems integration and Java development background.
- Earned an MSEE with an emphasis in communications and computer programming. He has proven ability to work well under high volume conditions while maintaining exceptional attention to detail.
- Possesses excellent multitasking, team-building and interpersonal skills. I am a Certified MapR Hadoop Administrator and familiar with Apache Drill.
- Proven Big Data expert; experience with Hadoop common and successfully created a fully-distributed cluster; knows how to install and configure Hadoop in a fully distributed cluster.
- Am very knowledgeable on Apache Drill.
- Brought up numerous MapR hadoop clusters.
- Has used MapR, HDFS, YARN, MapReduce, Pig, Hive and Oozie using Amazon EMR. Experienced in AWS services.
- Instruction in Operating Systems.
- Wireless communication theory and system simulation (Using Matlab and LabView).
- Over 30 years real-time software programming experience in C/C++ and UNIX.
- Oracle Certification Program. Also used MySQL and JDBC.
- Instruction in Oracle 10i data administration, database tuning and recovery.
- Acquired proficiency in SQL on Oracle 10i and My SQL applications.
- Modeled subsystems using MS-Exel. Familiar with Teradata and its' components.
- Java programming for over 5 years.
PROFESSIONAL EXPERIENCE
Confidential, McLean, Virginia
MapR Hadoop Administrator/Engineer
Responsibilities:
- Became a Certified MapR Hadoop Administrator.
- Created a 4 node MapR Hadoop cluster installation at client site in Palo Alto CA. Cluster included MapR-DB and OpenTSDB services.
- Brought up numerous MapR hadoop clusters in VM environment. Performed data ingestion using Hadoop distcp, Java and Python.
- Used OpenTSDB to monitor 20 to 30 misc time series sensor values.
- Assisted with development of a MapR-DB Garbage Collection prototype as reader/write solution for another client.
- Development included using the MapR-DB service to create a semi-distributed table using the Hbase Shell along with using MapR C-APIs.
Confidential, Orlando, Florida
Requirements/Design/Validation Engineer
Responsibilities:
- Wrote/upgraded requirements for a Remote Interface Unit (RIU) for Confidential Corp. used on the P-8 Poseidon
- Used Matlab for accuracy/verification of software, validated (FQT) requirements for software integrated into the RIU.
Confidential, Largo, Florida
Systems Engineer
Responsibilities:
- Created an Apache Hadoop fully distributed cluster install using HDFS, MapReduce and its various sub-projects, Pig, Hive, HBase and Oozie.
- Sub-Expert with HDFS and MapReduce in a Linux OS. Effort involved installing Hadoop and configuring Hadoop environment using .bashrc & hadoop-env.sh. Configured the Hadoop framework (provide JDK and SSH password-less keys from NameNode to all slave nodes). Configured the NameNode (create the masters and slaves files). Modified core, hdfs and mapred-site.xml files used to configure the nodes. Then format NameNode and verified the configuration.
- Ultimately, started up HDFS (start-dfs.sh) and MapReduce (start-mapred.sh); troubleshot the cluster using log files and the node web user interface to correct errors, and finally shut down each node (decommissioned the DataNodes as well for practice). Used Fs shell, fsck and dfsadmin tools to interact with HDFS. Throughout effort performed unit testing on MapReduce portion all under Eclipse IDE to eliminate bugs before entering job onto cluster. Once bugs were eliminated put job onto cluster to verify it worked. Made liberal use of the web user interface to verify all nodes' status in the cluster.
- A key producer in designing a 'user friendly' Database using ACCESS to replace the ESS log books in ESS Lab.
- Worked on the ‘next generation’ CEC SDP-S terminal. Responsible for evaluating CEC CCAs that comprise the CEC (Cooperative Engagement Capability) terminal. Ensured that CCAs respective VIDs (Vendor Item Drawing) content met CEC requirements. Interfaced with vendors from UK and Canada to discuss flaws that existed in VIDs and assisted on remedies for corrective action.
- Successfully developed, implemented, and lead CEP (Cooperative Engagement Processor) FQT (Formal Qualification Testing) of latest upgrade of CEP software. Supervised five Engineer testers whose responsibility was to create and run tests to simulate multiplatform CEP activity and ensure the CEP software was meeting CEP specifications.
- Involved in the integration of various newly acquired businesses. Used SAP business application software as the underlying foundation to achieve a successful integration (ETL) into data warehousing their business data of these legacy companies into one Raytheon.
- Responsible for the design and implementation of the SIAP (Single Integrated Air Picture) database for use in the CEC program. Designed the Oracle instance and schema for this research project using a Solaris UNIX box.
- Designed and developed software routines for a spread-spectrum frequency hopping communications system (CEC). Designed link budget models for this spread-spectrum frequency hopping communications system using MS-Excel and Matlab. Target was VXWorks OS and development was on a Solaris UNIX OS. Used Labview to contol an antenna pedistal feeding INS input.
Confidential, California
Systems Engineer
Responsibilities:
- Completed a retrofit of a ship-based radar system into a land-based tracking radar in Saipan.
- Range of engineering functions include redesign of the Rf component chain to minimize VSWR and maximize output power.
- Wrote software for a real-time data handling application.
Confidential, Rolling Meadows, Illinois
Engineer Specialist
Responsibilities:
- Project leader in design and development of RF ATE station for testing of receiver front-end of AN/ALQ-162 airborne radar set. Effort included RF system analysis, defining test plan, writing major software device drivers, power and I/O Interface circuitry design and procurement of all components and document required to complete objective.
- Actively participated and directed four engineers and technical support team using minimal resources and under critical time constraints.
- Responsible for the development and implementation of ATE test stations/fixtures used in the production testing of hybrid circuits and major receiver assemblies of the AN/ALQ-135 surveillance radar system. Led technical team in development of test plan of select RF assemblies.
- Work included creating test methodology, circuit design, writing software, creating TPSs (Test Program Set), integrating HW/SW and delivering final products to customer.