We provide IT Staff Augmentation Services!

Hadoop Architect/developer Resume

5.00/5 (Submit Your Rating)

SUMMARY:

  • I am a Computer Scientist specializing in Deep Learning, Big Data, distributed systems, and cloud computing.
  • I have contributed to architect, design, develop, test and run components of two very large Data Analytics Production Systems developed and owned by The Centers for Medicare & Medicaid Services, Department of Health and Human Service ( Confidential ) using Big Data and Mark Logic Technologies, Enterprise BI tools/products.
  • During course of my PhD studies, I contributed to two Big Data Innovation.
  • First, I invented a new MapReduce scheduling algorithm, designed and implemented it as an Apache Hadoop 1.0.1’s plug in scheduler.
  • This scheduler has been cited as one of the core research contribution that has improved the features of Apache Hadoop.
  • Secondly, I proposed a workflow system based on MapReduce framework for scientific data - intensive workflows, and a climate satellite data-intensive processing and analysis application was developed to evaluate the workflow system.
  • These works are still being cited by innovation research on Big Data. In addition, I have published about twenty academic peer-reviewed articles, one edited book chapter, mentored a dozen of undergraduate and master student’s thesis, and taught CS/IT courses.

TECHNOLOGY:

Deep Learning, Machine Learning, Open source Tensorflow/Keras, Python, Dwave system, Math packages, Confidential ’s LIS Model

PROFESSIONAL EXPERIENCE:

Confidential

Hadoop Architect/Developer

Responsibilities:

  • Perform system’s architecture and development review and recommendation.
  • Design and Develop components for data load/analysis/ad hoc queries.
  • Support system’s maintenance and operational tasks, Business Requirements Gathering, Data Collection, Review & Monitoring, Data Integration & Alignment, Claims Data Analysis

Technology: Informatica, Oracle, Amazon Web Services, Amazon Redshift, Amazon Elastic MapReduce, Apache Crunch

Confidential

Hadoop Architect/Developer

Responsibilities:

  • Developed data analytic tools/modules to perform data requests, extracts, updates and ad hoc queries on Health Insurance Marketplace system

Technology: XML, XQuery, NoSQL database Mark Logic, Java

Confidential

Hadoop Architect/Developer

Responsibilities:

  • Perform system architecture review (system, data, and software architecture, code review) on the current data warehouse production system
  • Recommend solutions on system, data, and software architecture, and analytic capabilities to future development of the Data Warehouse system. Proof of Concepts on analytic capabilities (trending, clustering, classification, prediction) from collected data.
  • Identify solutions (including code development) for business issues, data quality, and data reconciliation.

Technology: Cloudera Hadoop (MapReduce, Hive), Pentaho Data Integration (Big Data integration). Proof of Concepts: Apache Mahout, Oryx.

Confidential

Hadoop Architect/Developer

Responsibilities:

  • Developed algorithms, methodologies, framework and software which are used at the Confidential and available to the public because they effectively solve problem and reduce uncertainty in processing and analysis of live stem cell microscope images at large scale.
  • Developed spatial computations over Terabytes-Sized Images on top of Hadoop platform. This work provides scientists with a methodology for detecting and distributing spatial image computations using logical image partitions to lower the barrier of executing spatial image computations in a computer cluster/cloud environment instead of in desktop/laptop computing environment.
  • Technology: Hadoop MapReduce, Hbase, Java Advanced Imaging Utilities, ImageJ, Fij, Portable Batch System, Matlab. Process TBs datasets using developed Hadoop components on HPC Linux cluster.

Confidential

Hadoop Architect/Developer

Responsibilities:

  • Produced the first ever decadal record of Greenhouse Gases from AIRS’s observations.
  • Invented new techniques which reduce noise in radiance data calibration from remote sensing images.
  • Developed monitoring and analysis of Madden Julian Oscillation (tropical disturbance that propagates eastward around the global tropics) from MODIS’s observations has been selected to receive an Outstanding Award by the Earth and Space Science Informatics.
  • Proposed Data Intensive Scientific Compute Model for Multicore Clusters.
  • Developed a scalable web service system including set of tools that provides complex gridding services on-demand for atmospheric radiance datasets from multiple satellite instruments.
  • Developed several statistical analysis components, data calibration algorithms and models for climate processes analysis.
  • The system, components, routine were used to analysis several TB radiance datasets and produced data products and scientific results.

Technology: Hadoop Ecosystem (HBASE, ZooKeeper, Oozie, Hadoop streaming, Pig, Hive, Mahout, ETL tools), J2EE, MySQL, PostgreSQL, Ncar Graphic, Octave, Matlab, and Web services (SOAP, WSDL, Tomcat, Apache Axis).

Confidential

Hadoop Architect/Developer

Responsibilities:

  • Designed and Developed lepidopterists community project Leptree web site along with interactive tools allowing biologists and lepidopterists exchange information and coordinate their research.
  • Applied semantic web technology in design and implementation of the system.
  • Developed Billing Customer Support System for Telecom services using Oracle 7 and other software development tools.
  • Developed course curricular and taught subjects: Introduction to Databases, Distributed Databases, Oracle Server and Applications, Computer Network, C++ programming language, and Distributed Database Systems, Short-term training courses in the Information Technologies.

We'd love your feedback!