We provide IT Staff Augmentation Services!

Hadoop developer Resume

2.00/5 (Submit Your Rating)

SUMMARY:

  • Experience in hardware recommendations for Hadoop.
  • Experience in understanding business requirements to design services and nodes needed for Hadoop and related ecosystem.
  • Recent experience upgrading Hortonworks HDP and Ambari on Hadoop clusters.
  • Experience in installing, configuring, testing Hadoop components.
  • Experience in configuring and optimizing Solr, Hbase, HDFS, Oozie, Sqoop, Kerberos, and Hue.
  • Experience in diagnosing problems with Hbase, Solr, Ooozie, Yarn, Storm, Kafka, and Kerberos.
  • Experience in installation and configuration of Ranger to control centralized permissions for various components of the cluster.
  • Implementing automation of Hadoop setup and configuration using Puppet.
  • Setting up Kerberos between Hadoop and Microsoft Active Directory, Centrify, and MIT Kerberos with Openldap.
  • Experience in using Docker: Docker - machine, Docker-compose, Docker-swarm, and miscellaneous Docker components: network, volumes,etc.
  • Able to process large sets of structured, semi-structured and unstructured data and support systems application architecture.
  • Able to assess business rules, collaborate with stakeholders and perform source-to-target data mapping, design and review.
  • Able to assess data architecture including data ingestion pipeline design, Hadoop information architecture, data modeling and data mining, and machine learning and advanced data processing.

TECHNICAL SKILLS:

Databases: Microsoft SQL Server, IBM - DB2, Oracle, ER Studio

Languages: SQL, C#, Dot Net, VB, PowerShell, Java, Visual Studio, Eclipse

PROFESSIONAL EXPERIENCE:

Confidential

Hadoop Developer

Responsibilities:

  • Experience in installing, configuring, testing nCluster components.
  • Designed, implemented, and supported 30-nodes cluster, four loaders and two queen nodes (primary and failover) with 200TB of capacity.
  • Designed hardware and network for 30-node nCluster.
  • Setup LDAP configuration between nCluster and Microsoft Active Directory.
  • Setup firewalls on servers using iptables
  • Setup routes from worker nodes to access DB2 nodes through a Queen node.
  • Coded SQLMR java-code using Eclipse with Aster Data Development Environment plugin.
  • Upgraded several times with newer releases of nCluster.
  • Designed & implemented automatic copying of schemas from old system to new system in a parallel upgrade.
  • Developed security system for nCluster
  • Developed an “autogrant” script that runs daily to enforce least privilege access model.

Skills: SQLMR, Unix Administration (SuSE), Unix Shell Scripting, SQL, Query Performance Tuning, Networking including bonding and VLANS.

Confidential

Hadoop Developer

Responsibilities:

  • 13+ years of experience in Database Administration and Developer for very large and complex databases in SQL Server 2008 R2, 2008, 2005, 2000 & 6.5.
  • Expertise in Database Administration on Production Servers with server configuration, performance tuning and maintenance with outstanding troubleshooting capabilities.
  • Expertise in automating installation & configuration of SQL Servers using C# in Visual Studio.
  • Expertise in enabling Kerberos in SQL Server with Microsoft Active Directory.
  • Expertise in T-SQL writing stored procedures, triggers and functions.
  • Expertise in Administering SQL Server High Availability including Clustering, Mirroring, & Replication.
  • Experience in using DMV and dynamic management functions for debugging issues with queries.
  • Worked extensively on Clustering and server consolidation. Troubleshooting production issues and raising high availability.
  • Proficiency and expertise in SQL Server Replication, Backup/Recovery, Disaster recovery and planning.
  • Worked on configuring SQL Server with minimum privileged access.
  • Handled multiple SQL Instances on Cluster environment for Server Consolidation projects built on SAN using RAID levels.
  • Troubleshoot performance problems, fine-tuning of databases and index Analysis.
  • Experience in Batch processes, Import, Export, Backup, Database Monitoring tools and Application support.
  • Created Linked Servers between SQL Server 2008 R2 & DB2. Also created DTS package for data transfer between the two environments.
  • Working knowledge in Analysis Services (SSAS) & Reporting Services
  • Experience in supporting Very Large databases (VLDB) and troubleshooting the problems.
  • Strong experience in mentoring team members and writing documentation.
  • 24 X 7 Production Database on Call Support

We'd love your feedback!