Hadoop developer Resume
2.00/5 (Submit Your Rating)
SUMMARY:
- Experience in hardware recommendations for Hadoop.
- Experience in understanding business requirements to design services and nodes needed for Hadoop and related ecosystem.
- Recent experience upgrading Hortonworks HDP and Ambari on Hadoop clusters.
- Experience in installing, configuring, testing Hadoop components.
- Experience in configuring and optimizing Solr, Hbase, HDFS, Oozie, Sqoop, Kerberos, and Hue.
- Experience in diagnosing problems with Hbase, Solr, Ooozie, Yarn, Storm, Kafka, and Kerberos.
- Experience in installation and configuration of Ranger to control centralized permissions for various components of the cluster.
- Implementing automation of Hadoop setup and configuration using Puppet.
- Setting up Kerberos between Hadoop and Microsoft Active Directory, Centrify, and MIT Kerberos with Openldap.
- Experience in using Docker: Docker - machine, Docker-compose, Docker-swarm, and miscellaneous Docker components: network, volumes,etc.
- Able to process large sets of structured, semi-structured and unstructured data and support systems application architecture.
- Able to assess business rules, collaborate with stakeholders and perform source-to-target data mapping, design and review.
- Able to assess data architecture including data ingestion pipeline design, Hadoop information architecture, data modeling and data mining, and machine learning and advanced data processing.
TECHNICAL SKILLS:
Databases: Microsoft SQL Server, IBM - DB2, Oracle, ER Studio
Languages: SQL, C#, Dot Net, VB, PowerShell, Java, Visual Studio, Eclipse
PROFESSIONAL EXPERIENCE:
Confidential
Hadoop DeveloperResponsibilities:
- Experience in installing, configuring, testing nCluster components.
- Designed, implemented, and supported 30-nodes cluster, four loaders and two queen nodes (primary and failover) with 200TB of capacity.
- Designed hardware and network for 30-node nCluster.
- Setup LDAP configuration between nCluster and Microsoft Active Directory.
- Setup firewalls on servers using iptables
- Setup routes from worker nodes to access DB2 nodes through a Queen node.
- Coded SQLMR java-code using Eclipse with Aster Data Development Environment plugin.
- Upgraded several times with newer releases of nCluster.
- Designed & implemented automatic copying of schemas from old system to new system in a parallel upgrade.
- Developed security system for nCluster
- Developed an “autogrant” script that runs daily to enforce least privilege access model.
Skills: SQLMR, Unix Administration (SuSE), Unix Shell Scripting, SQL, Query Performance Tuning, Networking including bonding and VLANS.
Confidential
Hadoop DeveloperResponsibilities:
- 13+ years of experience in Database Administration and Developer for very large and complex databases in SQL Server 2008 R2, 2008, 2005, 2000 & 6.5.
- Expertise in Database Administration on Production Servers with server configuration, performance tuning and maintenance with outstanding troubleshooting capabilities.
- Expertise in automating installation & configuration of SQL Servers using C# in Visual Studio.
- Expertise in enabling Kerberos in SQL Server with Microsoft Active Directory.
- Expertise in T-SQL writing stored procedures, triggers and functions.
- Expertise in Administering SQL Server High Availability including Clustering, Mirroring, & Replication.
- Experience in using DMV and dynamic management functions for debugging issues with queries.
- Worked extensively on Clustering and server consolidation. Troubleshooting production issues and raising high availability.
- Proficiency and expertise in SQL Server Replication, Backup/Recovery, Disaster recovery and planning.
- Worked on configuring SQL Server with minimum privileged access.
- Handled multiple SQL Instances on Cluster environment for Server Consolidation projects built on SAN using RAID levels.
- Troubleshoot performance problems, fine-tuning of databases and index Analysis.
- Experience in Batch processes, Import, Export, Backup, Database Monitoring tools and Application support.
- Created Linked Servers between SQL Server 2008 R2 & DB2. Also created DTS package for data transfer between the two environments.
- Working knowledge in Analysis Services (SSAS) & Reporting Services
- Experience in supporting Very Large databases (VLDB) and troubleshooting the problems.
- Strong experience in mentoring team members and writing documentation.
- 24 X 7 Production Database on Call Support