Hadoop Architect Resume
SUMMARY:
Highly skilled Hadoop Architect with expertise in Unix/ Linux - based systems and Big Data. Vast experience in high-volume environments with strong analytical and organizational abilities. Complex problem solver able to thrive in fast-paced and challenging roles.
TECHNICAL SKILLS:
Hadoop cluster Management: Cloudera Manager, Ambari, Apache Hadoop
Hadoop/ Big Data Components: Zookeeper, HDFS, Yarn, MapReduce, Oozie, Spark, HBase, Impala, Sentry, Hue, Hive, Pig, flume, Sqoop, kafka, Solr
Access and Security management: Sentry & Kerberos
Scripting Language: Shell, Python
Cluster parallel shell tools: ClusterShell (clush)
Traditional Databases: Mysql, Oracle, Postgres (SQL, PL/SQL scripting), SQLServer
Programming: C, C++, Java, PHP, SQL
Systems: Red Hat Linux, FreeBSD, Centos, Fedora, HP-UX, IBM AIX
Servers web: Apache, JBoss, Apache Tomcat, Weblogic
Cloud: based service tools - Salesforce, Zendesk, Splunk
Network technologies: Load Balancers, Switches, Routers, Firewall
Mail Server: Sendmail
Gateway: Server Webmin, kannel (txtmsg Gateway), Mbuni (Multimedia content Gateway)
Data reporting Server: JasperServer pro
Continuous Integration Server: Jenkins/Hudson()
Software build processor: Apache Ant, Maven
Source Code Manager: Git
Testing and performance monitoring tools: Selenium, Jmeter
ITIL & IT Services Management: Incident, Management, Problem management, Change Management
Model of the system de development: SDLC
File transfer tools: ftp, sftp, scp
Monitoring and Metrics collection tools: Nagios, Ganglia (learning)
PROFESSIONAL EXPERIENCE:
Confidential
Hadoop Architect
Responsibilities:
- Understanding with Cloudera Hadoop, YARN, MRv2, Zookeeper, Oozie IMPALA, Hive, Flume and HBase, Sqoop, Pig, Apache Spark
- Administer, troubleshoot, perform problem isolation and correct problems discovered in clusters
- Performance tuning of Hadoop clusters and ecosystem components and jobs. This includes the management and review of Hadoop log files.
- Provide 24x7 on call support for production code migrations and lower environment platform outages/service disruptions on a rotation and need basis
- Provide code deployment support for Test and Production environments
- Diagnose and address database performance issues using performance monitors and various tuning techniques
- Interact with Storage and Systems administrators on Linux/Unix/VM operating systems and Hadoop Ecosystems.
- Troubleshoot of any Hadoop ecosystem services issues. performance analysis, ensuring security developing and testing Unix Shell scripts, Java and coding required for Hadoop administration and associated core Hadoop ecosystem
- Performance tuning of Hadoop clusters and ecosystem components and jobs. This includes the management and review of Hadoop log files.
- Document programming problems and resolutions for future reference.
- Demonstrated abilities utilizing core Hadoop (i.e. Hadoop, Map-Reduce, Hive, Pig, Oozie, HDFS, Unix Shell, Java, etc.) and Relational Databases (MySQL, Oracle, Postgres, etc.).
- Experience in defining new architectures and ability to drive an independent project from architectural standpoint.
Confidential
Hadoop Administrator
Responsibilities:
- Requires competency in customer focus, change & innovation, strategic thinking, relationship building & influencing, talent management, results focus and inspirational leadership.
- Install and maintain platform level Hadoop infrastructure including the additional tools.
- Interacting with tool vendors to resolve problems, monitor and troubleshoot problems.
- Working closely with developers, architects, and end users to implement capabilities based on product roadmap.
- Troubleshooting on Hadoop technologies including HDFS, MapReduce, YARN, Hive, Pig, Flume, HBase, Sqoop, Zookeeper, Spark, etc.
- Performance tuning applications and systems for high volume throughput
- Maintain clear documentation to help increase overall team productivity.
- Day-to-day troubleshooting of problems and performance issues in our clusters
- Be part of the On-call Rotation for your areas of responsibility and expertise
- Providing ITIL based Incident, Problem and Change management services for the platform
Confidential
Operation Engineer
Responsibilities:
- Working on a complete range of hosted services that include the telecom (Verizon, Confidential & Confidential, Confidential -Mobile) and banking industries ( Confidential, Chase, Wells Fargo, American Express).
- Administration, operation, and support of various hosted applications in the service production environment of Mobile Pay service.
- Installation, configuration, administration and support of Red Hat and Solaris in large environment.
- Monitoring that all systems are running smoothly and resolving issues that arise
- Data gathering and data provisioning of the solutions
- Provide investigation, root cause analysis, and problem resolution
- Maintain operations such as a planned event while upgrading and Patching solutions (integration)
- Technical support for Technical Account Manager
- Suggesting proposals to Technical Account Manager to improve traffic time
- Data Analysis and Solution Tuning to improve service performance: analyzing core / thread dumps.
- Create or improve processes for operations
- Support internal tool (monitoring, stats, scheduling,…) deployment, and usage
- Manage communication with customer for calls, status, and update
- Executing release for bug fix, upgrade, updates inside a Change management process
Confidential
Senior System Analyst
Responsibilities:
- Production applications (SOP-P and Allstream SNAP) support
- Task management for all signaling provisioning, Allstream SNAP application daily monitoring
- Routing and screening information and deliver updates to all network elements.
- Supporting LAMP based web application, PHP, MySQL, HTML, DHTML, CSS, JavaScript
- Deploying and updating application on HP-UX and AIX production systems
- Assisting and resolving users/customers issues received thru tickets
- Investigating and troubleshooting application from the backend
- Tasks automation with shell scripting
- Application Data manipulation with SQL queries (Informix and Oracle)
- Manage communication with customer for calls, status, and update
- Handling the Incident Management process from the issue reporting stage to the case closure
- Handling the failover process and disaster recovery process
- Managing the Change Management from beginning to the end as the owner of the applications in productions environment
Confidential
Software Engineer
Responsibilities:
- Linux Red Hat Enterprise Linux and CentOS.
- Supporting internal web application(troubleshooting, new features implementation)
- Debugging application server side(Eclipse Indigo) and browser side(IE, Safari, Firefox)
- Shell Scripting (running SQL script for database reporting, Backing up database, automating log rotation)
- Database Postgres Query (advanced SQL) and PL/SQL scripting
- Java programming (Servlet, JSP), JavaScript, XML, HTML
- Linux System (Centos 5.8) administration: Configuring, Installing packages, servers troubleshooting
- Application deployment from the staging environment to the production line
- Usage of Git distributed for application source code control