Senior Technical Advisor And Architect Resume
Atlanta, GeorgiA
OBJECTIVE:
In pursuit of a challenging and enriching assignments to enhance my current skills, utilize my six years of big data management experience in professional environments and advance in the specialty areas of Big Data.
SUMMARY:
- 6+ Years of experience in BigData/Hadoop ecosystem technologies. 8+ Years of professional experience in total.
- Thorough knowledge of Hadoop architecture.
- Hands on experience in provisioning production clusters using Ambari and blueprints.
- Experienced in working on both Hortonworks and Cloudera Platforms.
- Designing hadoop clusters and laying out requirements for functionality clusters. Capacity planning, node requirements and responsible for designing hadoop service catalog.
- Worked on security and networking requirements for secure data transfer and access management.
- Hands on experience in upgrading Ambari and HDP versions on hadoop clusters.
- Kerberizing hadoop clusters, configuring krb5.conf and managing KDC.
- Experienced in working on Active Directory and configuring LDAP proxy.
- Installed and configured various Hadoop services like HDFS with HA, YARN with HA, Storm, MR, Zookeeper, Tez, Ranger, Kafka, Zeppelin, Spark, Hive and Hbase.
- Expert on data processing, structured, semi - structured and unstructured using Hadoop.
- Proficient in writing Hive Queries for analyzing data using Hive Query Language (HQL).
- Have been an interim part of Business and Data Analysis, Data Profiling, Data Lineage, Data Migration, and Data Integration
- Installed and configured analytical tools like R, Rstudio and Alteryx Server with Tableau on Hadoop ecosystem.
- Worked on Google Cloud Platform and AWS.
- Handled administration activities of maintenance and monitoring HDFS, MapReduce, YARN, Pig, Flume, Sqoop on the Hadoop clusters.
- Proficient in UNIX Shell Scripting and automation using Chef.
- Installing and configuring ETL tool Syncsort and managed deployments of other similar tools like Infomart.
- Worked in Oracle and Java Core concepts like OOPS, Multithreading, Collections, and IO.
SKILL SET:
Big Data Technologies: Apache Hadoop, HDFS, Yarn, MapReduce, Pig, Hive, Sqoop, Flume, HBase, Zookeeper, Oozie, Kafka, Storm, and Spark
Analytical Tools: Rstudio and Alteryx
Databases Oracle 9i/11g/10g, DB2, MySQL, SQL Server:
High-Level Languages: C, C++, CoreJava, R, Chef
Scripting Languages: Perl, TCL, Bash
Operating Systems: Windows XP/Vista/7, UNIX, Linux
EXPERIENCE:
Confidential, Atlanta, Georgia
Senior Technical Advisor and Architect
Responsibilities:
- Hands on experience in provisioning production clusters using Ambari and blueprints.
- Experienced in working on both Hortonworks and Cloudera Platforms.
- Designing hadoop clusters and laying out requirements for functionality clusters. Capacity planning, node requirements and responsible for designing hadoop service catalog.
- Worked on security and networking requirements for secure data transfer and access management.
- Hands on experience in upgrading Ambari and HDP versions on hadoop clusters.
- Kerberizing hadoop clusters, configuring krb5.conf and managing KDC.
- Installed and configured various Hadoop services like HDFS with HA, YARN with HA, Storm, MR, Zookeeper, Tez, Ranger, Kafka, Zeppelin, Spark, Hive and Hbase.
- Expert on data processing, structured, semi-structured and unstructured using Hadoop.
- Proficient in writing Hive Queries for analyzing data using Hive Query Language (HQL).
- Have been an interim part of Business and Data Analysis, Data Profiling, Data Lineage, Data Migration, and Data Integration
- Installed and configured analytical tools like R, Rstudio and Alteryx Server on Hadoop ecosystem.
- Worked on Google Cloud Platform and AWS.
- Handled administration activities of maintenance and monitoring HDFS, MapReduce, YARN, Pig, Flume, Sqoop on the Hadoop clusters.
- Used UNIX Shell Scripting for various periodic jobs and scheduled them using crontab and CAWA schedulers.
- Worked on Chef to automate installs on Hadoop VM’s.
Confidential, Atlanta, Georgia
Hadoop Administrator
Responsibilities:
- Worked in Confidential & Confidential Big data admin and operations team for 2 years.
- Responsible for maintenance and updates of Confidential & Confidential production clusters.
- Analyzed requirements and adding new services on Hadoop ecosystem as per the application requirements.
- Responsible for horizontal scaling of the cluster by adding new nodes to various production clusters.
- Performance tuning the cluster for optimum performance and user requirements.
- Creating and managing kafka topics, deploying storm topologies and creating yarn queues for various applications.
- Installed and configured Syncsort, an ETL tool used for batch processing.
- Handled deployments of any new application in the cluster.
- Responsible for end to end big data processing for more than 50 applications on everyday basis.
- Experience in managing and reviewing Hadoop log files.
- Played an important role in big data projects like data acquiring, data processing, data monitoring and data serving using dash boards.
- Frequent client interactions, analyzing their requirements and chalking out plans to fulfill these requirements
- Proficient Confidential Shell Scripting to automate various jobs.
Confidential, Atlanta, Georgia
Hadoop Administrator
Responsibilities:
- Excellent architectural and design understanding of Hadoop and its Eco-system along with various sub-projects of H-Base, Hive, Pig, etc.
- Hadoop HDFS filesystem layout, design, and management. Directory creation, permissions, and ownership management.
- Experienced with managing Nagios, a hadoop monitoring system. Setup alerts to send emails to team in case of failures or non-functional components
- Installation activities of Hadoop Ecosystem (HDFS, MapReduce, HBASE, Hive, Pig, Flume, Sqoop, Oozie, and Zookeeper)
- Setup of schedulers in Hadoop including the Capacity and Fair Schedulers, customizing to the client requirements
- Worked on various data load activities using Sqoop
- Implemented many automated job via cron scheduler and TWS
- Fine-tuning the cluster to provide stability, high-secure and robust using various configuration properties and monitoring practices
Confidential
Application Developer
Responsibilities:
- Confidential is an android application used to make donations to churches in Chicago. Implemented layouts in the entire android application and assisted in code development.
- Developed an application for online hotel booking using Core Java. Developed and tested the entire code
- Have used and suggested best practices in various fields of development, testing, implementation, and post production support
- Have a good understanding of the complete Development Life-Cycle process and utilizing the corporate’s standards
- Involved in getting the User Requirements, Data Modeling & Development of the system.
- Creation of E-R diagram and Data Flow diagrams
- Documentation for the system
- Organized the activities onsite and ensured that Deadlines, Quality Standards, and expectations of Client were met.
