Hadoop And Snowflake Admin Resume
Whippany, NJ
SUMMARY
- SNOWPRO CORE CERTIFIED and having around 7 years of IT experience in which3 years of experience in Hadoop Administration & Big Data Technologies.
- Experience with complete Software Design Lifecycle including design, development, testing and implementation of moderate to advanced complex systems.
- Hands - on experience in working with Snowflake Cloud technology and Snowflake functionalities, such as Snow SQL, Snow pipe, Multi Clustering (Virtual Warehouse), Scalability, Time Travel, Failsafe and Zero Copy Clone.
- Experience in creating Snowflake internal and external stages while processing the data.
- Expertise in Data Migration from RDBMS to Snowflake cloud data warehouse.
- Good experience in administering (rbac, databases, schemas, external objects, pipes, file formats) and monitoring (warehouse) Snowflake computing platform.
- Well experienced in using Snowflake COPY command and loading the data from AWS S3 bucket into Snowflake data warehouse.
- Hands on experience in installation, configuration, supporting and managing Hadoop Clusters using Apache, Cloudera (CDH6, CDH5 and its minor versions),Yarn, Hive, Spark, Impala.
- Mange Amazon Webservices - EC2, RDS, S3, CloudWatch.
- Experience on Snowflake, SQL, Amazon Redshift.
- Working knowledge on Migration of data to snowflake databases.
- Working knowledge of parcel-based upgrades with Hadoop (i.e., Cloudera)
- Hadoop Cluster capacity planning, performance tuning, cluster Monitoring, Troubleshooting.
- Used Monitoring Daemons like Grafana, Ganglia and Service monitoring tools like Nagios.
- Backup configuration and Recovery of a NameNode failure using BDR.
- Decommissioning and commissioning the Node on running Hadoop cluster.
- Good knowledge on Linux administration
- Worked on configuration tools like puppet, and chef
- Involved in bench markingHadoop/HBasecluster file systems various batch jobs and workloads
- Experience monitoring and troubleshooting issues with Linux memory, CPU, OS, storage and networkand installation of various tools
- Deep understanding of Hadoop/ Spark stack and hands on experience in resolving issues with Hadoop/Spark Jobs
- Good experience on configuring and manage the backup and disaster recovery for Hadoop data.
- Hands on experience in analyzingLog files for Hadoop and eco system servicesand finding root cause.
- Experience on Commissioning, Decommissioning, Balancing, and Managing Nodes and tuning server for optimal performance of the cluster.
- As an admin involved in Cluster maintenance, trouble shooting, upgradations, monitoring and implementing backup& Recovery strategies.
PROFESSIONAL EXPERIENCE
Confidential, Whippany NJ
Hadoop and Snowflake Admin
Responsibilities:
- Analyzed data migration requirements that are in scope for snowflake migration.
- Executed python code for data movement from source databases onto Snowflake.
- Used scale out technique to increase the query performance.
- Maintaining Snowflake database, Hadoop Cluster, SQL database.
- Created external staging objects that are connected to AWS S3 to load the files.
- Created tasks in snowflake to schedule the query executions.
- Responsible for data migration to snowflake database, Managing snowflake shares.
- Mange Amazon Webservices - EC2, RDS, S3 buckets, CloudWatch, Amazon Redshift.
- Create S3 buckets and managing policies for S3 bucket.
- Manage Systems routine backups, scheduling jobs, enabling corn jobs, enabling system logging and network logging of servers for maintenance.
- Managing Tools such as SAS, R-Studio and Talend by creating execution plans, jobs, schedulers.
- Creating snapshots and Amazon Machine Images (AMIs) of instance for backup and creating clone instances.
- Day to day responsibilities includes solving developer issues, deployments moving code from one environment to other environment, providing access to new users and providing instant solutions to reduce the impact and documenting the same and preventing future issues.
Environment: Snowflake, Hadoop, HDFS, Hive, Sqoop, Flume, Zookeeper and HBase, Oracle 9i/10g/11g RAC with Solaris/redhat, Exadata MachinesX2/X3, Big Data Cloudera (CDH5 & CDH6) Apache Hadoop, Toad, SQL plus, Oracle Enterprise Manager (OEM), RMAN, Shell Scripting, Golden Gate, Redhat/Suse Linix, EM Cloud Control
Confidential, East Hanover NJ
Hadoop & Snowflake Admin
Responsibilities:
- Migrated the data from Teradata to Snowflake cloud data warehouse.
- Created temporary and transient tables as per the requirement.
- Created tasks in snowflake to schedule the query executions.
- Worked on transferring the ownership of objects from one role to another role in Snowflake.
- Wrote PL SQL procedures in Snowflake to load the data across different data zones.
- Involved in start to end process ofHadoop cluster upgradation using Cloudera from CDH5 to CDH6.
- Create S3 buckets and managing policies for S3 bucket.
- Manage Systems routine backups, scheduling jobs, enabling corn jobs, enabling system logging and network logging of servers for maintenance.
- Creating snapshots and Amazon Machine Images (AMIs) of instance for backup and creating clone instances.
- Monitoring systems and services, architecture design and implementation of Hadoop deployment, configuration management, backup, and disaster recovery systems and procedures.
Environment: Hadoop, HDFS, Hive, Sqoop, Flume, Zookeeper and HBase, Oracle 9i/10g/11g RAC with Solaris/redhat, Exadata MachinesX2/X3, Big Data Cloudera (CDH5 & CDH6) Apache Hadoop, Toad, SQL plus, Oracle Enterprise Manager (OEM), RMAN, Shell Scripting, Golden Gate, Redhat/Suse Linix, EM Cloud Control
Confidential, Bedminster NJ
Hadoop Admin
Responsibilities:
- Involved in start to end process ofHadoop cluster setup where in installation, configuration and monitoring the Hadoop Cluster using Cloudera.
- Responsible for Cluster maintenance, commissioning and decommissioning Data nodes, Cluster Monitoring, Troubleshooting, Manage and review data backups, Manage & review Hadoop log files.
- Monitoring systems and services, architecture design and implementation of Hadoop deployment, configuration management, backup, and disaster recovery systems and procedures.
- Mange Amazon Webservices - EC2, RDS, S3 buckets, CloudWatch.
- Create S3 buckets and managing policies for S3 bucket.
- Experienced in define being job flows with Oozie.
- Loading dynamic data directly into HDFS using Flume.
- Experienced in managing and reviewing Hadoop log files for troubleshooting s.
- Installation and configurations of various Hadoop Ecosystems and Hadoop Daemons.
- As an admin followed standard Back up policies to make sure the high availability of cluster and DR of clusters.
- Involved in Analyzing system failures, identifying root causes, and recommended course of actions. Documented the systems processes and procedures for future references.
- Worked with systems engineering team to plan and deploy new Hadoop environments and expand existing Hadoop clusters.
- Monitored multiple Hadoop clusters environments using Grafana, Ganglia and Nagios. Monitored workload, job performance and capacity planning using Cloudera Manager.
- Involved in Installing and configuring Kerberos and AD for the authentication of users and Hadoop daemons.
Environment: Hadoop, HDFS, Hive, Sqoop, Flume, Zookeeper and HBase, Oracle 9i/10g/11g RAC with Solaris/redhat, Exadata MachinesX2/X3, Big Data Cloudera CDH Apache Hadoop, Toad, SQL plus, Oracle Enterprise Manager (OEM), RMAN, Shell Scripting, Golden Gate, Redhat/Suse Linix, EM Cloud Control
Confidential, Scottsdale, AZ
Java/Android Application Support
Responsibilities:
- Design and develop in-house built applications and tools that streamline development and support processes.
- Working in a Linux environment.
- Business Application Development.
- Object Oriented Development principles.
- Provide off-hours support on a rotational basis.
- Install, maintain, and customize vendor-built software that is utilized by development and support teams.
- Internal Application Development & Support.
- Worked on unit testing and version control tools like SVN.
- Worked closely with the web application and mobile application development team to ensure proper integration between them.
Confidential, Los Angeles CA
BigData/Java Application Support
Responsibilities:
- Provide great customer service and support.
- Experienced in managing and reviewing Hadoop log files for troubleshooting’s.
- Installation and configurations of various Hadoop Ecosystems and Hadoop Daemons.
- As an admin followed standard Back up policies to make sure the high availability of cluster and DR of clusters.
- Object Oriented Development principles.
- Provide off-hours support on a rotational basis.
- Install, maintain, and customize vendor-built software that is utilized by development and support teams.
- Monitored multiple Hadoop clusters environments using Grafana, Ganglia and Nagios. Monitored workload, job performance and capacity planning using Cloudera Manager.
- Install, maintain, and customize vendor-built software that is utilized by development and support teams.
- Internal Application Development & Support.
- Worked on unit testing and version control tools like SVN.
Confidential, Los Angeles CA
Java Technical Support Analyst
Responsibilities:
- Provide application support for several trading applications.
- Provide great customer service and support.
- First line support for Incident for internal and external solutions, covering the full technology stack.
- Change / release support.
- Investigation of problems, including design, code, test and implementation of fixes.
- Ensuring solutions are monitored and have appropriate alerting.
- Automation of common, repeatable, manual tasks.
- Research and presentation of ideas for system improvements and contributing to continuous operational/service/lean improvement plans.
- Experience as a Software Engineer working on major programs across a complex IT environment.
