Cassandra Consultant Resume
Naperville, IL
SUMMARY
- Overall 6+yrs in IT Which related to Cassandra, Python and Java on Experience in building Cassandra cluster
- Monitoring Cassandra cluster for resource utilization.
- Managing Cassandra clusters using Datastax opscenter
- Knowledge of Cassandra systems backup and recovery
- Knowledge of Cassandra security
- Knowledge of Cassandra maintenance and tuning - both database and server
- Openstack VM management using provisioned cluster and PHP portal creation for VM management.
- Automatic Spinning Database as a service over cloud using chef/Puppet
- Perform routine management operations, including configuration and performance analysis for mongodb
- Collect data that introspects the performance of query and update operations on a mongodb instance.
- Diagnosing Performance Issues for mongodb
- Set the procedure of restoring a replica set from an archived backup such as a mongodump or MMS Backup file.
- Creating MongoDB data set backups using system-level file snapshot tool, such as LVM or native storage appliance tools.
- Experience in Database Administration, development, design, maintenance and production support of relational databases, business applications, new server setup, MySQL Server installation, upgrade, migration.
- Have successfully managed high availability of production systems for Corporate Sectors and Individual Organizations as MySQL DBA.
- Strong MySQL skills and brief general system administration skills on UNIX/HP Open VMS, Linux and Windows environment.
- Expertise in Shell Script, PHP backend.
- Experience in the administration of Web based Internet/Intranet Client/Server multi-tire distributed application, major in database technologies in Consulting, Sales & Finance, Telecom, Quality & Standards domains.
- Tested SOAP and REST web service calls
TECHNICAL SKILLS
Programming Languages: Java/J2EE, Python Scripting
Web Services: SOAP & Rest Services
Framework: Apache Spring, Apache CXF, Camel, Hibernate, Apache Spark, Kafka, Hadoop
Databases: Apache Cassandra, IBM DB2 and Oracle
Management Tools: Datastax Opscenter
Job Scheduling: Autosys, Cron
Version Controls: IBM ClearCase, SVN, CVS, Visual Source Safe
Operating Systems: Windows, Unix, Linux, OS X
PROFESSIONAL EXPERIENCE
Confidential, Naperville, IL
Cassandra Consultant
Responsibilities:
- To meet scale and availability requirements, we selected Apache Cassandra for Cassandra's master less architecture, ability to easily and quickly scale horizontally to meet their growing data store needs.
- Involved in designing, capacity planning and implementing multi-rack Cassandra cluster.
- Implemented and administered Data center Cassandra Clusters based on the knowledge of architecture and data modeling for Cassandra applications.
- Worked on adding and deleting of nodes along with configuration of Node-to-node and client-to-node encryptions by generating and distributing key store and trust store files to all nodes.
- Migrated 10 TB of data from Oracle to Cassandra datacenter 12 nodes that have 4TB drives each using SSTable Loader.
- Worked on performance tuning of cluster using Cassandra Configuration file and JVM Parameters.
- Configured internode communication between Cassandra nodes and client using SSL encryption.
- Evaluated, benchmarked and tuned data model by running endurance tests using JMeter, CassandraStress Tool and OpsCenter.
- Worked on tuning Bloom filters and configured compaction strategy based on the use case.
- Performed importing data from various sources to the Cassandra cluster using Java/Python APIs.
- Configured security features (Authentication and Authorization) for restricting user's access to database. Worked with CQL3 to execute queries on the data persisting in the Cassandra cluster.
- Administered Cassandra cluster using DataStax OpsCenter and Nodetool utility to monitor CPU usage, memory usage and health of nodes in the cluster.
- Configured authorization to Cassandra cluster using Password Authenticator and Kerberos for Hadoop cluster.
- Designed, automated the process of installation and configuration of secure DataStax Enterprise Cassandra using puppet.
Confidential, Austin, TX
Cassandra Administrator
Responsibilities:
- Involved in the process of designing Cassandra Architecture.
- Deployed and maintained 450 Node PROD cluster, 200 node client test, 30 node QA and 10 node Dev.
- Migrated 100 TB of data from one datacenter to another datacenter.
- Integrated AD with Cassandra Authorization.
- Designed, Automated the process of installation and configuration of secure DataStax Enterprise Cassandra cluster using puppet.
- Monitored the cluster with Zabbix.
- Configured internode communication between Cassandra nodes and client using SSL encryption.
- Developed shell scripts along with setting up of CRON jobs for monitoring and automated data backup on Cassandra cluster.
- Created azure templates to automate server creation and DSE deployments.
- Installed and configured Cassandra cluster and CQL on the cluster.
- Experience in upgrading the existing Cassandra cluster to latest releases.
- Experience in using opscenter to monitor cluster Metrics and enable the services and alerts.
- Experience in Unix SHELL Scripting.
- Performed Stress and Performance testing, benchmark on the cluster.
- Tuned the cluster to achieve maximum throughput and execution time based on the benchmarking results
- Migrated the data from one datacenter to another datacenter.
- Configured, Documented and Demonstrated inter node communication between Cassandra nodes and client using SSL encryption.
- Encrypted the data at rest using Gazzang.
- Enabled Ldap Authentication on opscenter.
- Experience in upgrading DSE and applying patches for the existing clusters.
- Configured authorization to Cassandra cluster using Password Authenticator.
- Scheduled repair and cleanup process in production environment.
- Added and decommissioned the nodes based on requirement.
- Encrypted the passwords in configuration files.
- Added a new datacenter to existing cluster and migrated the data using rebuild process
Confidential, Charlotte, NC
Hadoop Administrator/Cassandra Developer
Responsibilities:
- Involved in start to end process of Hadoop cluster setup where in installation, configuration and monitoring the Hadoop Cluster.
- Responsible for Cluster maintenance, commissioning and decommissioning Data nodes, Cluster Monitoring, Troubleshooting, Manage and review data backups, Manage & review Hadoop log files.
- Installation of various Hadoop Ecosystems and Hadoop Daemons.
- Responsible for Installation and configuration of Hive, Pig, HBase, Sqoop, flume on the Hadoop cluster.
- Configured various property files like core-site.xml, hdfs-site.xml, mapred-site.xml based upon the job requirement.
- Involved in loading data from UNIX file system to HDFS.
- Provisioning, installing, configuring, monitoring, and maintaining HDFS, Yarn, HBase, Flume, Sqoop, Oozie, Pig, Hive.
- Monitored workload, job performance and capacity planning.
- Installing, Upgrading and Managing Hadoop Cluster on Cloudera distribution.
- Trouble shooting many cloud related issues such as Data Node down, Network failure and data block missing.
- Experience with UNIX or Linux, including shell scripting.
- Managing and reviewing Hadoop and HBase log files.
- Solution planning with Java EE, Cassandra & SOA platforms.
- Involved in supporting Design and analysis by providing POC’s by using Cassandra DB, Apache Kafka
- Provide road map for the Cassandra conversion and implementation support
- Develop Cassandra Data model considering current functionality and business need of application
- Provide Solution in re-write of DB operations through Datastax driver
- Building components by using Spark SQL and streaming
- Technical Analysis and implementation Approach planning & validation
- Design Document preparation, coding, unit, integration & performance testing support
- Closely associated with Cassandra DBA in implementing Cassandra data model in application environment to ensure solution is not affecting existing business as usual
- Worked on data conversion by extracting data from DB2, reform data, and load data into Cassandra nodes
- Provided support in application code implementation and post production support
- Suggested flight mode implementation to open live traffic on both data models
Confidential
Jr. Python Developer
Responsibilities:
- Create a Python application for ERM system.
- Used Django web based apps for Insurance premium calculations.
- Designed and developed components using Python.
- Designed unit test framework for new code.
- Used GIT Subversion version control tool to coordinate team-development.
- Implemented database access and data manipulation functions using MySQL.
- Update and Replace Java, C++ application in Python.
- Designed the architecture of the hardware environments and methodology of the code.
- Experienced in Agile Methodologies and SCRUM Process.
- Involved in entire lifecycle of the projects including Design, Development, and Deployment, Testing and Implementation and support.
- Used Pandas library for statistical Analysis.
- Used Numpy for Numerical analysis for Insurance premium.
Environment: Python, Django, MySQL, Linux, HTML, GIT, CSS, JavaScript and Apache Web Server.
Confidential
Java Developer
Responsibilities:
- Involved in Design, Development and Support phases of Software Development Life Cycle (SDLC)
- Reviewed the functional, design, source code and test specifications
- Involved in developing the complete front end development using Java Script and CSS
- Author for Functional, Design and Test Specifications
- Implemented Backend, Configuration DAO, XML generation modules of DIS
- Analyzed, designed and developed the component
- Used JDBC for database access
- Used Data Transfer Object (DTO) design patterns
- Unit testing and rigorous integration testing of the whole application
- Written and executed the Test Scripts using JUNIT
- Actively involved in system testing
- Developed XML parsing tool for regression testing
- Prepared the Installation, Customer guide and Configuration document which were delivered to the customer along with the product
Environment: Java, JavaScript, HTML, CSS, JDK 1.5.1, JDBC, Oracle10g, XML, XSL, Solaris and UML