Big Data Consultant Resume
SUMMARY:
- Develop database solutions by designing proposed system; defining database physical structure and functional capabilities, security, back - up, and recovery specifications.
- Experience includes both relational and open source database platforms such as Cassandra, Mongodb 3.2, Hadoop, Spark, and Redis.
- Maintain database performance by identifying and resolving production and application development problems; calculating optimum values for parameters; evaluating, integrating, and installing new releases; completing maintenance; answering user questions.
- Responsible for performance tuning and optimization of SQL Server, Mysql, and open source databases such as Cassandra, Hadoop, Mongodb running on Windows and Linux 6.6 platforms.
- Provide consulting on performance tuning and troubleshooting, application workload testing, integration, data migration and general problem solving.
- Architect and implement backup and disaster recovery including both node to node and master slave replication.
- Business Intelligence (BI)/Online Analytical Processing (OLAP); interactively analyze multidimensional data roll-up, drill-down, data slicing; Cluster Analysis; Data Mining; Predictive Modeling; NoSQL Database; Big Data Strategies - Performance Management (non-transactional, social data), Data Exploration, Social Analytics (non-transactional, social data), Decision Science);MongoDB DBA; MongoDB clusters, Mongodb Oplog, Mongodb sharding, Mongodb partitioning, Mongodb indexes, Mongodb performance tuning. Mongodb 2.6 Mongodb 3.0 - 3.4 Implemented SQL Server SSRS,SSAS,SSIS as a Business Intelligence (BIDW) suite implementation for data warehouse using MS Visual Studio. Implemented SSIS for ETL data extraction and conversion for a model conversion. Created SSRS reports, migrated SSRS farm/reports to new data center servers.
- Implemented Cassandra 2.1.4 and managed with Opscenter. Drained nodes to clear up disk space, Segmenting out network traffic between nodes and external traffic to optimize connectivity. Cassandra multi data center configurationSpark 2.1.0 stream data ingestion.
TECHNICAL SKILLS & QUALIFICATION SUMMARY:
Mongodb, MySQL, Cassandra, and Cloudera Hadoop
SQL Server SSRS, SSAS & SSIS, Database Clustering (Log Shipping, Data Mirroring, Replication), SAN Storage Technologies.
Database Design and Administration - SQL Server v6, v7 2000, 2005, 2008, 2008r2, 2012; MySQL, MongoDB 3.0-3.4, Access, Datastax Cassandra and Apache Open source Cassandra
Database Design, Data Maintenance, Database Security, Database Management, Requirements Analysis, Teamwork, Technical Zeal, Project Management, Presenting Technical Information, Training, Operating Systems
Big Data Technology - MongoDB; MongoDB sharding, MongoDB clusters, MongoDB replication, Relational, hierarchical, Graphdb, ldap and Kerberos, distributed data file systems, notable scan option, Cassandra, Hadoop, Impala in a Red Hat Linux host based environment. Cassandra data modeling, Cassandra CQLSH. Extensive experience with Neo4j graph database cluster operations and development. Extensive experience with Docker and Kubernetes in a dev ops and agile development environment. Experience with automated code deployment tools such as Jira, Bamboo, and Atlassian.
PROFESSIONAL EXPERIENCE:
Big Data consultant
Confidential
Responsibilities:
- Responsible for architecture and operational aspects of Mongodb and Neo4j Graph database corporate environment. n Agile Dev Ops - GIT code branching, Docker, Kubernetes, AWS, Puppet, and Ansible.
- Extensive experience with Docker Swarm with Bridge networking to include inter container network communications.
- Experience with Uprade and shard automation aspects of Ops Manager.
- Capacity planning and forecasting for fast growing environments supporting public facing Apps and streaming apple watch data. modeling architecture that balances performance and speed of development.
- Created and maintained security infrastructure for Mongo and Neo4j environments with Kerberos, ldap, auditing, and SSL to comply with Hipaa health and personal information regulations. Secondary responsibilities include Cloudera Hadoop, Kafka, Spark, and DataRobot.
Confidential
Big Data consultantResponsibilities:
- Set up Chef and Ansible playbooks for server setup, server updates, server backups, background jobs that are needed to run on each server, and code deployments to prod servers on projects that required a scheduled prod deployment rather than automated deployments.
- Implemented scalable microservices solutions using Node.js, travis, Docker Cloud, Kubernetes / Helm, Mongo, Redis and SQS to implement tasking between services.
Confidential
Big Data consultant
Responsibilities:
- Responsible for administration and architecture of corporate level Mongodb environment. 15 Replicasets were centrally managed and monitored via Mongodb MMS.
- Experience in Mongodb versions 2.4 - 3.2 to include upgrades.
- Responsible for administration, maintenance, Performance analysis, and Capacity planning for Mongodb/Cassandra/Hadoop corporate data lake environment.
- Underlying operating system consists of Red Hat Linux 6.x, 7.x based environment. Full lifecycle methodology also was implemented - Dev, Test/Release, Stage, and Production.
- Supported Cloudera Hadoop infrastructure, monitored Cloudera Manager to troubleshoot performance bottlenecks and node availability and alerts.
- Supported Lambda Architecture to support real time event analysis.
- Hands-on knowledge of Big Data technologies NoSQL ecosystem such as Hive, Kafka, Hbase, Hue, Impalaq, Zookeeper, Spark, Storm, etc. Hands-on experience on Hadoop 2.0 components like, Yarn and High availability. Hands-on experience in creating Clusters, HDFS backup and Migration. Hands-on experience in Authentication/Authorization mechanism such as Kerberos and Sentry. Implemented Spark 2.1.0 data iningestion streams into Hue. Developed publisher/subscriber model with Spark/Kafka/Cassandra.
- Architected Mongo environments for various use cases that ranged from cache to full blown data Shard repositories in both operational and data warehouse capacity.
- Mongodb data store supported mobile based Iphone/Android app that had a 18 million user base. Analysis of data usage for proper index creation and data modeling. Implemented ldap and Kerberos for Cassandra and Mongodb. Experience in large scale consumer facing multiple Sharding implementations and architecture.
- Implemented Mongodb security that included LUKS (Linux Unified Key Store) disk based encryption, SSL, Kerberos, and LDAP to secure Mongodb environments.
- Implemented Cassandra 2.1.4 and DataStax Enterprise 4.8 for proof of concept and technology acquisition for Confidential .
- This project was to support a managed global cloud environment which included creating runbooks, architecture, and implementation of new technology in a corporate environment
- This Cassandra environment was a 6 node multi data center ring. Created Ansible scripts that auto provisioned Cassandra nodes.
- Administered Cassandra database and Performed data modeling with CQLSH.
- Implemented Ldap and Kerberos security solutions in a multi- data center Bi directional replication was important in addressing the multi-Datacenter environment.
DW/Big Data Consultant
Confidential, Houston, Texas
Responsibilities:
- Architected and administered a Cassandra Enterprise 4.7 Cluster to store health data and compare performance against Mongodb.
- Implemented Use Case for bringing data together from various systems for a consolidated view of health data.
- Created prototype and presented justification to senior management for use of MongoDB.
- Created document based schema for patient data.
- Created aggregation queries for reporting and analysis.
- Created replication and Mongodb Sharding clustering.
- Analyzed data to determine appropriate Shard key.
- Analyzed performance activity to determine if data required balancing.
- Backed up databases from replication secondary server.
- Implemented indexing. Implemented MMS for Mongodb monitoring.
- Maintained and expanded existing SQL Server 2008/2012 production and data warehouse and Analysis services.
- Performed data model and data workflow analysis of existing database environment.
- Created unified data model from disparate database applications.
- Developed Cost/ Value/ Priority Matrix for following business areas: Inspections, Infectious disease, and Mosquito Control.
- Developed 1 year road map for delivering high value reports Operations dashboards
- Designed and Developed Master Data Services for referential data across all business units.
- Managed project plan for business intelligence delivery. Developed Process flows, and functional documentations to capture all systems and users involved for the integration of disparate custom applications.
- Manage50+ SQL Server databaseservermigrationto new data centervendor on both physical and virtual environments. Performed detailed database level planningand project creationfor migration of 200+ databases and 15TB of data storage to include HAclustering,SAN,and Solid Statestorage.
- Obtained Client buy in for Cloud based application prototype.Priced, planned, and implemented prototype.
- SDLM - coordinated and interacted with App teams and Change Control team on production changes in support of corporate and ETRM trading systems.
- Production support of 60+ SQL Server databases to include High availability clustering and Disaster Recovery.
- Manage workflow for offshore Physical DBA team.
- Support Trade floor application architecture that includes SSRS, SSIS, and Analysis Services
- Coordinate and implement change control tasks in support of a Sarbanes-Oxley environment.
- Implemented SQL 2012 Always On technology
- Implemented Quest Performance Analysis for in-depth SQL server analysis and performance tuning.
- Implemented MongoDB datawarehouse for energy trading data. Determined Use Case would bring various data from different applications and create a single view of the data for quick access. Created data model and imported data using MongodbImport. Granted users authorization and authentication. Backed up databases using Mongodb backup facility.
- Coordinate with application teams and infrastructure groups to resolve performance bottlenecks.
- Determine architecture for new applications as well as upgrades.
- Database design for Sharepoint-based KPI application
- Analyzed workflow and requirements of a KPISharepointapplication and designedBIDW data warehousedata model in SQL Server as well as flowcharts for drilling exploration activities.
- Provided SSRS/SSIS/SSAS production support for Confidential energy.
- Managed change control process regarding business intelligence stack.
- Supported natural gas exploration and land management software.
Confidential
Senior database administrator
Responsibilities:
- SQL Environments range from departmental to VLDB implementations
- Experience in SAN and Windows Clustering platforms.
- SQL Server 2005 implementation and administration expertise.
- Inventoried all SQL instances for version, databases, agent job status, and ensure that backups were active and being executed.
- Influenced team members and decision maker on improvements to the monitoring and diagnostic processes.
Confidential, Houston, Texas
Senior database administratorResponsibilities:
- Created mobile based SQL server monitoring tool for the Pocket PC platform.
- Resolved all implementation and technical issues with CompactDBA.
- CompactDBA was successfully licensed to Confidential Software.
Senior Sales Engineer
Confidential, Houston, Texas
Responsibilities:
- Provided sales engineer expertise to 15 sales reps.
- The main product focus was SQL Server monitoring tools.
- Responsible for technical support as well as demonstrations of the products.
- Created white papers on product best practices and Return on Investment.
Senior Sales Engineer
Confidential, Houston, Texas
Responsibilities:
- Became the corporate Sql Server DBA Guru and was recognized by both customers and peers.
- Have been exposed to 100s of SQL Server environments via engagements.
- Launched product line in Europe.
