Sr Splunk Engineer Resume
Wilmington, DE
SUMMARY
- Around 6+ years of extensive experience in the IT industry with years of expertise in Splunk, Linux/UNIX, PLSQL, SQL DBA. Monitoring, Data Analytics performance tuning Troubleshooting and Maintenance of Data Base.
- Around 4+ years of experience as Splunk Developer performed activities including requirement analysis, design, and implementations of various client server based applications using Splunk 5.x, Splunk 6.x.
- Expertise in customizing splunk for monitoring, Application management and security.
- Streamlined operations, realize efficiencies and cost saving by integrating teams across service lines, resulting in savings.
- Expertise in Installation, Configuration, Migration, Trouble - Shooting and Maintenance ofSplunk, Passionate about Machine data and operational Intelligence.
- Reduced expenses through staff management, increasing efficiency through automation, while maintaining service delivery and meeting service level agreements.
- Understanding of Network Firewalls, Load-balancers, LDAP and complex network design.
- Continual service improvement by regularly exercising oversight. Updated established process and procedures and created new guidelines when necessary.
- Experience onSplunksearch construction with ability to create well-structured search queries that minimize performance impact.
- Knowledge on Wily Introscope and Dynatrace monitoring tools.
- Involved in migrating from manual process to ARM job via Jenkin Builds and Subversion.
- Experience in performance testing, application monitoring and website support for banking, insurance, manufacturing, and retail industries.
- Designed scripts to automate Splunk forwarder maintenance and alerts.
- Troubleshoot Splunk infrastructure components, performance issue and license usage in coordination with infrastructure support teams.
- Experience managing global support teams, which included training, managing priorities, and establishing procedures to maintain quality support.
- Proven track record of identifying and resolving performance and availability issues using industry standard monitoring tools.
- Involved in ITSM change management Process for production changes.
- Standardize Splunk forwarder deployments, configurations and maintenance across a variety of UNIX and Windows platforms.
- Experience in creating regex expressions to extract the fields.
- Experience in working with Splunk authentication and permissions.
- Self-motivated and self-educating, yet willing and able to work collaboratively with both customers and team members.
- Provide design ideas to the leadership of the project team and represent the team as required Assist management in the development of design policies and procedures which improve the ability to meet requirements.
- Maintain technical skills and awareness of technical improvements.
- Experience in building a multi-tiered Splunk instance.
TECHNICAL SKILLS
Languages: C, SQL, SAS, html, php.
Testing Tools: HP ALM Performance Center, HP Load Runner, HP QTP, HP Quality Center.
Monitoring Tools: Splunk, DynaTrace, HP BSM, HP SiteScope, Wily.
Operating Systems: UNIX, Windows Server, Linux, Mac OSX.
Databases: Oracle, SQL, Sybase.
PROFESSIONAL EXPERIENCE
Confidential, Wilmington, DE
Sr Splunk Engineer
Responsibilities:
- Created Dashboards, Visualizations, Statistical reports, scheduled searches, alerts and also worked on creating different other knowledge objects.
- Knowledge about Splunk architecture and various components (indexer, forwarder, search head, deployment server), Universal and Heavy forwarder.
- Provide Regular support guidance to Splunk project teams on complex solution and issue resolution.
- Expertise with Splunk UI/GUI development and operations roles.
- Involved in helping the UNIX and Splunk administrators to deploy Splunk across the UNIX and windows environment.
- Worked on installing Universal Forwarders and Heavy Forwarders to bring any kind of data fields in to Splunk.
- On boarded different applications in to splunk using ARM job and Jenkin Bulids.
- Designing and maintaining production-quality Splunk dashboards.
- Involved in admin activities and worked on inputs.conf, index.conf, props.conf and transform.conf to set up time zone and time stamp extractions, complex event transformations and whether any event breaking.
- Troubleshooting of searches for performance issues by adding lookups, correct joins and using summary indexes.
- Scripting and development skills (Perl, Python, Java) with strong knowledge of regular expressions.
- Various types of charts Alert settings Knowledge of app creation, user and role access permissions. Creating and managing app, Create user, role, Permissions to knowledge objects.
- Experience in working Agile methodologies and Jira project tracking.
- Experience in upgrading the splunk environment from 6.3 to 6.4.
- Experience in migration of all splunk changes from manual to automation using ARM job process and Jenkin builds.
- Decommissioned Site Scope tool and integrated with splunk Web monitoring app.
- Worked on different customized apps for generating reports on daily bases.
- Created Macros for different middle ware applications for easy search process and to improve user friendly for splunk.
- Manage, deploy and support multiple concurrent releases through various test environments.
- Helped Dynatrace team for onboarding new applications, business transactions work flows and JVM tuning.
- Assisted internal users of Splunk in designing and maintaining production-quality dashboard.
- Installation and Maintenance of Splunk Universal Forwarders, Solving Forwarder Issues, Deployment Server Classes and Apps through Deployment Server.
- Implemented Forwarders (Universal and Heavy) with Load Balancing, Splunk Forwarder Management
- Managed the Splunk Enterprise Deployment.
Environment: SPLUNK6.3,Splunk6.4,SplunkEnterprise,SplunkModule, Linux,SplunkdbConnect, Automation toolsets, Oracle Access Manager.
Confidential - Chevy Chase, Maryland
Sr. Splunk Developer
Responsibilities:
- Monitoring responsible for implementing performance and availability monitoring solutions for the CMS applications.
- Managed global teams responsible for application support, performance management, and monitoring.
- Developed custom coded executive dashboards that provide real-time website performance and usage trends.
- Implemented and administered HP BSM suite, Compuware dynaTrace, and Splunk monitoring tools.
- Set up sophisticated monitoring and automated recovery for operating systems and application platforms.
- Developed monitoring and production support strategies, trained Production support team and monitoring team on several sophisticated troubleshooting techniques.
- Performed security monitoring of corporate networks.
- Tested systems and application security.
- Panned, implemented and managed Splunk for log management and analytics.
- Design, implement and maintain a Splunklog collection solution for the Performance Engineeringenvironments.
- Ability to collaborate and listen with technical and non-technical consumers from IT by LizardSales">Administrators to executive level stakeholders.
- Ability to quickly explore, examine and understand complex problem and how it relates to the customers’ business.
- Design core scripts to automate Splunk maintenance and alerting tasks.
- Experience in managing Splunk apps.
- Deal with Universal forwarder and forwarder management.
- Deployment and management of Splunk for logging aggregation.
- Ensure the continuous availability of all data network services and maintain site operations.
- Provide support to systems by monitoring both systems and network performance through the use of various network management tools and ticketing systems.
- Research and analysis of new tools and technologies to improve existing solutions.
- Running reports, tracking escalations and report server, network, and systems performance metrics.
- Exercises judgment within generally defined practices and policies in selecting methods and techniques for obtaining solutions.
- Building Splunk dashboards with search forms, views, packaging and distribution.
- Experience Creating, testing and deploying Splunk operational search strings.
- Creation of Splunk reports and dashboards.
- Create user interfaces that will allow customers to manage their own Splunk instances.
- Setting up Splunk forwarding for new application tiers introduced into the environment identifying bad searches or dashboards and partnering with the creators to improve performance.
- Monitor the Splunk Infrastructure for capacity planning and optimization.
- Design, implement and maintain a Splunk log collection solution for the performance Engineering.
- Created documentation to help evaluate new technologies and testing methodologies.
- Managed and supported multiple development environments and code deployment in these environments.
- Provided Linux and SQL support and guidance to internal software developers.
Environment: SPLUNK6.0.1, Linux, UNIX, Oracle 11g, MS SQL Server 2012, SQL, XML, MS Excel, MS Power Point
Confidential - Seattle, WA.
Splunk Administrator and Developer
Responsibilities:
- SetupSplunkForwarders for new application tiers introduced into environment and existing applications.
- Work closely with Application Teams to create newSplunkdashboards for Operation teams.
- CreatedSplunkapp for Enterprise Security to identify and address emerging security threats through the use of continuous monitoring, alerting and analytics.
- Use techniques to optimize searches for better performance, Search time vs. Index time field extraction. And understanding of configuration files, precedence and working.
- Created Regular Expressions for Field Extractions and Field Transformations inSplunk.
- Very Good experience onSplunkSearch Language and Regular expressions.
- Supported 5+Splunksearch Heads, 10 + Indexers, 3000 + forwarders.
- Anonymize the PII data inSplunk. Masked sensitive information such SSN numbers, Addresses when showing results inSplunk.
- ConfigureSplunkfor all the mission critical applications and usingSplunkeffectively for Application troubleshooting and monitoring post go lives.
- Created Dashboards and Reports to show Login count of each application, to show which app resources being accessed more, Number of failed logins, statistics on High hitting applications.
- ConfiguredSplunkforwarder to send unnecessary log events to “Null Queue” using props and transforms configurations to reduce license costs.
- Developed a POC on usage of Puppet Configuration Management tool.
- Good knowledge about Indexer and Search head clustering.
- Created Shell Scripts to installSplunkForwarders on all servers and configure with common configuration files such as Bootstrap scripts, Outputs.conf and Inputs.conf files.
- Experienced in attending the bridge calls for production issues and non-prod issues and involved application teams or database teams or networking teams to resolve the issues and involved in Root cause analysis for the issues encountered. Also provided 24/7 on call support for all the production applications.
- Provide regular support guidance toSplunkproject teams on complex solution and issue resolution with the objective of ensuring best fit and high quality.
- Doing deeper analysis of data using event correlations across indexes and various source types to generate custom reports for senior management.
Environment: SplunkEnterprise, UniversalSplunkforwarder,SplunkDb connect, Oracle, MS SQL 2008, Regular expressions, Windows, UNIX,SplunkApp for Enterprise Security (SIEM).
Confidential - Washington, DC
Splunk Engineer
Responsibilities:
- Developing a newSplunkenvironment in multiple servers with 2 head servers, Search Head and node servers and training fellow team mates with the implementation ofSplunk.
- Integrating theSplunkwith Single Sign-On authentication and Service now ticketing tool.
- Prepared, arranged and testedSplunksearch strings and operational strings.
- Created and configured management reports and dashboards.
- Used Splunk forwarders to provide reliable and secure collection and delivery of data to the Splunk platform for indexing, storage and analysis.
- Configured Splunk to turn operational data into usable information, generating daily reports that can then be used to create custom dashboards to aid in making business-critical decisions.
- Implementing Deployment server for controlling, patching and installing updates on slave nodes. Design and implement Splunk using a Deployment Server, Search Head, indexers and forwarders.
- Built Splunk dashboards to highlight key business metrics such as transaction volume and average processing time, as well as to measure the performance of other third party systems.
- Installation, Upgrade and Maintenance of Splunk Universal Forwarders, Solving Forwarder Issues, Deployment Server Classes and Apps through Deployment Server.
- Used Splunk Enterprise for real-time error reporting, exception monitoring and overall debugging.
- Maintained the Splunk software to automatically send out an alert to notify the appropriate authority through Email and activate the necessary support.
- ManageSplunkconfiguration files like inputs, props, transforms, and lookups.
- Developed, evaluated and documented specific metrics for management purpose.
- Analyzed security based events, risks and reporting instances.
- Troubleshoot and maintain theSplunkenvironment and provide 100% delivery through.
- Worked on log parsing, complexsplunksearches, including external table lookups.
- Push Asset Summary Reporting (ASR) content fromSplunkto RSA Archer based dashboard.
- Field Extraction, Using Ifx, Rex Command and Regex in configuration files.
- Designed, developed and implemented system engineering plans and technical support services.
- Worked on DB Connect configuration for Oracle, My SQL and MS SQL.
- Monitored Database Connection Health by usingSplunkDB connects health dashboards.
- Deployed various WAR, JAR, EAR applications in clustered environment.
- Application Performance Monitoring (Dynatrace Application Monitoring).
- Monitor the applications and provide daily reports onSplunkservers, responding timelines and troubleshooting.
- Executed systems programming activities and supported data center activities.
Confidential - Pittsburg, PA.
Monitoring consultant
Responsibilities:
- Lead responsible for managing performance testing and tuning activities for web applications, triage of performance issues, and setup of BSM/SiteScope application monitoring.
- Managed global teams across India, Europe, and the United States, ensuring high quality test plans, overseeing execution and implementation, and certifying performance and monitoring capabilities for new applications.
- Migrated HP BAC 8 to HP BSM 9, which involved setting up a new BSM 9 Platform, migrating the business process monitoring scripts, integrating SiteScope, HP Diagnostics and SAAS BAC Anywhere.
- Lead monitoring initiatives to close all gaps in application monitoring based on issue analysis.
- Designed and implemented a performance gateway process that tests all new code releases and identifies performance bottlenecks.
- Conducted performance tuning activities for all tiers of the application to meet the service level agreements.
- Lead multiple triage efforts for diagnosing performance issues related to JVM memory leaks and capacity issues.
- Trained and assisted offshore Performance engineers with testing and triaging.
- Conducted Load and Stress testing for new Rating Engine application used by Underwriters.
- Identified Business need for Load Testing and issues with application.
- Created scripts for Business Scenarios.
- Conducted Load Testing and collated the Test Results.
- Provided recommendations based on the Test Results.
- Recertified the scalability of the application after the configuration changes.
- Responsible for upgrading BSM environment Apply new patches received from by LizardSales">HP .
- Administered Performance Center Prod and Test environment deployment of patches version upgrade.
- Provided recommendations to Architecture team forServer consolidation.
- Provided the recommendations to DBA team to make the changes in Database like table reorg add enough spaces to database.
- Identifying Scenarios, Recording & Enhancing Load Runner Scripts and execution of Test Scenarios.
- Expertise in gathering various Performance metrics using Load Runner Monitors,HPSite Scope and various O/S resources counters.
- Help application team to analyze performance bottle necks in their applications using different kinds of BAC reports and Diagnostics.
- Working as a Performance test consultant helping client in strategizing Performance testing and doing capacity planning for Global Trade Repository (GTR).
- Analyze the production environment for volumes and by LizardSales">CONFIGURATION to simulate the same in QA.
- Understand the Application functionality, architecture details and component metrics along with workload characterization.
- Creating the work load analysis for Performance testing based on the production volumes.
- Performs in-depth analysis to isolate points of failure in the application.
- Used Dynatrace to monitor server metrics and Performed in-depth analysis to isolate points of failure in the application.
Confidential
SQL Developer
Responsibilities:
- Implemented enhanced monitoring strategies to fill the current gaps and improve website availability.
- Developed executive dashboards and reports that help drive the scalability efforts for the holidays.
- Trained the Production Support Team on tools administration and issue resolution using monitoring tools.
- Responsible for creation and tuning of all application, state based, event based, and performance monitoring.
- Responsible for creation and implementation of monitoring and compliance procedures.
- Manage production technology incidents to resolution, ensuring timely engagement, escalation and effective communication to business, technology and vendor partners.
- Identify and implement opportunities for automation of production monitoring.
- Proactively identify common root causes of issues and address to improve overall production stability.
- Work with application vendors to schedule upgrades and enhancements.
- Provide first hand leadership guidance and management oversight for critical incident resolutions and root cause analysis.
- Track, review and manage the production issues to closure.
- Manage and review the application redundancy and contingency plan to ensure uninterrupted service to the customers.
- Partner with the Application Management, Architects and the SME's in identifying necessary. Enhancements and solutions to meeting the processing capacity and stability needs of production.
- Implement integrated monitoring solutions and support monitoring tools administration.
- Develop training plans to enhance technical, analytical and business capability across the team.
- Work with business and technology partners to plan and test the disaster recovery plan.
- High level of interaction with web teams assisting them with many improvements.
- Supported data source configurations and change management processes.
- Analyzed and monitored incident management and incident resolution problems.
- Author scripts to automate tasks that were conducted manually in the previous platform.
