Home » Categories » Products » Nagios Log Server » Troubleshooting » Common Problems

Nagios Log Server - Troubleshooting Commands

Troubleshooting Commands

This is a list of commands that can be used to help diagnose issues with Nagios Log Server.

Be careful, some commands can be destructive and can result in data loss!

 

 

Generic Information Gathering

Master:

curl 'localhost:9200/_cat/master?v'

 

Nodes:

curl 'localhost:9200/_cat/nodes?v'

 

Pending tasks:

curl 'localhost:9200/_cat/pending_tasks?v'

 

Recovery:

curl -XGET 'localhost:9200/_cat/recovery?v'

 

Running plugins:

curl 'localhost:9200/_cat/plugins?v'

 

Cluster basic health:

curl -XGET 'http://localhost:9200/_cluster/health?pretty=true'

 

Check jvm settings:

curl -XGET localhost:9200/_nodes/jvm?pretty

 

Shard status (use index status instead for clarify, in most cases):

curl -XGET http://localhost:9200/_cat/shards

 

Cluster state:

curl -XGET 'http://localhost:9200/_cluster/state?pretty'

 

Shard health (index health works better in most circumstances):

curl -XGET 'http://localhost:9200/_cluster/health/*?level=shards'

 

 

Red Cluster Recovery

Check index health:

curl 'localhost:9200/_cluster/health?level=indices&pretty'

 

Shard list:

curl -s localhost:9200/_cat/shards

 

Unassigned shards:

curl -s localhost:9200/_cat/shards | grep UNASS

 

Delete bad index:

curl -XDELETE 'http://localhost:9200/twitter/'

 

 

Active Troubleshooting

Tail maintenance logs:

tail -f /usr/local/nagioslogserver/var/jobs.log

 

Tail poller logs:

tail -f /usr/local/nagioslogserver/var/poller.log

 

Shut down all nodes:

curl -XPOST 'http://localhost:9200/_shutdown'

 

Check users:

curl -XGET 'http://localhost:9200/nagioslogserver/_search?type=user&pretty'

 

 

Backup Troubleshooting

Check running knapsack export:

curl -XPOST 'http://localhost:9200/_export/state'

Typically jobs.log should be tailed and the backup+maintenance command should be forced from the subsys - jobs.log should complain about a partial snapshot.

 

Delete a snapshot (versions <= 1.3.0):

curator delete --older-than 1 --prefix logstash-2015.05.19 (replace with snapshot name)

(versions >= 1.3.0):

curator delete snapshots --repository nlsbackup --prefix (replace with snapshot prefix)

 You can also delete snapshots from the Web GUI under the backup page, or directly from the repo.

 

 

Purpose-Driven Commands

Check min master nodes:

curl localhost:9200/_cluster/settings?pretty

 

Set min master nodes:

curl http://localhost:9200/_cluster/settings -XPUT -d '{ "persistent": { "discovery.zen.minimum_master_nodes": 2} }'

 

Check users:

curl -XGET 'http://localhost:9200/nagioslogserver/_search?type=user&pretty'

 

 

Final Thoughts

For any support related questions please visit the Nagios Support Forums at:

http://support.nagios.com/forum/

0 (0)
Article Rating (No Votes)
Rate this article
  • Icon PDFExport to PDF
  • Icon MS-WordExport to MS Word
Attachments Attachments
There are no attachments for this article.
Related Articles RSS Feed
Nagios Log Server - Waiting For Database Startup
Viewed 2432 times since Wed, Oct 12, 2016
Nagios Log Server - rsyslog and JSON Formatted Log Files
Viewed 1563 times since Thu, Mar 2, 2017
Nagios Log Server - Troubleshooting SELinux and rsyslog
Viewed 3465 times since Wed, Mar 30, 2016
Nagios Log Server - Troubleshooting Backups
Viewed 1896 times since Fri, Apr 15, 2016
Pages Not Displaying Correctly
Viewed 2567 times since Mon, Jan 25, 2016
Nagios Log Server - Understanding and Troubleshooting Yellow Cluster Health
Viewed 5093 times since Mon, Feb 15, 2016
Nagios Log Server - Administration Page Fails To Display
Viewed 2692 times since Thu, Jan 21, 2016
Nagios Log Server - Logstash not running after upgrade to 2.0
Viewed 1634 times since Tue, Nov 14, 2017
Nagios Log Server - Newline Character Added When Adding A Filter To A Search
Viewed 1929 times since Wed, Apr 27, 2016
Nagios Log Server - License Key Not Accepted
Viewed 1925 times since Wed, Apr 12, 2017