Nagios XI - ICMP and Ping Checks Stopped Graphing

Problem Description

Due to issues with rrdtool and the performance graphs, rrdtool may cease to record performance data to RRDs from check_icmp. This is caused by the addition of new performance datasources returned from the check_icmp plugin in newer versions of nagios-plugins.

This problem appeared after upgrading to XI 2014

The problem also exists with any performance data where additional datasources are returned with the performance data, compared to when the original performance data was received for this service.

We provide a script to search for, and subsequently add, the missing datasources to the RRDs in question. For those upgrading to 2014, this script will essentially double the size of all ping/icmp RRDs. Please verify that your XI server has ample free space before running the script (the backups consume the extra space).

You should backup your XI server, either through a VM snapshot or a full XI Backup. The script does provide a way to make backups of your RRDs, but it is better to perform the backup through one of the two above mentioned actions.

The script can be downloaded from: http://assets.nagios.com/downloads/nagiosxi/scripts/rrd_ds_fix.zip

Resolving The Problem

The following steps will check all the rrd files to ensure they have a valid amount of datasources.

First a Perl package needs to be installed using one of the commands below:

RHEL | CentOS | Oracle Linux

cpan -i RRD::Simple

Debian | Ubuntu

apt-get install -y librrd-simple-perl

Download and unzip the required files:

cd /tmp
wget https://assets.nagios.com/downloads/nagiosxi/scripts/rrd_ds_fix.zip
unzip rrd_ds_fix.zip

To run the script with RRD backups:

./fix_ds_quantity.sh -d /usr/local/nagios/share/perfdata/

To run the script without RRD backups (if you have performed one of the suggested backup options above):

./fix_ds_quantity.sh -i -d /usr/local/nagios/share/perfdata/

This Process may take a considerable amount of time depending on many RRDs needed to be updated. The script logs to /tmp/fix_rrd_ds.log. Once completed, it may take 5-10 minutes for the new datasources to appear in the performance graphs tab (longer if rrdcached is used).

Final Thoughts

For any support related questions please visit the Nagios Support Forums at:

http://support.nagios.com/forum/