Solved: No graphs for Cisco network devices

[tguadagnin]

Hi Support,

I seem to have destroyed all my graphing abilities somehow.
I manually removed all the rrd files since I made major changes to our infrastructure and did not require the histories of our graphs.
pon re-adding the switches to Nagios, I have found that data is no longer being accumulated for the switches. I've followed everything mentioned in the nagios docs and in the nagios FAQ surrounding graphs / perfmon / rrdcache to no avail.

1) Nagios XI 2012R1.6
2) CentOS release 5.8 (Final)
3) Linux nagios 2.6.18-308.24.1.el5 #1 SMP Tue Dec 4 17:42:30 EST 2012 i686 i686 i386 GNU/Linux
4) XI VMware Image
5) No other special installed software/features.

[scottwilkerson]

Is everything green in Admin -> Monitoring Engine Status ?

Can you post the output of

Code: Select all

ls -ld /usr/local/nagios
ls -ld /usr/local/nagios/share
ls -ld /usr/local/nagios/share/perfdata

[tguadagnin]

All is green in the Admin-> Component status list (including monitoring engine).

Output as follows;

drwxr-xr-x 8 root root 4096 Jan 12 2010 /usr/local/nagios
drwxrwxr-x 14 nagios nagios 4096 Dec 10 14:07 /usr/local/nagios/share
drwxrwxr-x 110 nagios nagios 4096 Mar 15 10:22 /usr/local/nagios/share/perfdata

[abrist]

If it is just the switches and routers that are having graph problems, but not the ping,etc. checks, you may want to walk through the following document:
http://assets.nagios.com/downloads/nagi ... Router.pdf

[tguadagnin]

Hi Abrist,

I've followed that document before whilst troubleshooting and it didnt help the problem.
Ill follow it again now though.
My steps..
1) Create new /etc/mrtg/mrtg.cfg file with 'WorkDir: /var/www/mrtg/'
2) Deleted all services and host configuration from core config manager.
3) Archived all switch related files in '/var/www/mrtg/'
3) Re-adding the network switch via Configuration Wizard.
-> Monitoring Wizard -> Network Switch/Router -> Fill out all details for cisco switch -> Done.

All the new files have been created inside /var/www/mrtg.
The /etc/mrtg/mrtg.cfg file is not populating with interface/switch information.
There are no files generated inside /var/lib/mrtg. Messages log is telling me repeatedly that '..../var/lib/mrtg/xxxxxx_xx.rrd does not exist.'

Whatever the issue is, it must be that whatever creates the rrd files is not doing its job?

[tguadagnin]

I've changed the permissions on the mrtg.cfg file, deleted the created files inside /var/www/mrtg, deleted the host and service config out of nagiosxi.

Ive readded my core switch again, this time the mrtg.cfg file has populated (due to permission change, my bad on that one).
Its created all the related files inside /var/www/mrtg.

There are still no .rrd files being generated in /var/lib/mrtg though, which is why all my graphs/bandwidth services are failing.

rrdtool must be the problem here?

[abrist]

Are there any rrd files in /var/lib/mrtg and what are the directory's permissions?

Code: Select all

ls -la /var/lib/mrtg
ls -ld /var/lib/mrtg

[tguadagnin]

Hi,

No, there are zero files being created inside /var/lib/mrtg.

[root@nagios ~]# ls -la /var/lib/mrtg
total 32
drwxrwxrwx 2 root root 16384 Mar 15 10:21 .
drwxr-xr-x 33 root root 4096 Mar 15 10:20 ..
-rw-r--r-- 1 root root 0 Jul 19 2010 mrtg.ok
[root@nagios ~]# ls -ld /var/lib/mrtg
drwxrwxrwx 2 root root 16384 Mar 15 10:21 /var/lib/mrtg
[root@nagios ~]# ls -ld /var/lib/mrtg/
drwxrwxrwx 2 root root 16384 Mar 15 10:21 /var/lib/mrtg/
[root@nagios ~]# ls -la /var/lib/mrtg/
total 32
drwxrwxrwx 2 root root 16384 Mar 15 10:21 .
drwxr-xr-x 33 root root 4096 Mar 15 10:20 ..
-rw-r--r-- 1 root root 0 Jul 19 2010 mrtg.ok
[root@nagios ~]#

[sreinhardt]

There are still no .rrd files being generated in /var/lib/mrtg though, which is why all my graphs/bandwidth services are failing.

rrdtool must be the problem here?

To confirm what I am reading, you are unable to even get the network speed results or you have additional checks on the rrds specifically? The port speeds should always show regardless of rrdtool working and rrds being generated, however if you are not getting any results, we need to look at the remote devices. Has your IP on the nagios box changed? What results do you get back with the following command?

nmap -sU -p 161 [IP of switch\router]

[tguadagnin]

No changes to the IP addresses of any of my network switches. Everything was fine 6 months ago up to the point I went and updated a heap of interface names and wanted to add a new WAN link to for bandwidth monitoring. Ever since I deleted all the config in nagios, graphs, etc; it has never graphed right after that, always failing with the same missing .rrd issue.

Code: Select all

Starting Nmap 5.00 ( http://nmap.org ) at 2013-05-17 10:44 EST
Interesting ports on sw-6500.ap.acncorp.com (10.150.11.1):
PORT    STATE         SERVICE
161/udp open|filtered snmp

Nmap done: 1 IP address (1 host up) scanned in 0.90 seconds

The switch adds to Nagiosxi correctly.. All the ports are discovered, interface names, etc.

I'm not sure what you mean by 'unable to get network speed results'?
Nagios wizard configures two services for each port, Status and Bandwidth.
The Status for each port is fine.
The Bandwidth for each port is broken because it is trying to use the command, $USER1$/check_rrdtraf -f /var/lib/mrtg/$ARG1$ -w $ARG2$ -c $ARG3$ -l $ARG4$ and there are no .rrd files in /var/lib/mrtg/.