Problem with nagiosgraph, stops appending to the rrd files

Support forum for Nagios Core, Nagios Plugins, NCPA, NRPE, NSCA, NDOUtils and more. Engage with the community of users including those using the open source solutions.
Locked
jobst
Posts: 16
Joined: Mon Jul 22, 2013 6:33 pm

Problem with nagiosgraph, stops appending to the rrd files

Post by jobst »

Hi,

I have been some very stange problems with nagiosgraph, it stops appending to the rrd files but the scheduler still works.
I have set the debug level to 5 to figure this one out, but nor error message appears, it just stops.

This is what happens:

1 /etc/rc.d/init.d/nagios restart
2 I see messages appear in /var/log/nagiosgraph/nagiosgraph.log, e.g "debug insert.pl processing started" and "Wed Jul 24 19:15:32 2013 p1.pl debug createrrd(1374657096,piquet,CPULOAD,user)" and so on
3 I can see the rrd files being created, e.g. "CurrentLoad___load15.rrd" in "/var/nagiosgraph/rrd/piquet"
4 I can see in the "Scheduling Queue" changing, e.g. if I sort by "Next Check (asc)" I can always see the next item on the top of the list that is next in the queue and this changes all the time
5 I can see the graphs for the services I want to plot, and I can see data being added to the graphs (if I refresh)
6 all seems ok
7 then suddenly the debug messages stop
8 the Scheduling Queue still changes (i.e. next one on top)
9 the rrd files are not appended anymore.
10 If I restart nagios the next time it will stop it will NOT be on the same service, it will stop at another one.

This is what I tried:

1 disabled all hosts but one host only
2 disabled all services but a couple for that one host
3 restarted nagios
4 then I started appending services and hosts again (inc restarting) waiting for a full cycle in the queue to see whether it stops
5 I checked all plugins for correct output on the command line

I have no idea what is going on, it simply stops appending data to the rrd files, the debug messages stop at the same time.

Any help is appreciated.
jobst
abrist
Red Shirt
Posts: 8334
Joined: Thu Nov 15, 2012 1:20 pm

Re: Problem with nagiosgraph, stops appending to the rrd fil

Post by abrist »

What version of core are you running?
Did you do any major changes/upgrades right before the behavior started?
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
Locked