Page 1 of 1

Graph Lag?

Posted: Mon Jul 29, 2013 11:09 am
by Pilly170
Hi,

On all my graphs it seems that nagios is lagging. For example the time is now 17:00

Image

But its only showing up until 16:15... the updates on this is to poll every 5 mins. its happening to all my graphs on my dashboard. The VM nagios is running on seems fine. No issues with the monitoring engine.


Any ideas?

Re: Graph Lag?

Posted: Mon Jul 29, 2013 11:23 am
by sreinhardt
Is your nagios server setup on ntp? Are the scheduled checks that are being scheduled now, also at this lagged time? Can you run the commands below please.

cat /etc/localtime
grep -i 'date.timezone' /etc/php.ini

Re: Graph Lag?

Posted: Tue Jul 30, 2013 3:31 am
by Pilly170
Thing is its ok now, but towards the end of day this happens. For instance at this moment it looks ok, just gets further and further behind.


LMTBSTGMTBDST
GMT0BST,M3.5.0/1,M10.5.0

[root@nagios ~]# grep -i 'date.timezone' /etc/php.ini
; http://www.php.net/manual/en/datetime.c ... e.timezone
date.timezone = Europe/London

Re: Graph Lag?

Posted: Tue Jul 30, 2013 9:40 am
by scottwilkerson
2 possible things:

1. there will be a lag if you have setup RRDCACHED

2. If not we should check the following when you are experiencing this

Code: Select all

ll /usr/local/nagios/var/spool/xidpe | wc -l
ll /usr/local/nagios/var/spool/perfdata | wc -l
tail /usr/local/nagios/var/npcd.log
tail /usr/local/nagios/var/perfdata.log

Re: Graph Lag?

Posted: Tue Jul 30, 2013 9:49 am
by Pilly170
I've never knowingly enable it so I did what you said. The logs were massive so I zipped them up.

[root@nagios ~]# ll /usr/local/nagios/var/spool/xidpe | wc -l
3

[root@nagios ~]# ll /usr/local/nagios/var/spool/perfdata | wc -l
8

https://dl.dropboxusercontent.com/u/519 ... s-Logs.zip

Re: Graph Lag?

Posted: Tue Jul 30, 2013 9:54 am
by scottwilkerson
Looks like you are hitting a default load limit.

If you have a fairly powerful machine you can increase it from the defaults

edit
change

Code: Select all

load_threshold = 10.0
to a higher value, 10*# of CPU's

Then

Code: Select all

service npcd restart

Re: Graph Lag?

Posted: Tue Jul 30, 2013 9:57 am
by Pilly170
edit what file?

Re: Graph Lag?

Posted: Tue Jul 30, 2013 10:12 am
by abrist

Code: Select all

vi /usr/local/nagios/etc/pnp/npcd.cfg
Change:

Code: Select all

load_threshold = 10.0
To:

Code: Select all

load_threshold = 20.0
Restart npcd:

Code: Select all

service npcd restart

Re: Graph Lag?

Posted: Tue Jul 30, 2013 10:19 am
by Pilly170
Thanks I've changed it and will monitor.

Re: Graph Lag?

Posted: Tue Jul 30, 2013 10:20 am
by abrist
No problem.