Graph Lag?

This support forum board is for support questions relating to Nagios XI, our flagship commercial network monitoring solution.
Locked
Pilly170
Posts: 75
Joined: Thu Mar 28, 2013 6:03 am

Graph Lag?

Post by Pilly170 »

Hi,

On all my graphs it seems that nagios is lagging. For example the time is now 17:00

Image

But its only showing up until 16:15... the updates on this is to poll every 5 mins. its happening to all my graphs on my dashboard. The VM nagios is running on seems fine. No issues with the monitoring engine.


Any ideas?
sreinhardt
-fno-stack-protector
Posts: 4366
Joined: Mon Nov 19, 2012 12:10 pm

Re: Graph Lag?

Post by sreinhardt »

Is your nagios server setup on ntp? Are the scheduled checks that are being scheduled now, also at this lagged time? Can you run the commands below please.

cat /etc/localtime
grep -i 'date.timezone' /etc/php.ini
Nagios-Plugins maintainer exclusively, unless you have other C language bugs with open-source nagios projects, then I am happy to help! Please pm or use other communication to alert me to issues as I no longer track the forum.
Pilly170
Posts: 75
Joined: Thu Mar 28, 2013 6:03 am

Re: Graph Lag?

Post by Pilly170 »

Thing is its ok now, but towards the end of day this happens. For instance at this moment it looks ok, just gets further and further behind.


LMTBSTGMTBDST
GMT0BST,M3.5.0/1,M10.5.0

[root@nagios ~]# grep -i 'date.timezone' /etc/php.ini
; http://www.php.net/manual/en/datetime.c ... e.timezone
date.timezone = Europe/London
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: Graph Lag?

Post by scottwilkerson »

2 possible things:

1. there will be a lag if you have setup RRDCACHED

2. If not we should check the following when you are experiencing this

Code: Select all

ll /usr/local/nagios/var/spool/xidpe | wc -l
ll /usr/local/nagios/var/spool/perfdata | wc -l
tail /usr/local/nagios/var/npcd.log
tail /usr/local/nagios/var/perfdata.log
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
Pilly170
Posts: 75
Joined: Thu Mar 28, 2013 6:03 am

Re: Graph Lag?

Post by Pilly170 »

I've never knowingly enable it so I did what you said. The logs were massive so I zipped them up.

[root@nagios ~]# ll /usr/local/nagios/var/spool/xidpe | wc -l
3

[root@nagios ~]# ll /usr/local/nagios/var/spool/perfdata | wc -l
8

https://dl.dropboxusercontent.com/u/519 ... s-Logs.zip
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: Graph Lag?

Post by scottwilkerson »

Looks like you are hitting a default load limit.

If you have a fairly powerful machine you can increase it from the defaults

edit
change

Code: Select all

load_threshold = 10.0
to a higher value, 10*# of CPU's

Then

Code: Select all

service npcd restart
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
Pilly170
Posts: 75
Joined: Thu Mar 28, 2013 6:03 am

Re: Graph Lag?

Post by Pilly170 »

edit what file?
abrist
Red Shirt
Posts: 8334
Joined: Thu Nov 15, 2012 1:20 pm

Re: Graph Lag?

Post by abrist »

Code: Select all

vi /usr/local/nagios/etc/pnp/npcd.cfg
Change:

Code: Select all

load_threshold = 10.0
To:

Code: Select all

load_threshold = 20.0
Restart npcd:

Code: Select all

service npcd restart
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
Pilly170
Posts: 75
Joined: Thu Mar 28, 2013 6:03 am

Re: Graph Lag?

Post by Pilly170 »

Thanks I've changed it and will monitor.
abrist
Red Shirt
Posts: 8334
Joined: Thu Nov 15, 2012 1:20 pm

Re: Graph Lag?

Post by abrist »

No problem.
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
Locked