Page 1 of 1

plugin timed out?

Posted: Tue Mar 12, 2019 10:31 pm
by xpertech
upgrade NagiosXI from 5.4.11 to 5.5.11 last week, after that there're a lot report "plugin timed out" from time to time, but before upgraded there're no such problem?!

Re: plugin timed out?

Posted: Wed Mar 13, 2019 12:38 pm
by cdienger
Are all of these hosts in the screenshot using the same plugin? Please PM me a profile taken while it is in this state so I can take a closer look at things. A profile can be created under Admin > System Config > System Profile > Download Profile.

Re: plugin timed out?

Posted: Thu Mar 14, 2019 11:07 am
by cdienger
The profile shows database corruption and multiple ipcs queues. Repair the database following https://assets.nagios.com/downloads/nag ... tabase.pdf and then restart everything to give it a clean start:

Code: Select all

systemctl stop crond
systemctl stop npcd
systemctl stop nagios
systemctl stop ndo2db
pkill -9 -u nagios
for i in $(ipcs -q | grep nagios |awk '{print $2}'); do ipcrm -q $i; done
rm -rf /usr/local/nagiosxi/var/dbmaint.lock
rm -rf /usr/local/nagiosxi/var/event_handler.lock
rm -rf /usr/local/nagiosxi/scripts/reconfigure_nagios.lock
systemctl stop mysqld
systemctl start mysqld
systemctl start ndo2db
systemctl start nagios
systemctl start npcd
systemctl start crond
systemctl start httpd

Re: plugin timed out?

Posted: Sun Mar 17, 2019 8:56 pm
by xpertech
cdienger wrote:The profile shows database corruption and multiple ipcs queues. Repair the database following https://assets.nagios.com/downloads/nag ... tabase.pdf and then restart everything to give it a clean start:

Code: Select all

systemctl stop crond
systemctl stop npcd
systemctl stop nagios
systemctl stop ndo2db
pkill -9 -u nagios
for i in $(ipcs -q | grep nagios |awk '{print $2}'); do ipcrm -q $i; done
rm -rf /usr/local/nagiosxi/var/dbmaint.lock
rm -rf /usr/local/nagiosxi/var/event_handler.lock
rm -rf /usr/local/nagiosxi/scripts/reconfigure_nagios.lock
systemctl stop mysqld
systemctl start mysqld
systemctl start ndo2db
systemctl start nagios
systemctl start npcd
systemctl start crond
systemctl start httpd


the command seems not work?!

Re: plugin timed out?

Posted: Mon Mar 18, 2019 11:32 am
by cdienger
Sorry, looks like you're running mariadb. Try stopping and starting with these commands instead:

Code: Select all

systemctl stop mariadb
systemctl start mariadb

Re: plugin timed out?

Posted: Thu Mar 21, 2019 1:58 am
by xpertech
After run the commands, it seems that after upgraded NagiosXI still has a lot of "plugin timed out" (compared to another NagiosXI which before upgraded).

Re: plugin timed out?

Posted: Thu Mar 21, 2019 11:39 am
by cdienger
Let's gather a fresh profile so we can confirm the database problem is resolved. It'd probably be best to work this through a ticket too. Feel free to open on at https://support.nagios.com/tickets and attach the profile to the case.

Re: plugin timed out?

Posted: Wed Mar 27, 2019 10:39 am
by xpertech
Today there were a lot of "Service check timed out after seconds" alert on the Production Host Nagios XI 5.4.11, but in the same time the Backup Nagios XI 5.5.11 didn't get any alert, it seems that something wrong after upgraded.

Re: plugin timed out?

Posted: Wed Mar 27, 2019 10:57 am
by cdienger
A ticket has been opened for this so we'll lock this up and continue working through the ticket.