Core 4.0.8 / NDO2DB v2.0.0
Posted: Wed Nov 19, 2014 1:52 pm
short story - database is not being populated , after some time the error 'Error: max retries exceeded sending message to queue. Kernel queue parameters may neeed to be tuned. See README.' appears , i have adjusted tuning suitably and can not see any connections between my sql server and nagios server form either end.
the ndo2db daemon doesn't seem to do anything, More details below and how its setup
I can connect fine manually from this host / credentials / permission / firewalls have all been checked and confirmed good,
The only thing different about my setup is that the mysql install is on a separate server and uses a custom ip (custom ip is set in ndo2db.cfg)
Due to this i could not run the 'installdb' setup script as i cannot find a way to specify the port , if i used -h ipaddress:port it would see the whole string as a host name and i could not find a way around it - i then just imported the mysql.sql to setup the db , created the user , and assigned permissions - this is the only thing that wasnt setup quite as it should be , im not convinced its the issue though. The fact i can see no communication between this box and the mysql box at all while its running points out the problem - i see no connections on the network and nothing in mariadb log or the ndo2db log but have no idea where to look now
I can start ndo2db deamon and all says successful in nagios log and /var/log/messages log . i ran through the config files many times and im sure all is fine but nothing in db is populated.
I just cannot see any evidence of an attempted connection out from this server, monitoring connections i done see any communication at all - if i manually initiate a connection from command line using same details i see it straight away.
I get no errors until it has been running for some time,then i get ndo2db[14021]: Error: max retries exceeded sending message to queue. Kernel queue parameters may neeed to be tuned. See README.
I don't think that the tuning is the issue, initially i had errors regarding max bytes being used and i adjusted settings and everything looked good - but after a while with it not pushing anything to the db these messages must be backing up somewhere
log below shows restart of ndo2db then nagios
can anyone provide any pointer where i can look , or is my configuration just not supported ?
any help much appreciated.
Thanks
the ndo2db daemon doesn't seem to do anything, More details below and how its setup
I can connect fine manually from this host / credentials / permission / firewalls have all been checked and confirmed good,
The only thing different about my setup is that the mysql install is on a separate server and uses a custom ip (custom ip is set in ndo2db.cfg)
Due to this i could not run the 'installdb' setup script as i cannot find a way to specify the port , if i used -h ipaddress:port it would see the whole string as a host name and i could not find a way around it - i then just imported the mysql.sql to setup the db , created the user , and assigned permissions - this is the only thing that wasnt setup quite as it should be , im not convinced its the issue though. The fact i can see no communication between this box and the mysql box at all while its running points out the problem - i see no connections on the network and nothing in mariadb log or the ndo2db log but have no idea where to look now
I can start ndo2db deamon and all says successful in nagios log and /var/log/messages log . i ran through the config files many times and im sure all is fine but nothing in db is populated.
I just cannot see any evidence of an attempted connection out from this server, monitoring connections i done see any communication at all - if i manually initiate a connection from command line using same details i see it straight away.
I get no errors until it has been running for some time,then i get ndo2db[14021]: Error: max retries exceeded sending message to queue. Kernel queue parameters may neeed to be tuned. See README.
I don't think that the tuning is the issue, initially i had errors regarding max bytes being used and i adjusted settings and everything looked good - but after a while with it not pushing anything to the db these messages must be backing up somewhere
log below shows restart of ndo2db then nagios
Code: Select all
Nov 19 17:43:54 nagiosserver systemd: Starting LSB: Nagios NDO2DB Initscript...
Nov 19 17:43:54 nagiosserver ndo2db: Starting ndo2db: done.
Nov 19 17:43:54 nagiosserver systemd: Started LSB: Nagios NDO2DB Initscript.
Nov 19 17:44:09 nagiosserver nagios: ndomod: Successfully reconnected to data sink! 0 items lost, 822 queued items to flush.
Nov 19 17:44:09 nagiosserver nagios: ndomod: Successfully flushed 822 queued items to data sink.
Nov 19 17:44:09 nagiosserver systemd: Stopping LSB: Starts and stops the Nagios monitoring server...
Nov 19 17:44:09 nagiosserver nagios: Stopping nagios:No lock file found in /usr/local/nagios/var/nagios.lock
Nov 19 17:44:09 nagiosserver systemd: nagios.service: control process exited, code=exited status=1
Nov 19 17:44:09 nagiosserver systemd: Unit nagios.service entered failed state.
Nov 19 17:44:09 nagiosserver systemd: Starting LSB: Starts and stops the Nagios monitoring server...
Nov 19 17:44:09 nagiosserver nagios: Warning: use_embedded_perl_implicitly is deprecated and will be removed.
Nov 19 17:44:09 nagiosserver nagios: Warning: enable_embedded_perl is deprecated and will be removed.
Nov 19 17:44:09 nagiosserver nagios: Warning: p1_file is deprecated and will be removed.
Nov 19 17:44:09 nagiosserver nagios: Warning: sleep_time is deprecated and will be removed.
Nov 19 17:44:09 nagiosserver nagios: Warning: external_command_buffer_slots is deprecated and will be removed. All commands are always processed upon arrival
Nov 19 17:44:09 nagiosserver nagios: Warning: command_check_interval is deprecated and will be removed. Commands are always handled on arrival
Nov 19 17:44:09 nagiosserver nagios: Nagios 4.0.8 starting... (PID=17472)
Nov 19 17:44:09 nagiosserver nagios: Local time is Wed Nov 19 17:44:09 UTC 2014
Nov 19 17:44:09 nagiosserver nagios: LOG VERSION: 2.0
Nov 19 17:44:09 nagiosserver nagios: qh: Socket '/usr/local/nagios/var/rw/nagios.qh' successfully initialized
Nov 19 17:44:09 nagiosserver nagios: qh: core query handler registered
Nov 19 17:44:09 nagiosserver nagios: nerd: Channel hostchecks registered successfully
Nov 19 17:44:09 nagiosserver nagios: nerd: Channel servicechecks registered successfully
Nov 19 17:44:09 nagiosserver nagios: nerd: Channel opathchecks registered successfully
Nov 19 17:44:09 nagiosserver nagios: nerd: Fully initialized and ready to rock!
Nov 19 17:44:09 nagiosserver nagios: wproc: Successfully registered manager as @wproc with query handler
Nov 19 17:44:09 nagiosserver nagios: Starting nagios: done.
Nov 19 17:44:09 nagiosserver systemd: Started LSB: Starts and stops the Nagios monitoring server.
Nov 19 17:44:09 nagiosserver nagios: wproc: Registry request: name=Core Worker 17475;pid=17475
Nov 19 17:44:09 nagiosserver nagios: wproc: Registry request: name=Core Worker 17477;pid=17477
Nov 19 17:44:09 nagiosserver nagios: wproc: Registry request: name=Core Worker 17476;pid=17476
Nov 19 17:44:09 nagiosserver nagios: wproc: Registry request: name=Core Worker 17474;pid=17474
Nov 19 17:44:09 nagiosserver nagios: ndomod: NDOMOD 2.0.0 (02-28-2014) Copyright (c) 2009 Nagios Core Development Team and Community Contributors
Nov 19 17:44:09 nagiosserver nagios: ndomod: Successfully connected to data sink. 357 queued items to flush.
Nov 19 17:44:09 nagiosserver nagios: ndomod: Successfully flushed 357 queued items to data sink.
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for process data
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for timed event data
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for log data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for system command data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for event handler data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for notification data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for service check data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for host check data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for comment data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for downtime data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for flapping data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for program status data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for host status data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for service status data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for adaptive program data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for adaptive host data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for adaptive service data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for external command data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for aggregated status data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for retention data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for contact data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for contact notification data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for acknowledgement data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for contact status data'
Nov 19 17:44:09 nagiosserver nagios: ndomod registered for adaptive contact data'
Nov 19 17:44:09 nagiosserver nagios: Event broker module '/usr/local/nagios/bin/ndomod.o' initialized successfully.
Nov 19 17:44:09 nagiosserver nagios: Warning: failure_prediction_enabled is obsoleted and no longer has any effect in host type objects (config file '/usr/local/nagios/etc/objects/templates.cfg', starting at line 52)
Nov 19 17:44:09 nagiosserver nagios: Warning: failure_prediction_enabled is obsoleted and no longer has any effect in service type objects (config file '/usr/local/nagios/etc/objects/templates.cfg', starting at line 169)
Nov 19 17:44:16 nagiosserver nagios: Successfully launched command file worker with pid 17492
can anyone provide any pointer where i can look , or is my configuration just not supported ?
any help much appreciated.
Thanks