All mysql nagios tables are Empty

Support forum for Nagios Core, Nagios Plugins, NCPA, NRPE, NSCA, NDOUtils and more. Engage with the community of users including those using the open source solutions.
deepak_symphony
Posts: 37
Joined: Wed Jan 28, 2015 4:18 pm
Location: India

Re: All mysql nagios tables are Empty

Post by deepak_symphony »

lnx0202:root# ll /usr/local/nagios/etc/
total 224
-rwxrwxrwx 1 root nagios 12015 Dec 12 01:10 cgi.cfg
-rwxrwxrwx 1 root nagios 26 Dec 10 07:05 htpasswd.users
-rwxrwxrwx 1 root nagios 45657 Feb 1 20:41 nagios.cfg
-rwxrwxrwx 1 root nagios 44475 Dec 11 06:11 nagios.cfg_backup
-rwxrwxrwx 1 root nagios 44550 Dec 11 06:44 nagios.cfg_error
-rwxrwxr-x 1 root nagios 4833 Feb 2 00:04 ndo2db.cfg
-rwxrwxr-x 1 root nagios 5131 Jan 29 15:38 ndomod.cfg
drwxrwxrwx 2 root nagios 4096 Feb 1 21:33 objects
-rwxrwxrwx 1 root nagios 1312 Dec 10 06:22 resource.cfg
lnx0202:root#
Configured ndoutils in nagios but all mysql nagios tables are empty
User avatar
tgriep
Madmin
Posts: 9190
Joined: Thu Oct 30, 2014 9:02 am

Re: All mysql nagios tables are Empty

Post by tgriep »

Try running this command and see if it fixes the issue.

Code: Select all

chown -R apache.nagios /usr/local/nagios/etc/
Be sure to check out our Knowledgebase for helpful articles and solutions!
deepak_symphony
Posts: 37
Joined: Wed Jan 28, 2015 4:18 pm
Location: India

Re: All mysql nagios tables are Empty

Post by deepak_symphony »

Performed change and tried still same issue, tables are empty.
Log file:
[1423016916] wproc: Registry request: name=Core Worker 13363;pid=13363
[1423016916] wproc: Registry request: name=Core Worker 13361;pid=13361
[1423016916] wproc: Registry request: name=Core Worker 13362;pid=13362
[1423016916] wproc: Registry request: name=Core Worker 13360;pid=13360
[1423016916] ndomod: NDOMOD 2.0.0 (02-28-2014) Copyright (c) 2009 Nagios Core Development Team and Community Contributors
[1423016916] ndomod: Could not open data sink! I'll keep trying, but some output may get lost...
[1423016916] ndomod registered for contact data'
[1423016916] ndomod registered for contact notification data'
[1423016916] Event broker module '/usr/local/nagios/bin/ndomod.o' initialized successfully.
[1423016918] Successfully launched command file worker with pid 13364
--------------------------------------------------------------------------------------------------------------------------------------
mysql> select count(*) from nagios_hosts;
+----------+
| count(*) |
+----------+
| 0 |
+----------+
1 row in set (0.01 sec)
Configured ndoutils in nagios but all mysql nagios tables are empty
deepak_symphony
Posts: 37
Joined: Wed Jan 28, 2015 4:18 pm
Location: India

Re: All mysql nagios tables are Empty

Post by deepak_symphony »

Logs looks like this:

[1423043470] ndomod: Error writing to data sink! Some output may get lost...
[1423043470] ndomod: Please check remote ndo2db log, database connection or SSL Parameters
[1423043472] Successfully launched command file worker with pid 23092
[1423043486] ndomod: Still unable to reconnect to data sink. 0 items lost, 471 queued items to flush.
[1423043489] Caught SIGTERM, shutting down...
[1423043489] Successfully shutdown... (PID=15949)
[1423043489] Event broker module 'NERD' deinitialized successfully.
[1423043489] ndomod: Shutdown complete.
[1423043489] Event broker module '/usr/local/nagios/bin/ndomod.o' deinitialized successfully.
[1423043638] Nagios 4.0.8 starting... (PID=23459)
[1423043638] Local time is Wed Feb 04 03:53:58 CST 2015
[1423043638] LOG VERSION: 2.0
[1423043638] qh: Socket '/usr/local/nagios/var/rw/nagios.qh' successfully initialized
[1423043638] qh: core query handler registered
[1423043638] nerd: Channel hostchecks registered successfully
[1423043638] nerd: Channel servicechecks registered successfully
[1423043638] nerd: Channel opathchecks registered successfully
[1423043638] nerd: Fully initialized and ready to rock!
[1423043638] wproc: Successfully registered manager as @wproc with query handler
[1423043638] wproc: Registry request: name=Core Worker 23461;pid=23461
[1423043638] wproc: Registry request: name=Core Worker 23462;pid=23462
[1423043638] wproc: Registry request: name=Core Worker 23466;pid=23466
[1423043638] wproc: Registry request: name=Core Worker 23463;pid=23463
[1423043638] wproc: Registry request: name=Core Worker 23464;pid=23464
[1423043638] wproc: Registry request: name=Core Worker 23465;pid=23465
[1423043638] ndomod: NDOMOD 2.0.0 (02-28-2014) Copyright (c) 2009 Nagios Core Development Team and Community Contributors
[1423043638] ndomod: Successfully connected to data sink. 484 queued items to flush.
[1423043643] Caught SIGTERM, shutting down...
[1423043653] Nagios 4.0.8 starting... (PID=23544)
[1423043653] Local time is Wed Feb 04 03:54:13 CST 2015
Configured ndoutils in nagios but all mysql nagios tables are empty
abrist
Red Shirt
Posts: 8334
Joined: Thu Nov 15, 2012 1:20 pm

Re: All mysql nagios tables are Empty

Post by abrist »

deepak_symphony wrote:[1423043638] ndomod: Successfully connected to data sink. 484 queued items to flush.
Alright, so ndomod is connecting to ndo2db. We need to see the ndo logs, increase the debug level by editing:

Code: Select all

/usr/local/nagios/etc/ndo2db.cfg
Set the debug to 2:

Code: Select all

debug_level=2
debug_verbosity=2
Restart ndo2db:

Code: Select all

service ndo2db restart
Wait some time, and then tail the debug log:

Code: Select all

tail -50 /usr/local/nagios/var/ndo2db.debug
And failed queries may log to the system logger, so tail that too:

Code: Select all

tail -50 /var/log/messages
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
deepak_symphony
Posts: 37
Joined: Wed Jan 28, 2015 4:18 pm
Location: India

Re: All mysql nagios tables are Empty

Post by deepak_symphony »

lnx0202:root# tail -50 /var/log/messages
Feb 4 20:38:29 lnx0202 nagios: ndomod registered for downtime data'
Feb 4 20:38:29 lnx0202 nagios: ndomod registered for flapping data'
Feb 4 20:38:29 lnx0202 nagios: ndomod registered for program status data'
Feb 4 20:38:29 lnx0202 nagios: ndomod registered for host status data'
Feb 4 20:38:29 lnx0202 nagios: ndomod registered for service status data'
Feb 4 20:38:29 lnx0202 nagios: ndomod registered for adaptive program data'
Feb 4 20:38:29 lnx0202 nagios: ndomod registered for adaptive host data'
Feb 4 20:38:29 lnx0202 nagios: ndomod registered for adaptive service data'
Feb 4 20:38:29 lnx0202 nagios: ndomod registered for external command data'
Feb 4 20:38:29 lnx0202 nagios: ndomod registered for aggregated status data'
Feb 4 20:38:29 lnx0202 nagios: ndomod registered for retention data'
Feb 4 20:38:29 lnx0202 nagios: ndomod registered for contact data'
Feb 4 20:38:29 lnx0202 nagios: ndomod registered for contact notification data'
Feb 4 20:38:29 lnx0202 nagios: ndomod registered for acknowledgement data'
Feb 4 20:38:29 lnx0202 nagios: ndomod registered for contact status data'
Feb 4 20:38:29 lnx0202 nagios: ndomod registered for adaptive contact data'
Feb 4 20:38:29 lnx0202 nagios: Event broker module '/usr/local/nagios/bin/ndomod.o' initialized successfully.
Feb 4 20:38:31 lnx0202 nagios: Successfully launched command file worker with pid 1297
Feb 4 20:38:47 lnx0202 nagios: ndomod: Still unable to connect to data sink. 0 items lost, 1375 queued items to flush.
Feb 4 20:39:03 lnx0202 nagios: ndomod: Still unable to connect to data sink. 0 items lost, 1395 queued items to flush.
Feb 4 20:39:19 lnx0202 nagios: ndomod: Still unable to connect to data sink. 0 items lost, 1414 queued items to flush.
Feb 4 20:39:38 lnx0202 nagios: ndomod: Still unable to connect to data sink. 0 items lost, 1440 queued items to flush.
Feb 4 20:39:55 lnx0202 nagios: ndomod: Still unable to connect to data sink. 0 items lost, 1476 queued items to flush.
Feb 4 20:40:12 lnx0202 nagios: ndomod: Still unable to connect to data sink. 0 items lost, 1521 queued items to flush.
Feb 4 20:40:25 lnx0202 snmpd[1833]: Connection from UDP: [171.74.58.58]:53269->[10.106.10.197]
Feb 4 20:40:25 lnx0202 snmpd[1833]: Connection from UDP: [171.74.58.58]:53269->[10.106.10.197]
Feb 4 20:40:25 lnx0202 snmpd[1833]: Connection from UDP: [171.74.58.58]:53270->[10.106.10.197]
Feb 4 20:40:25 lnx0202 snmpd[1833]: Connection from UDP: [171.74.58.58]:53270->[10.106.10.197]
Feb 4 20:40:25 lnx0202 snmpd[1833]: Connection from UDP: [171.74.58.58]:53271->[10.106.10.197]
Feb 4 20:40:25 lnx0202 snmpd[1833]: Connection from UDP: [171.74.58.58]:53271->[10.106.10.197]
Feb 4 20:40:25 lnx0202 snmpd[1833]: Connection from UDP: [171.74.58.58]:53272->[10.106.10.197]
Feb 4 20:40:25 lnx0202 snmpd[1833]: Connection from UDP: [171.74.58.58]:53272->[10.106.10.197]
Feb 4 20:40:25 lnx0202 snmpd[1833]: Connection from UDP: [171.74.58.58]:53273->[10.106.10.197]
Feb 4 20:40:25 lnx0202 snmpd[1833]: Connection from UDP: [171.74.58.58]:53273->[10.106.10.197]
Feb 4 20:40:25 lnx0202 snmpd[1833]: Connection from UDP: [171.74.58.58]:53273->[10.106.10.197]
Feb 4 20:40:25 lnx0202 snmpd[1833]: Connection from UDP: [171.74.58.58]:53273->[10.106.10.197]
Feb 4 20:40:25 lnx0202 snmpd[1833]: Connection from UDP: [171.74.58.58]:53273->[10.106.10.197]
Feb 4 20:40:25 lnx0202 snmpd[1833]: Connection from UDP: [171.74.58.58]:53273->[10.106.10.197]
Feb 4 20:40:25 lnx0202 snmpd[1833]: Connection from UDP: [171.74.58.58]:53273->[10.106.10.197]
Feb 4 20:40:25 lnx0202 snmpd[1833]: Connection from UDP: [171.74.58.58]:53273->[10.106.10.197]
Feb 4 20:40:25 lnx0202 snmpd[1833]: Connection from UDP: [171.74.58.58]:53273->[10.106.10.197]
Feb 4 20:40:25 lnx0202 snmpd[1833]: Connection from UDP: [171.74.58.58]:53273->[10.106.10.197]
Feb 4 20:40:28 lnx0202 nagios: ndomod: Still unable to connect to data sink. 0 items lost, 1556 queued items to flush.
Feb 4 20:40:44 lnx0202 nagios: ndomod: Still unable to connect to data sink. 0 items lost, 1598 queued items to flush.
Feb 4 20:41:02 lnx0202 nagios: ndomod: Still unable to connect to data sink. 0 items lost, 1633 queued items to flush.
Feb 4 20:41:18 lnx0202 nagios: ndomod: Still unable to connect to data sink. 0 items lost, 1668 queued items to flush.
Feb 4 20:41:34 lnx0202 nagios: ndomod: Still unable to connect to data sink. 0 items lost, 1707 queued items to flush.
Feb 4 20:41:50 lnx0202 nagios: ndomod: Still unable to connect to data sink. 0 items lost, 1756 queued items to flush.
Feb 4 20:42:08 lnx0202 nagios: ndomod: Successfully connected to data sink. 1796 queued items to flush.
Feb 4 20:42:08 lnx0202 nagios: ndomod: Successfully flushed 1796 queued items to data sink.
Configured ndoutils in nagios but all mysql nagios tables are empty
deepak_symphony
Posts: 37
Joined: Wed Jan 28, 2015 4:18 pm
Location: India

Re: All mysql nagios tables are Empty

Post by deepak_symphony »

But still all tables are empty:

mysql> select count(*) from nagios_hosts;
+----------+
| count(*) |
+----------+
| 0 |
+----------+
1 row in set (0.00 sec)

mysql> select count(*) from nagios_service_contacts;
+----------+
| count(*) |
+----------+
| 0 |
+----------+
1 row in set (0.00 sec)
Configured ndoutils in nagios but all mysql nagios tables are empty
deepak_symphony
Posts: 37
Joined: Wed Jan 28, 2015 4:18 pm
Location: India

Re: All mysql nagios tables are Empty

Post by deepak_symphony »

Debug file is empty nothing generated in it.


tail -50 /usr/local/nagios/var/ndo2db.debug
lnx0202:root# cd /usr/local/nagios/var
lnx0202:root# ls -lrt
total 1112
drwxr-xr-x 3 nagios nagios 4096 Dec 10 06:22 spool
srwxr-xr-x 1 nagios nagios 0 Jan 20 12:00 ndo.sock_back
-rwxr-xr-x 1 nagios nagios 0 Jan 22 15:31 ndo2db.debug
-rwxr-xr-x 1 nagios nagios 13092 Jan 29 14:41 host-perfdata.out
-rwxr-xr-x 1 nagios nagios 13512 Jan 29 14:41 host-perfdata
-rwxr-xr-x 1 nagios nagios 97992 Jan 29 14:41 service-perfdata.out
-rwxr-xr-x 1 nagios nagios 101976 Jan 29 14:41 service-perfdata
-rwxr-xr-x 1 nagios nagios 149251 Jan 29 23:39 nagios.log_old
-rwxr-xr-x 1 nagios nagios 129288 Feb 4 20:38 objects.precache
-rwxr-xr-x 1 nagios nagios 129288 Feb 4 20:38 objects.cache
-rw-r--r-- 1 nagios nagios 5 Feb 4 20:38 nagios.lock
-rw-r--r-- 1 nagios nagios 34 Feb 4 20:38 nagios.configtest
drwxr-sr-x 2 nagios nagios 4096 Feb 4 20:38 rw
srwxr-xr-x 1 nagios nagios 0 Feb 4 20:41 ndo.sock
-rw-r--r-- 1 nagios nagios 5 Feb 4 20:41 ndo2db.lock
-rw------- 1 nagios nagios 204742 Feb 4 23:38 retention.dat
drwxr-xr-x 2 nagios nagios 4096 Feb 4 23:59 archives
-rwxr-xr-x 1 nagios nagios 26449 Feb 5 00:22 nagios.log
-rw-rw-r-- 1 nagios nagios 204049 Feb 5 00:23 status.dat
Configured ndoutils in nagios but all mysql nagios tables are empty
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: All mysql nagios tables are Empty

Post by scottwilkerson »

Please run the following from your Nagios server and report the output

Code: Select all

mysql -h 10.106.10.197 -u nagios -pnagios
Former Nagios employee
Creator:
Human Design Website
Get Your Human Design Chart
deepak_symphony
Posts: 37
Joined: Wed Jan 28, 2015 4:18 pm
Location: India

Re: All mysql nagios tables are Empty

Post by deepak_symphony »

lnx0202:root# mysql -h 10.106.10.197 -u nagios -pnagiosmysql -h 10.106.10.197 -u nagios -pnagios
ERROR 1045 (28000): Access denied for user 'nagios'@'lnx0202.ch3.prod.i.com' (using password: YES)
lnx0202:root#
Configured ndoutils in nagios but all mysql nagios tables are empty
Locked