Nagios Support Forum

Posted: **Mon May 22, 2017 9:20 am**

Hi Team,

We are seeing an issue with our messages queue. It is filling up very fast. I have a device and it is sending the alert related to snmptrad info. But that device is not configured in this Nagios XI server. I have recycled all the services, reconfigured mysql and nagios. Please advise.

Code: Select all

 df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/mapper/vg_uusrcdlsbx00-lv_root
                      193G  181G  2.4G  99% /
tmpfs                 3.9G     0  3.9G   0% /dev/shm
/dev/sda1             477M   98M  355M  22% /boot
tmpfs                 500M   11M  490M   3% /var/nagiosramdisk

Code: Select all

Every 2.0s: ipcs -q                                                                                                                                                                                                  Mon May 22 09:17:09 2017


------ Message Queues --------
key        msqid      owner      perms      used-bytes   messages
0x61000002 2719744    nagios     600        101881856    99494

Code: Select all

Every 2.0s: ipcs -q                                                                                                                                                                                                  Mon May 22 09:17:25 2017


------ Message Queues --------
key        msqid      owner      perms      used-bytes   messages
0x61000002 2719744    nagios     600        102659072    100253

Code: Select all

tail -30 messages
May 22 08:55:42 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:42 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905400) 2 days, 15:37:34.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny tcp src dmz244:172.30.244.207/53663 dst outside:52.20.14.163/443 by access-group \"dmz244_access_in\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905400) 2 days, 15:37:34.00
May 22 08:55:42 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:42 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905400) 2 days, 15:37:34.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny tcp src dmz244:172.30.244.207/53663 dst outside:52.20.14.163/443 by access-group \"dmz244_access_in\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905400) 2 days, 15:37:34.00
May 22 08:55:42 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:42 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905400) 2 days, 15:37:34.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny tcp src dmz244:172.30.244.203/60318 dst outside:52.23.16.199/443 by access-group \"dmz244_access_in\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905400) 2 days, 15:37:34.00
May 22 08:55:42 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:42 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905400) 2 days, 15:37:34.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny tcp src dmz244:172.30.244.203/60318 dst outside:52.23.16.199/443 by access-group \"dmz244_access_in\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905400) 2 days, 15:37:34.00
May 22 08:55:43 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:43 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905400) 2 days, 15:37:34.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny udp src dmz244:172.30.244.34/1141 dst outside:52.23.16.199/443 by access-group \"dmz244_access_in\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905400) 2 days, 15:37:34.00
May 22 08:55:43 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:43 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905400) 2 days, 15:37:34.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny udp src dmz244:172.30.244.34/1141 dst outside:52.23.16.199/443 by access-group \"dmz244_access_in\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905400) 2 days, 15:37:34.00
May 22 08:55:44 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:43 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905400) 2 days, 15:37:34.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny tcp src outside:10.121.21.11/49697 dst dmz244:172.30.244.200/4508 by access-group \"outside_inside\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905400) 2 days, 15:37:34.00
May 22 08:55:44 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:43 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905400) 2 days, 15:37:34.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny tcp src outside:10.121.21.11/49697 dst dmz244:172.30.244.200/4508 by access-group \"outside_inside\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905400) 2 days, 15:37:34.00
May 22 08:55:44 lbschpnagxi00 xinetd[23215]: START: nrpe pid=1977 from=::ffff:10.10.83.97
May 22 08:55:44 lbschpnagxi00 xinetd[23215]: START: nrpe pid=1977 from=::ffff:10.10.83.97
May 22 08:55:44 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:44 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905400) 2 days, 15:37:34.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny tcp src dmz244:172.30.244.202/63839 dst outside:52.4.245.162/443 by access-group \"dmz244_access_in\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905400) 2 days, 15:37:34.00
May 22 08:55:44 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:44 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905400) 2 days, 15:37:34.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny tcp src dmz244:172.30.244.202/63839 dst outside:52.4.245.162/443 by access-group \"dmz244_access_in\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905400) 2 days, 15:37:34.00
May 22 08:55:45 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:45 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905400) 2 days, 15:37:34.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny udp src dmz244:172.30.244.64/50669 dst outside:10.128.3.10/53 by access-group \"dmz244_access_in\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905400) 2 days, 15:37:34.00
May 22 08:55:45 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:45 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905400) 2 days, 15:37:34.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny udp src dmz244:172.30.244.64/50669 dst outside:10.128.3.10/53 by access-group \"dmz244_access_in\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905400) 2 days, 15:37:34.00
May 22 08:55:45 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:45 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905400) 2 days, 15:37:34.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny tcp src outside:10.121.17.11/58012 dst dmz244:172.30.244.200/4508 by access-group \"outside_inside\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905400) 2 days, 15:37:34.00
May 22 08:55:45 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:45 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905400) 2 days, 15:37:34.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny tcp src outside:10.121.17.11/58012 dst dmz244:172.30.244.200/4508 by access-group \"outside_inside\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905400) 2 days, 15:37:34.00
May 22 08:55:46 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:46 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905400) 2 days, 15:37:34.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny tcp src outside:10.121.14.10/50312 dst dmz244:172.30.244.200/4508 by access-group \"outside_inside\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905400) 2 days, 15:37:34.00
May 22 08:55:46 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:46 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905400) 2 days, 15:37:34.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny tcp src outside:10.121.14.10/50312 dst dmz244:172.30.244.200/4508 by access-group \"outside_inside\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905400) 2 days, 15:37:34.00
May 22 08:55:46 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:46 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905400) 2 days, 15:37:34.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 7#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<166>May 22 2017 08:55:22 DALCFCFW01 : %ASA-6-302014: Teardown TCP connection 3433763 for outside:10.10.83.90/36785 to inside:dalcpiq00/5666 duration 0:00:03 bytes 2072 TCP FINs"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905400) 2 days, 15:37:34.00
May 22 08:55:46 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:46 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905400) 2 days, 15:37:34.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 7#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<166>May 22 2017 08:55:22 DALCFCFW01 : %ASA-6-302014: Teardown TCP connection 3433763 for outside:10.10.83.90/36785 to inside:dalcpiq00/5666 duration 0:00:03 bytes 2072 TCP FINs"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905400) 2 days, 15:37:34.00
May 22 08:55:47 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:47 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905500) 2 days, 15:37:35.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny tcp src outside:10.121.15.10/64739 dst dmz244:172.30.244.200/4508 by access-group \"outside_inside\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905500) 2 days, 15:37:35.00
May 22 08:55:47 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:47 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905500) 2 days, 15:37:35.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny tcp src outside:10.121.15.10/64739 dst dmz244:172.30.244.200/4508 by access-group \"outside_inside\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905500) 2 days, 15:37:35.00
May 22 08:55:47 lbschpnagxi00 xinetd[23215]: EXIT: nrpe status=0 pid=1977 duration=3(sec)
May 22 08:55:47 lbschpnagxi00 xinetd[23215]: EXIT: nrpe status=0 pid=1977 duration=3(sec)
May 22 08:55:48 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:47 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905500) 2 days, 15:37:35.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny tcp src outside:10.121.3.11/56619 dst dmz244:172.30.244.200/4508 by access-group \"outside_inside\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905500) 2 days, 15:37:35.00
May 22 08:55:48 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:47 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905500) 2 days, 15:37:35.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny tcp src outside:10.121.3.11/56619 dst dmz244:172.30.244.200/4508 by access-group \"outside_inside\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905500) 2 days, 15:37:35.00
May 22 08:55:48 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:48 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905500) 2 days, 15:37:35.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny tcp src outside:10.121.19.11/60675 dst dmz244:172.30.244.200/4508 by access-group \"outside_inside\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905500) 2 days, 15:37:35.00
May 22 08:55:48 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:48 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905500) 2 days, 15:37:35.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 5#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<164>May 22 2017 08:55:22 DALCFCFW01 : %ASA-4-106023: Deny tcp src outside:10.121.19.11/60675 dst dmz244:172.30.244.200/4508 by access-group \"outside_inside\" [0x0, 0x0]"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905500) 2 days, 15:37:35.00
May 22 08:55:49 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:48 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905500) 2 days, 15:37:35.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 7#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<166>May 22 2017 08:55:22 DALCFCFW01 : %ASA-6-302020: Built inbound ICMP connection for faddr 172.30.9.5/0 gaddr 10.10.241.10/0 laddr 10.10.241.10/0"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905500) 2 days, 15:37:35.00
May 22 08:55:49 lbschpnagxi00 snmptrapd[1062]: 2017-05-22 08:55:48 <UNKNOWN> [UDP: [10.10.241.10]:162->[10.80.86.100]]:#012DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (22905500) 2 days, 15:37:35.00#011SNMPv2-SMI::snmpModules.1.1.4.1.0 = OID: SNMPv2-SMI::enterprises.9.9.41.2.0.1#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.2.0 = STRING: "20"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.3.0 = INTEGER: 7#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.4.0 = STRING: "Syslog Trap"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.5.0 = STRING: "<166>May 22 2017 08:55:22 DALCFCFW01 : %ASA-6-302020: Built inbound ICMP connection for faddr 172.30.9.5/0 gaddr 10.10.241.10/0 laddr 10.10.241.10/0"#011SNMPv2-SMI::enterprises.9.9.41.1.2.3.1.6.0 = Timeticks: (22905500) 2 days, 15:37:35.00

Code: Select all

[root@lbschpnagxi00 scripts]#  echo "SELECT relname AS objectname, relkind AS objecttype, reltuples, pg_size_pretty(relpages::bigint*8*1024) AS size FROM pg_class WHERE relpages >= 8 ORDER BY relpages DESC;" | psql nagiosxi nagiosxi
           objectname            | objecttype |  reltuples  |  size
---------------------------------+------------+-------------+---------
 xi_meta                         | r          | 6.72173e+06 | 16 GB
 xi_events                       | r          | 7.77652e+06 | 649 MB
 xi_meta_keyname_idx             | i          | 6.72173e+06 | 516 MB
 xi_meta_metatype_id_idx         | i          | 6.72173e+06 | 381 MB
 event_time                      | i          | 7.77652e+06 | 329 MB
 xi_meta_pkey                    | i          | 6.72173e+06 | 300 MB
 xi_meta_metaobj_id_idx          | i          | 6.72173e+06 | 300 MB
 xi_events_pkey                  | i          | 7.77652e+06 | 262 MB

Posted: **Mon May 22, 2017 11:27 am**

It's very difficult to say what is going on with the current information.

It's possible you were out of space, which caused database issues.

Please run through https://assets.nagios.com/downloads/nag ... tabase.pdf and report any errors. If you stop at any point, please know at which point you stop.

If the repair script and other instructions in the document do not work, please continue.

Regarding the instructions below, if you do not have killall, you can install it via the following command:

Code: Select all

yum install psmisc

If psmisc is not in your repos, then instead you can check to make sure nagios is not running with

Code: Select all

ps -aef | grep nagios

If that document does not resolve your issue, please run the following commands in order and report any errors. You ***must*** use mariadb instead of mysqld in the commands below, ***if*** you have mariadb.

Code: Select all

service nagios stop
service ndo2db stop
service mysqld stop
service crond stop
service httpd stop
killall -9 nagios
killall -9 ndo2db
rm -f /usr/local/nagios/var/ndo.sock
rm -f /usr/local/nagios/var/ndo2db.lock
service ndo2db start
service nagios start
service mysqld start
service crond start
service httpd start

To get a better idea of what is going on, can you PM me your Profile? You can download it by going to Admin > System Config > System Profile and click the ***Download Profile*** button towards the top. If for whatever reason you *cannot* download the profile, please put the output of View System Info (5.3.4+, Show Profile if older) in the thread (that will at least get us some info). This will give us access to many of the logs we would otherwise ask for individually. If security is a concern, you can unzip the profile take out what you like, and then zip it up again. We may end up needing something you remove, but we can ask for that specifically.

After you PM the profile, please update this thread. Updating this thread is the only way for it to show back up on our dashboard.

Lastly, you will want to take a look at https://support.nagios.com/kb/article.php?id=139

Nagios Support Forum

Messages queue piling up

Messages queue piling up

Re: Messages queue piling up