Log file filling up with Cannot adopt OID messages

[lorejo]

We recently upgraded to XI v5.8.7. Our log is filling up with the following message types consuming a lot of disk space-

UNJ-NagiosXI nagios: wproc: stderr line 450: Cannot adopt OID in OLD-CISCO-INTERFACES-MIB: locIfarpOutPkts ::= { lifEntry 107 } (and others like this)
UNJ-NagiosXI nagios: wproc: stderr line 458: Cannot adopt OID in CISCO-ERR-DISABLE-MIB: cErrDisableFeatureEntry ::= { cErrDisableFeatureTable 1 } (and others like this)
UNJ-NagiosXI nagios: wproc: stderr line 474: Cannot adopt OID in CISCO-BGP4-MIB: cbgpPeerAddrFamilyPrefixEntry ::= { cbgpPeerAddrFamilyPrefixTable 1 } (and others like this)

I tried reloading the MIBs but we are still seeing these messages. All our Cisco Hosts/Services are running fine.

Output from Admin->Manage MIBs->View File Permissions:
MIB File Owner Group Permissions Date
CISCO-BGP4-MIB CISCO-BGP4-MIB.my www-data nagios rw-rw-r-- 2021-11-19 12:04:01
ERR-DISABLE-MIB ERR-DISABLE-MIB.txt root nagios rw-rw-r-- 2019-02-26 15:44:32
OLD-CISCO-INTERFACES-MIB OLD-CISCO-INTERFACES-MIB.my www-data nagios rw-rw-r-- 2021-11-17 18:08:30

Can you please assist?

[pbroste]

Hello @lorejo

Thanks for reaching out and would like to take a look at your Nagios XI System Profile so we can see what is going on.

To send us your system profile.

• Login to the Nagios XI GUI using a web browser.
• Click the "Admin" > "System Profile" Menu
• Click the "Download Profile" button
• Save the profile.zip file and send via Private Message

In addition, run this command as root or sudo and send me the resulting /tmp/SNMPFILES.tar.gz file:

Code: Select all

GZIP=-9 tar czvf /tmp/SNMPFILES.tar.gz /etc/snmp /usr/share/snmp/mibs

What is the output of this command?

Code: Select all

mysql -unagiosxi -pn@gweb nagiosxi -e "SELECT * FROM xi_cmp_trapdata WHERE trapdata_event_name = 'SyslogMSG' \G";

Thanks,
Perry

[pbroste]

Hello @lorejo

Thanks for following up and sending over the System Profile. We see from the System Profile that all mibs are reporting that they "Cannot adopt OID in....".

Not sure if permissions issue but this is what I list on mine:

ls -lahrt /usr/share/snmp/mibs/
total 1.9M
-rw-rw-r-- 1 root nagios 2.2K Jun 15 2021 NAGIOS-ROOT-MIB.txt
-rw-rw-r-- 1 root nagios 20K Jun 15 2021 NAGIOS-NOTIFY-MIB.txt
-rw-r--r-- 1 root root 28K Jun 29 2021 TUNNEL-MIB.txt
-rw-r--r-- 1 root root 17K Jun 29 2021 TRANSPORT-ADDRESS-MIB.txt

Want to have you update yours:

Code: Select all

chown root:root /usr/share/snmp/mibs/

Then restart the snmp services by bouncing:

Code: Select all

systemctl restart snmptt snmptrapd

Also see that there are several mibs with the message 'Cannot find module':

grep -Eir 'Cannot find module' * | awk -F ":" '{print $2 $3 $4}' | sort -u
Cannot find module (CISCO-PRIVATE-VLAN-MIB) At line 31 in /usr/share/snmp/mibs/ERR-DISABLE-MIB.txt
Cannot find module (CISCO-SMI) At line 22 in /usr/share/snmp/mibs/OLD-CISCO-INTERFACES-MIB.my
Cannot find module (CISCO-SMI) At line 27 in /usr/share/snmp/mibs/CISCO-BGP4-MIB.my
Cannot find module (CISCO-SMI) At line 33 in /usr/share/snmp/mibs/ERR-DISABLE-MIB.txt
Cannot find module (CISCO-TC) At line 29 in /usr/share/snmp/mibs/ERR-DISABLE-MIB.txt

This indicates that these MIB's requires MIBS: CISCO-PRIVATE-VLAN-MIB, CISCO-SMI, CISCO-TC. The subsequent "Cannot Adopt" errors are derivatives of those missing MIB errors. You will need to install/convert the associated mibs to correct these errors.

Please look things over and let us know how things look,
Perry

[lorejo]

We added the MIBs and had issues with plug-ins and several services, specifically Cisco devices. We rolled back to the previous MIB files that we had in the /usr/share/snmp/mibs/ directory and the plugins now work fine but routers and switches that we previously discovered using the wizard will not report bandwidth.

After running the following command:

root@UNJ-NagiosXI:/usr/local/nagios/libexec# time LANG=C LC_ALL=C /usr/bin/mrtg /etc/mrtg/mrtg.cfg
SNMPv2c_Session (remote host: "ipaddress" [ipaddress].161)
community: "Thestring"
request ID: 1282586501
PDU bufsize: 8000 bytes
timeout: 2s
retries: 5
backoff: 1)
at /usr/bin/../lib/mrtg2/SNMP_util.pm line 497.
SNMPGET Problem for ifInOctets.2 ifOutOctets.2 on Central#Station@ipaddress:161::::2:v4only
at /usr/bin/mrtg line 2435.
2022-02-11 14:27:13: WARNING: skipping because at least the query for ifInOctets.2 on ipaddress did not succeed
2022-02-11 14:27:13: WARNING: no data for ifInOctets&ifOutOctets:Central#Station@ipaddress. Skipping further queries for Host 10.10.254.75 in this round.
2022-02-11 14:28:14: ERROR: Target[ipaddress_1][_IN_] ' $target->[0]{$mode} ' did not eval into defined data
2022-02-11 14:28:14: ERROR: Target[ipadress_1][_OUT_] ' $target->[0]{$mode} ' did not eval into defined data
2022-02-11 14:28:14: ERROR: Target[ipaddress_2][_IN_] ' $target->[1]{$mode} ' did not eval into defined data
2022-02-11 14:28:14: ERROR: Target[ipaddress_2][_OUT_] ' $target->[1]{$mode} ' did not eval into defined data
.
.
remaining truncated. will provide if need in a secure fashion.

After discovering a new router as a test, bandwidth services are in an 'UNKNOWN' state and display:
/var/lib/mrtg/ipaddress_30.rrd does not exist.

Thoughts?

Thanks,
Josh...

[pbroste]

Hello @lorejo

Thanks for following up, want to check to see if anything is listed in 'Unconfigured Objects':

unconfiguredobjects2.png

Please let us know what you find, and follow up with an updated System Profile.

To send us your system profile.

• Login to the Nagios XI GUI using a web browser.
• Click the "Admin" > "System Profile" Menu
• Click the "Download Profile" button
• Save the profile.zip file and send via Private Message

Thanks,
Perry

[pbroste]

To also follow up further on this we see the following are resulting in the error message "Cannot find module"

Cannot find module (CISCO-PRIVATE-VLAN-MIB) At line 31 in /usr/share/snmp/mibs/ERR-DISABLE-MIB.txt
Cannot find module (CISCO-SMI) At line 22 in /usr/share/snmp/mibs/OLD-CISCO-INTERFACES-MIB.my
Cannot find module (CISCO-SMI) At line 27 in /usr/share/snmp/mibs/CISCO-BGP4-MIB.my
Cannot find module (CISCO-SMI) At line 33 in /usr/share/snmp/mibs/ERR-DISABLE-MIB.txt

Please also verify that these are present and if so please go ahead and remove the mibs and upload an updated replacement.

Thanks,
Perry

[pbroste]

Hello @lorejo

Thanks for sending over the System Profile, want to circle back on this a bit. We see NDO/database messages logged that we want to look into.

Want to have you run through that database repair script:

Code: Select all

/usr/local/nagiosxi/scripts/repair_databases.sh

Review the configs found here:
https://support.nagios.com/kb/article/n ... r-754.html

Please follow up with the updated System Profile so we can see what has changed.

Thanks
Perry

[lorejo]

I ran the DB repair script:
===============
REPAIR COMPLETE
===============
DATABASE: nagiosql
TABLE:
/var/lib/mysql/nagiosql ~
DATABASE: nagiosxi
TABLE:
/var/lib/mysql/nagiosxi ~

=======================
nagios database repair succeeded

I PM'd you the profile.zip file.

As for 'Nagios XI - SQL Error [nagiosxi] : ERROR: syntax error' I don't think this is applicable to us. We purchased XI in late 2018. I believe we started with 5.7. I was unable to locate /var/lib/pgsql/data/postgresql.conf. Please advise.

Also I noticed directory /var/lib/mrtg/ has www-data as the owner. Not sure if this is pertinent.

Thanks, Josh

[pbroste]

Hello @lorejo

Thanks for following up with the results on the database repair.

Want to run 'addmib' on the following:

CISCO-BGP4-MIB
CISCO-ERR-DISABLE-MIB
OLD-CISCO-INTERFACES-MIB

Code: Select all

bash -x /usr/local/bin/addmib /your/path/to/CISCO-BGP4-MIB.*
bash -x /usr/local/bin/addmib /your/path/to/CISCO-ERR-DISABLE-MIB.*
bash -x /usr/local/bin/addmib /your/path/to/OLD-CISCO-INTERFACES-MIB.*

• *Added bash -x to the command to watch the results

Restart the services by bouncing:

Code: Select all

service snmpd restart
service snmptrapd restart
service snmptt restart

Then review the logs and see if anything is listed in the 'Unconfigured Objects list.

Thanks,
Perry

[lorejo]

Thanks. When I tried to manually install the MIBs I get:

(example)
Cannot adopt OID in CISCO-PRIVATE-VLAN-MIB: cpvlanPromPort4kGroup ::= { cpvlanMIBGroups 4 }
Cannot adopt OID in CISCO-PRIVATE-VLAN-MIB: cpvlanPromPortGroup ::= { cpvlanMIBGroups 3 }
Cannot adopt OID in CISCO-PRIVATE-VLAN-MIB: cpvlanPrivatePortGroup ::= { cpvlanMIBGroups 2 }
Cannot adopt OID in CISCO-PRIVATE-VLAN-MIB: cpvlanVlanGroup ::= { cpvlanMIBGroups 1 }
Cannot adopt OID in CISCO-PRIVATE-VLAN-MIB: cpvlanVlanEditEntry ::= { cpvlanVlanEditTable 1 }
Cannot adopt OID in CISCO-ERR-DISABLE-MIB: ciscoErrDisableMIBConform ::= { ciscoErrDisableMIB 2 }
Cannot adopt OID in CISCO-ERR-DISABLE-MIB: ciscoErrDisableMIBObjects ::= { ciscoErrDisableMIB 1 }
Cannot adopt OID in CISCO-ERR-DISABLE-MIB: ciscoErrDisableMIBNotifs ::= { ciscoErrDisableMIB 0 }

For each. Please advise.

Regards,
Josh.