Page 3 of 3

Re: Some Performance graphs not graphing

Posted: Mon Nov 22, 2021 12:33 pm
by pbroste
Hello @hbouma

Thanks for following up, the system date, time, and timezone are sync'ed up. Let's then take a closer look at your 'rrdcached' output that looked wonky.

Code: Select all

systemctl -l status rrdcached --no-pager

Code: Select all

less /etc/systemd/system/multi-user.target.wants/rrdcached.service
Please forward the results,
Perry

Re: Some Performance graphs not graphing

Posted: Mon Nov 22, 2021 2:06 pm
by hbouma
systemctl -l status rrdcached --no-pager
● rrdcached.service - LSB: start and stop rrdtool caching daemon
Loaded: loaded (/etc/rc.d/init.d/rrdcached; bad; vendor preset: disabled)
Active: active (running) since Tue 2021-11-16 07:56:23 EST; 6 days ago
Docs: man:systemd-sysv-generator(8)
CGroup: /system.slice/rrdcached.service
└─21288 /usr/bin/rrdcached -p /var/rrdtool/rrdcached/rrdcached.pid -s nagios -m 0660 -l unix:/var/rrdtool/rrdcached/rrdcached.sock -F -w 900 -z 90 -j /var/rrdtool/rrdcached -b /var/rrdtool/rrdcached

Nov 22 11:56:23 SERVER rrdcached[21288]: started new journal /var/rrdtool/rrdcached/rrd.journal.1637600183.218529
Nov 22 11:56:23 SERVER rrdcached[21288]: removing old journal /var/rrdtool/rrdcached/rrd.journal.1637592983.218610
Nov 22 12:56:23 SERVER rrdcached[21288]: flushing old values
Nov 22 12:56:23 SERVER rrdcached[21288]: rotating journals
Nov 22 12:56:23 SERVER rrdcached[21288]: started new journal /var/rrdtool/rrdcached/rrd.journal.1637603783.218555
Nov 22 12:56:23 SERVER rrdcached[21288]: removing old journal /var/rrdtool/rrdcached/rrd.journal.1637596583.218546
Nov 22 13:56:23 SERVER rrdcached[21288]: flushing old values
Nov 22 13:56:23 SERVER rrdcached[21288]: rotating journals
Nov 22 13:56:23 SERVER rrdcached[21288]: started new journal /var/rrdtool/rrdcached/rrd.journal.1637607383.218577
Nov 22 13:56:23 SERVER rrdcached[21288]: removing old journal /var/rrdtool/rrdcached/rrd.journal.1637600183.218529



less /etc/systemd/system/multi-user.target.wants/rrdcached.service
/etc/systemd/system/multi-user.target.wants/rrdcached.service: No such file or directory


find / -name rrdcached.service
/run/systemd/generator.late/rrdcached.service
/run/systemd/generator.late/runlevel5.target.wants/rrdcached.service
/run/systemd/generator.late/runlevel4.target.wants/rrdcached.service
/run/systemd/generator.late/runlevel3.target.wants/rrdcached.service
/run/systemd/generator.late/runlevel2.target.wants/rrdcached.service
/sys/fs/cgroup/devices/system.slice/rrdcached.service
/sys/fs/cgroup/systemd/system.slice/rrdcached.service

Re: Some Performance graphs not graphing

Posted: Tue Nov 23, 2021 11:36 am
by pbroste
Hello @hbouma

Thanks for sending the info over, want to take a look at the search results that you sent over.
find / -name rrdcached.service
/run/systemd/generator.late/rrdcached.service
/run/systemd/generator.late/runlevel5.target.wants/rrdcached.service
/run/systemd/generator.late/runlevel4.target.wants/rrdcached.service
/run/systemd/generator.late/runlevel3.target.wants/rrdcached.service
/run/systemd/generator.late/runlevel2.target.wants/rrdcached.service
/sys/fs/cgroup/devices/system.slice/rrdcached.service
/sys/fs/cgroup/systemd/system.slice/rrdcached.service
Let's take a look at the rrdcached.service files:

Code: Select all

find / -iname rrdcached.service -print -exec cat {} \; -exec echo \;find / -iname rrdcached.service -print -exec cat {} \; -exec echo \; >/tmp/rrdcachedresults.txt
Let's also get an updated System Profile as well (on both support forum issues):

To send us your system profile.
  • Login to the Nagios XI GUI using a web browser.
  • Click the "Admin" > "System Profile" Menu
  • Click the "Download Profile" button
  • Save the profile.zip file and send via Private Message
Thanks,
Perry

Thanks,
Perry

Re: Some Performance graphs not graphing

Posted: Tue Nov 23, 2021 12:55 pm
by hbouma
Information sent via PM.

Re: Some Performance graphs not graphing

Posted: Tue Nov 23, 2021 5:37 pm
by pbroste
Hello @hbouma

Thanks for following up, we see a list of these listed and want to have you clear these out so they can rebuild.
rrd_update_r (/usr/local/nagios/share/perfdata/yourhostnamehere/Paging_File_Usage.rrd) failed with status -1.

Code: Select all

cd /usr/local/nagios/share/perfdata/<config name>
then find the RRDs and XML for these specific hosts and/or services and remove them.

Code: Select all

rm -rf <service_name.rrd>
rm -rf <service_name.xml>
The new RRD and XML files should get recreated in 10-20 min, and the graphs should start showing up

Code: Select all

watch -n 1 ls -l /usr/local/nagios/share/perfdata/yourhostnamehere/....
Thanks,
Perry

Re: Some Performance graphs not graphing

Posted: Wed Nov 24, 2021 9:31 am
by hbouma
I see these messages in the messages.txt file from the Profile. How would I find these messages without running a new Profile?

I have gone through and deleted the rrdcached perfdata. I want to keep an eye on those messages to see if it clears up.

Re: Some Performance graphs not graphing

Posted: Wed Nov 24, 2021 3:30 pm
by pbroste
Hello @hbouma

You can watch messages from:

Code: Select all

tail -F /var/log/messages

or
tail -F /var/log/syslog
depending on distro.

Thanks,
Perry

Re: Some Performance graphs not graphing

Posted: Mon Nov 29, 2021 9:32 am
by hbouma
Thank you. I am no longer seeing these errors in the /var/log/messages on my RHEL system. The Graphs are now showing data as well.

Thank you for your assistance. Feel free to close this topic.

Re: Some Performance graphs not graphing

Posted: Mon Nov 29, 2021 3:51 pm
by pbroste
Excellent, thanks for the update @hbouma, I will go ahead and lock this.

Thanks,
Perry