Highcharts work, mrtg graphs don't

[jwicks]

No changes made:

Batch process started at Tue Apr 28 14:42:49 PDT 2015
Populating list of RRDs from the dircetory: /usr/local/nagios/share/perfdata/
Ignoring pnp-internal RRD: /usr/local/nagios/share/perfdata/.pnp-internal/runtime_runtime.rrd
Ignoring pnp-internal RRD: /usr/local/nagios/share/perfdata/.pnp-internal/runtime_invalid.rrd
Ignoring pnp-internal RRD: /usr/local/nagios/share/perfdata/.pnp-internal/runtime_update.rrd
Ignoring pnp-internal RRD: /usr/local/nagios/share/perfdata/.pnp-internal/runtime_skipped.rrd
Ignoring pnp-internal RRD: /usr/local/nagios/share/perfdata/.pnp-internal/runtime_errors.rrd
Ignoring pnp-internal RRD: /usr/local/nagios/share/perfdata/.pnp-internal/runtime_rows.rrd
Ignoring pnp-internal RRD: /usr/local/nagios/share/perfdata/.pnp-internal/runtime_create.rrd
Batch job finished at Tue Apr 28 14:42:55 PDT 2015.
A total of 0 file(s) were updated with a total of 0 datasource(s).

-Jason

[Box293]

Hmm OK lets check some other things.

Code: Select all

ll /usr/local/nagios/var/spool/
ll /usr/local/nagios/var/spool/xidpe/
ll /usr/local/nagios/share/perfdata/
ls -alR /usr/local/nagios/share/perfdata/

Just to confirm, all graphs for services work with Highcharts? Do any graphs work when PNP is set as the default?

[jwicks]

Yes, Hicharts work with all services.

The only PNP chart that works is Performance. CPU, Disk, RAM do not.

I'll PM you the output of the ls commands.

Thanks for helping out with this.

-Jason

[lmiltchev]

Can you PM me (or anyone on the Nagios Support team) your latest profile?

Admin->System Profile->Download Profile

[jwicks]

Done.

Thanks for taking a look.

-Jason

[Box293]

Can you please send us the output from this command:

Code: Select all

ls -alR /usr/local/nagios/share/pnp

[jwicks]

Sure,

here you go:

Code: Select all

[root@nagios-48c ~]# ls -alR /usr/local/nagios/share/pnp
/usr/local/nagios/share/pnp:
total 48
drwxr-xr-x.  8 nagios nagios 4096 Apr 16 11:30 .
drwxrwxr-x. 15 nagios nagios 4096 Apr 24 16:17 ..
-rw-r--r--.  1 nagios nagios 2964 Apr 16 11:30 ajax.php
drwxr-xr-x.  2 nagios nagios 4096 Apr 16 11:30 images
drwxr-xr-x.  4 nagios nagios 4096 Apr 28 15:15 include
-rw-r--r--.  1 nagios nagios 5484 Apr 16 11:30 index.php
drwxr-xr-x.  2 nagios nagios 4096 Apr 16 11:30 lang
drwxrwsr-x.  2 nagios nagios 4096 Apr 24 10:45 templates
drwxrwsr-x.  2 nagios nagios 4096 Apr 16 14:43 templates.dist
drwxr-xr-x.  2 nagios nagios 4096 Apr 16 14:45 templates.special
-rw-r--r--.  1 nagios nagios 3742 Apr 16 11:30 zoom.php

/usr/local/nagios/share/pnp/images:
total 108
drwxr-xr-x. 2 nagios nagios 4096 Apr 16 11:30 .
drwxr-xr-x. 8 nagios nagios 4096 Apr 16 11:30 ..
-rw-r--r--. 1 nagios nagios  661 Apr 16 11:30 ack.png
-rw-r--r--. 1 nagios nagios 1475 Apr 16 11:30 action.gif
-rw-r--r--. 1 nagios nagios 5837 Apr 16 11:30 calendar.png
-rw-r--r--. 1 nagios nagios 1385 Apr 16 11:30 critical.png
-rw-r--r--. 1 nagios nagios 1030 Apr 16 11:30 eps.png
-rw-r--r--. 1 nagios nagios 1475 Apr 16 11:30 graph.gif
-rw-r--r--. 1 nagios nagios   80 Apr 16 11:30 int2.gif
-rw-r--r--. 1 nagios nagios   80 Apr 16 11:30 int.gif
-rw-r--r--. 1 nagios nagios  165 Apr 16 11:30 link.png
-rw-r--r--. 1 nagios nagios  829 Apr 16 11:30 noack.png
-rw-r--r--. 1 nagios nagios  947 Apr 16 11:30 notify.gif
-rw-r--r--. 1 nagios nagios 1413 Apr 16 11:30 ok.png
-rw-r--r--. 1 nagios nagios 5432 Apr 16 11:30 pages.png
-rw-r--r--. 1 nagios nagios 5084 Apr 16 11:30 pdf.png
-rw-r--r--. 1 nagios nagios  298 Apr 16 11:30 pnp.png
-rw-r--r--. 1 nagios nagios 1413 Apr 16 11:30 recovery.png
-rw-r--r--. 1 nagios nagios  420 Apr 16 11:30 rrdtool.png
-rw-r--r--. 1 nagios nagios 1104 Apr 16 11:30 svg.png
-rw-r--r--. 1 nagios nagios  870 Apr 16 11:30 trends.gif
-rw-r--r--. 1 nagios nagios 1386 Apr 16 11:30 warning.png
-rw-r--r--. 1 nagios nagios 1771 Apr 16 11:30 xml.png
-rw-r--r--. 1 nagios nagios  810 Apr 16 11:30 zoom.png

/usr/local/nagios/share/pnp/include:
total 244
drwxr-xr-x. 4 nagios nagios  4096 Apr 28 15:15 .
drwxr-xr-x. 8 nagios nagios  4096 Apr 16 11:30 ..
-rw-r--r--. 1 nagios nagios 13470 Apr 16 14:11 am_utils.php
-rw-r--r--. 1 nagios nagios 10271 Apr 16 11:30 debug.php
drwxr-xr-x. 3 nagios nagios  4096 Apr 16 11:30 font
-rw-r--r--. 1 nagios nagios 45079 Apr 16 11:30 fpdf.php
-rw-r--r--. 1 nagios nagios 12777 Apr 16 11:30 fpdf_tpl.php
-rw-r--r--. 1 nagios nagios 10946 Apr 16 11:30 fpdi_pdf_parser.php
-rw-r--r--. 1 nagios nagios 14721 Apr 16 11:30 fpdi.php
-rw-r--r--. 1 nagios nagios 66804 Apr 16 11:30 function.inc.php
drwxr-xr-x. 2 nagios nagios  4096 Apr 16 11:30 js
-rw-r--r--. 1 nagios nagios  1829 Apr 16 11:30 pdf_context.php
-rw-r--r--. 1 nagios nagios 18947 Apr 16 11:30 pdf_parser.php
-rw-r--r--. 1 nagios nagios  1876 Apr 16 11:30 site.php
-rw-r--r--. 1 nagios nagios  4075 Apr 16 11:30 style.css
-rw-r--r--. 1 nagios nagios  3307 Apr 16 11:30 tpl_function.inc.php
-rw-r--r--. 1 nagios nagios  2362 Apr 16 11:30 wrapper_functions.php

/usr/local/nagios/share/pnp/include/font:
total 56
drwxr-xr-x. 3 nagios nagios 4096 Apr 16 11:30 .
drwxr-xr-x. 4 nagios nagios 4096 Apr 28 15:15 ..
-rw-r--r--. 1 nagios nagios  257 Apr 16 11:30 courier.php
-rw-r--r--. 1 nagios nagios 3163 Apr 16 11:30 helveticabi.php
-rw-r--r--. 1 nagios nagios 3162 Apr 16 11:30 helveticab.php
-rw-r--r--. 1 nagios nagios 3163 Apr 16 11:30 helveticai.php
-rw-r--r--. 1 nagios nagios 3162 Apr 16 11:30 helvetica.php
drwxr-xr-x. 2 nagios nagios 4096 Apr 16 11:30 makefont
-rw-r--r--. 1 nagios nagios 3086 Apr 16 11:30 symbol.php
-rw-r--r--. 1 nagios nagios 3157 Apr 16 11:30 timesbi.php
-rw-r--r--. 1 nagios nagios 3160 Apr 16 11:30 timesb.php
-rw-r--r--. 1 nagios nagios 3153 Apr 16 11:30 timesi.php
-rw-r--r--. 1 nagios nagios 3154 Apr 16 11:30 times.php
-rw-r--r--. 1 nagios nagios 3051 Apr 16 11:30 zapfdingbats.php

/usr/local/nagios/share/pnp/include/font/makefont:
total 180
drwxr-xr-x. 2 nagios nagios  4096 Apr 16 11:30 .
drwxr-xr-x. 3 nagios nagios  4096 Apr 16 11:30 ..
-rw-r--r--. 1 nagios nagios  4546 Apr 16 11:30 cp1250.map
-rw-r--r--. 1 nagios nagios  4776 Apr 16 11:30 cp1251.map
-rw-r--r--. 1 nagios nagios  4541 Apr 16 11:30 cp1252.map
-rw-r--r--. 1 nagios nagios  4255 Apr 16 11:30 cp1253.map
-rw-r--r--. 1 nagios nagios  4523 Apr 16 11:30 cp1254.map
-rw-r--r--. 1 nagios nagios  4298 Apr 16 11:30 cp1255.map
-rw-r--r--. 1 nagios nagios  4434 Apr 16 11:30 cp1257.map
-rw-r--r--. 1 nagios nagios  4493 Apr 16 11:30 cp1258.map
-rw-r--r--. 1 nagios nagios  4263 Apr 16 11:30 cp874.map
-rw-r--r--. 1 nagios nagios  4689 Apr 16 11:30 iso-8859-11.map
-rw-r--r--. 1 nagios nagios  4579 Apr 16 11:30 iso-8859-15.map
-rw-r--r--. 1 nagios nagios  4625 Apr 16 11:30 iso-8859-16.map
-rw-r--r--. 1 nagios nagios  4605 Apr 16 11:30 iso-8859-1.map
-rw-r--r--. 1 nagios nagios  4569 Apr 16 11:30 iso-8859-2.map
-rw-r--r--. 1 nagios nagios  4588 Apr 16 11:30 iso-8859-4.map
-rw-r--r--. 1 nagios nagios  4719 Apr 16 11:30 iso-8859-5.map
-rw-r--r--. 1 nagios nagios  4430 Apr 16 11:30 iso-8859-7.map
-rw-r--r--. 1 nagios nagios  4623 Apr 16 11:30 iso-8859-9.map
-rw-r--r--. 1 nagios nagios  4739 Apr 16 11:30 koi8-r.map
-rw-r--r--. 1 nagios nagios  4739 Apr 16 11:30 koi8-u.map
-rw-r--r--. 1 nagios nagios 10818 Apr 16 11:30 makefont.php

/usr/local/nagios/share/pnp/include/js:
total 440
drwxr-xr-x. 2 nagios nagios   4096 Apr 16 11:30 .
drwxr-xr-x. 4 nagios nagios   4096 Apr 28 15:15 ..
-rw-r--r--. 1 nagios nagios   4770 Apr 16 11:30 builder.js
-rw-r--r--. 1 nagios nagios   4830 Apr 16 11:30 calendar-blue.css
-rw-r--r--. 1 nagios nagios   3863 Apr 16 11:30 calendar-de.js
-rw-r--r--. 1 nagios nagios   3600 Apr 16 11:30 calendar-en.js
-rw-r--r--. 1 nagios nagios  49237 Apr 16 11:30 calendar.js
-rw-r--r--. 1 nagios nagios   8853 Apr 16 11:30 calendar-setup.js
-rw-r--r--. 1 nagios nagios  34868 Apr 16 11:30 controls.js
-rw-r--r--. 1 nagios nagios  31605 Apr 16 11:30 dragdrop.js
-rw-r--r--. 1 nagios nagios  38986 Apr 16 11:30 effects.js
-rw-r--r--. 1 nagios nagios     68 Apr 16 11:30 menuarrow.gif
-rw-r--r--. 1 nagios nagios  37153 Apr 16 11:30 overlib_mini.js
-rw-r--r--. 1 nagios nagios 129738 Apr 16 11:30 prototype.js
-rw-r--r--. 1 nagios nagios   2654 Apr 16 11:30 scriptaculous.js
-rw-r--r--. 1 nagios nagios  10296 Apr 16 11:30 slider.js
-rw-r--r--. 1 nagios nagios   1920 Apr 16 11:30 sound.js
-rw-r--r--. 1 nagios nagios  20197 Apr 16 11:30 unittest.js
-rw-r--r--. 1 nagios nagios  22280 Apr 16 11:30 zoom.js

/usr/local/nagios/share/pnp/lang:
total 28
drwxr-xr-x. 2 nagios nagios 4096 Apr 16 11:30 .
drwxr-xr-x. 8 nagios nagios 4096 Apr 16 11:30 ..
-rw-r--r--. 1 nagios nagios 3018 Apr 16 11:30 lang_de.php
-rw-r--r--. 1 nagios nagios 2533 Apr 16 11:30 lang_en.php
-rw-r--r--. 1 nagios nagios 3113 Apr 16 11:30 lang_fr.php
-rw-r--r--. 1 nagios nagios 2693 Apr 16 11:30 lang_nl.php
-rw-r--r--. 1 nagios nagios 2441 Apr 16 11:30 lang_se.php

/usr/local/nagios/share/pnp/templates:
total 56
drwxrwsr-x. 2 nagios nagios 4096 Apr 24 10:45 .
drwxr-xr-x. 8 nagios nagios 4096 Apr 16 11:30 ..
-rw-r--r--. 1 root   nagios  832 Apr 16 11:30 check_local_disk.php
-rw-r--r--. 1 root   nagios 1125 Apr 16 14:13 check_local_load.php
-rw-r--r--. 1 root   nagios 1067 Apr 16 11:30 check_local_load.php.ORIG
-rw-r--r--. 1 root   nagios  966 Apr 16 14:14 check_local_users.php
-rw-r--r--. 1 root   nagios  718 Apr 16 11:30 check_local_users.php.ORIG
-rw-r--r--. 1 root   nagios 1250 Apr 16 11:30 check_xi_host_http.php
-rw-r--r--. 1 root   nagios 1926 Apr 16 11:30 check_xi_host_ping.php
-rw-r--r--. 1 root   nagios  734 Apr 16 11:30 check_xi_service_dns.php
-rw-r--r--. 1 root   nagios 1261 Apr 16 11:30 check_xi_service_http_content.php
-rw-r--r--. 1 root   nagios 1253 Apr 16 11:30 check_xi_service_http.php
-rw-r--r--. 1 root   nagios 1140 Apr 16 11:30 check_xi_service_mrtgtraf.php
-rw-r--r--. 1 root   nagios 1929 Apr 16 11:30 check_xi_service_ping.php

/usr/local/nagios/share/pnp/templates.dist:
total 184
drwxrwsr-x. 2 nagios nagios  4096 Apr 16 14:43 .
drwxr-xr-x. 8 nagios nagios  4096 Apr 16 11:30 ..
-rw-r--r--. 1 nagios nagios   877 Apr 16 11:30 check_disk.php
-rw-r--r--. 1 nagios nagios   725 Apr 16 11:30 check_dns.php
-rw-r--r--. 1 nagios nagios  2135 Apr 16 11:30 check_fping.php
-rw-r--r--. 1 nagios nagios  2121 Apr 16 11:30 check-host-alive.php
-rw-r--r--. 1 nagios nagios  1244 Apr 16 11:30 check_http.php
-rw-r--r--. 1 nagios nagios    14 Apr 16 11:30 check_http_url.php
-rw-r--r--. 1 nagios nagios   813 Apr 16 11:30 check_iftraffic_counter.php
-rw-r--r--. 1 nagios nagios   757 Apr 16 11:30 check_iftraffic_pct.php
-rw-r--r--. 1 nagios nagios  1126 Apr 16 11:30 check_load.php
-rw-r--r--. 1 nagios nagios   824 Apr 16 11:30 check_messpc_temp.php
-rw-r--r--. 1 nagios nagios   948 Apr 16 11:30 check_multi.php
-rw-r--r--. 1 nagios nagios 19994 Apr 16 11:30 check_mysql_health.php
-rw-r--r--. 1 nagios nagios  1223 Apr 16 11:30 check_nt_cpu.php
-rw-r--r--. 1 nagios nagios   867 Apr 16 11:30 check_nt_disk.php
-rw-r--r--. 1 nagios nagios   754 Apr 16 11:30 check_nt_mem.php
-rw-r--r--. 1 nagios nagios  1056 Apr 16 11:30 check_nwstat_CONNS.php
-rw-r--r--. 1 nagios nagios    21 Apr 16 11:30 check_nwstat_LOAD15.php
-rw-r--r--. 1 nagios nagios    21 Apr 16 11:30 check_nwstat_LOAD1.php
-rw-r--r--. 1 nagios nagios    21 Apr 16 11:30 check_nwstat_LOAD5.php
-rw-r--r--. 1 nagios nagios  1034 Apr 16 11:30 check_nwstat_LOAD.php
-rw-r--r--. 1 nagios nagios  1048 Apr 16 11:30 check_nwstat_ofiles.php
-rw-r--r--. 1 nagios nagios   609 Apr 16 11:30 check_oracle_connection-time.php
-rw-r--r--. 1 nagios nagios   565 Apr 16 11:30 check_oracle_health_connection-time.php
-rw-r--r--. 1 nagios nagios   597 Apr 16 11:30 check_oracle_health_pga-in-memory-sort-ratio.php
-rw-r--r--. 1 nagios nagios   557 Apr 16 11:30 check_oracle_health_redo-io-traffic.php
-rw-r--r--. 1 nagios nagios   590 Apr 16 11:30 check_oracle_health_switch-interval.php
-rw-r--r--. 1 nagios nagios  1380 Apr 16 11:30 check_oracle_health_tablespace-usage.php
-rw-r--r--. 1 nagios nagios  2127 Apr 16 11:30 check_ping.php
-rw-r--r--. 1 nagios nagios  1150 Apr 16 11:30 check_pnp_rrds.php
-rw-r--r--. 1 nagios nagios    12 Apr 16 11:30 check_smtp.php
-rw-r--r--. 1 nagios nagios  1177 Apr 16 11:30 check_snmp_int-bits.php
-rw-r--r--. 1 nagios nagios  1028 Apr 16 11:30 check_snmp_int.php
-rw-r--r--. 1 nagios nagios   889 Apr 16 11:30 check_swap.php
-rw-r--r--. 1 nagios nagios    55 Apr 16 14:42 check_tcp.php
-rw-r--r--. 1 nagios nagios    12 Apr 16 11:30 check_tcp.php.ORIG
-rw-r--r--. 1 nagios nagios   701 Apr 16 11:30 check_users.php
-rw-r--r--. 1 nagios nagios  4273 Apr 16 14:42 default.php
-rw-r--r--. 1 nagios nagios  1638 Apr 16 11:30 default.php.ORIG
-rw-r--r--. 1 nagios nagios   570 Apr 16 11:30 response.php

/usr/local/nagios/share/pnp/templates.special:
total 32
drwxr-xr-x. 2 nagios nagios  4096 Apr 16 14:45 .
drwxr-xr-x. 8 nagios nagios  4096 Apr 16 11:30 ..
-rw-r--r--. 1 nagios nagios  2373 Apr 16 14:45 check_dummy_copysense.php
-rw-r--r--. 1 nagios nagios 10729 Apr 16 14:45 check_dummy.php
-rw-r--r--. 1 nagios nagios  3968 Apr 16 14:45 check_xi_service_nsclient.php
-rw-r--r--. 1 nagios nagios  1105 Apr 16 11:30 loop.php

Thanks again for looking into this. I am completely stumped.

-Jason

[Box293]

Looks like there are some older SELinux ACLs (file permissions ending with a period).

I'm positive you are not using SELinux as other file listing do not show these (perfdata files).

However lets check

Code: Select all

getenforce

If it returns enabled, run the following:

Code: Select all

sed -i 's/SELINUX=enforcing/SELINUX=permissive/g' /etc/selinux/config
setenforce 0

And finally run this to remove the SELinux ACLs on the files.

Code: Select all

find /usr/local/nagios/share/pnp/ -print0 |xargs -0 -n 1 setfattr -h -x security.selinux

See if that works.

If it doesn't maybe run this against root to clear all files:

Code: Select all

find / -print0 |xargs -0 -n 1 setfattr -h -x security.selinux

Maybe a full reboot of the nagios server afterwards.

I'm starting to clutch at straws here.

[jwicks]

No change.

Is there a command I can run or a URL I can post to that will generate a graph?

That might be a good place to start leading me down the path of how this is supposed to work.

Thanks,

-Jason

[tgriep]

Could you run the following and post the results here?

Code: Select all

ls -lR /usr/local/nagios/etc/pnp/