Page 1 of 3

Return Code: 3, Output: NRPE: Unable to read output

Posted: Wed Oct 03, 2018 2:43 pm
by jenglish
Hi all,

There is only one check that is failing.

Code: Select all

Oct  3 15:36:51 coralsea nrpe[1264]: Host 10.0.130.70 is asking for command 'check_multipath' to be run...
Oct  3 15:36:51 coralsea nrpe[1264]: Running command: /usr/lib/nagios/plugins/check_multipath.sh
Oct  3 15:36:51 coralsea nrpe[1265]: WARNING: my_system() seteuid(0): Operation not permitted
Oct  3 15:36:51 coralsea nrpe[1264]: Command completed with return code 0 and output:
Oct  3 15:36:51 coralsea nrpe[1264]: Return Code: 3, Output: NRPE: Unable to read output
nrpe client information

Code: Select all

(TEST-BOYERS-3|jenglish@coralsea ~)$ uname -r ; cat /etc/redhat-release ; nrpe -V
3.10.0-862.6.3.el7.x86_64
Red Hat Enterprise Linux Server release 7.5 (Maipo)
NRPE - Nagios Remote Plugin Executor
Version: 3.2.0
sudoers

Code: Select all

(TEST-BOYERS-3|jenglish@coralsea ~)$ sudo grep nrpe /etc/sudoers
nrpe ALL=NOPASSWD:!ALL, /usr/sbin/hpacucli, /bin/ping, /usr/sbin/dmidecode, /usr/bin/openssl, /bin/egrep, /sbin/ethtool -S *, /sbin/service * restart, /usr/lib/nagios/plugins/check_fts_t1.sh, /usr/lib/nagios/plugins/check_zero_length_files.sh, /usr/lib/nagios/plugins/check_file_age, /usr/bin/radwho, /usr/bin/radlast, /usr/sbin/postqueue, /bin/cat, /bin/ls, /usr/bin/find, /usr/lib/nagios/plugins/check_dir, /sbin/multipath -ll, /sbin/service iptables status, /usr/sbin/hpacucli, /bin/ping, /usr/sbin/dmidecode, /usr/bin/openssl, /bin/egrep, /usr/sbin/ethtool -S, /usr/openv/volmgr/bin/vmquery, /usr/openv/volmgr/bin/tpconfig, /var/ossec/bin/list_agents, /usr/openv/netbackup/bin/admincmd/bpplclients, /usr/openv/volmgr/bin/vmoprcmd
nrpe.cfg

Code: Select all

(TEST-BOYERS-3|jenglish@coralsea ~)$ cat /etc/nagios/nrpe.cfg
# Nagios NRPE Configuration

server_port=5666
allowed_hosts=127.0.0.1,10.0.130.70,172.24.17.133,172.27.17.133
nrpe_user=nrpe
nrpe_group=nrpe
dont_blame_nrpe=1
debug=1
command_timeout=900
command[check_users]=/usr/lib/nagios/plugins/check_users -w $ARG1$ -c $ARG2$
command[check_load]=/usr/lib/nagios/plugins/check_load -w $ARG1$ -c $ARG2$
command[check_disk]=/usr/lib/nagios/plugins/check_disk -w $ARG1$ -c $ARG2$ -p $ARG3$
#command[check_procs]=/usr/lib/nagios/plugins/check_procs -w $ARG1$ -c $ARG2$ -s $ARG3$
command[check_temp]=/usr/lib/nagios/plugins/check_temp -w $ARG1$ -c $ARG2$
command[check_procs]=/usr/lib/nagios/plugins/check_procs -C $ARG1$ -c $ARG2$
command[check_tomcat_memory]=/usr/lib/nagios/plugins/check_tomcat_memory.sh
command[check_lock_age]=/usr/lib/nagios/plugins/check_file_age_wrapper.sh
command[check_file_size]=/usr/lib/nagios/plugins/check_file_age -f $ARG1$ -W $ARG2$ -C $ARG3$ -w $ARG4$ -c $ARG5$
command[check_catalina_logs]=/usr/lib/nagios/plugins/check_logfiles -t 3600 --logfile=/var/log/tomcat/catalina.out --criticalpattern="Java heap space"
command[check_init]=/usr/lib/nagios/plugins/check_init.sh $ARG1$ "$ARG2$"
command[check_swap]=/usr/lib/nagios/plugins/check_swap $ARG1$ $ARG2$
command[check_jpas]=/usr/lib/nagios/plugins/check_jpas.sh
command[check_ntp_peer]=/usr/lib/nagios/plugins/check_ntp_peer -H 10.0.130.70 -w 0.5 -c 1 -W 5 -C 7
command[check_ntp_procs]=/usr/lib/nagios/plugins/check_procs -w 1:1 -c 0:2 -C ntpd
command[check_ntp_time]=/usr/lib/nagios/plugins/check_ntp_time -H 10.0.130.70 -w 0.5 -c 1
command[check_all_disk]=/usr/lib/nagios/plugins/check_disk -l -w $ARG1$ -c $ARG2$
command[check_proc_string]=/usr/lib/nagios/plugins/check_procs -a $ARG1$ -c $ARG2$
command[check_linux_kernel]=/usr/lib/nagios/plugins/check_linux_kernel.sh
command[check_iptables_getenforce]=/usr/lib/nagios/plugins/check_iptables_getenforce.sh
command[check_bond]=/usr/lib/nagios/plugins/check_bond.sh
command[check_multipath]=/usr/lib/nagios/plugins/check_multipath.sh
command[check_md5sum]=/usr/lib/nagios/plugins/check_md5sum.sh $ARG1$
command[check_mysql_backup]=/usr/lib/nagios/plugins/check_mysql_backups.sh
command[check_mysql]=/usr/lib/nagios/plugins/check_mysql -uroot -popm4me2
command[check_generic]=/usr/lib/nagios/plugins/$ARG1$ $ARG2$ $ARG3$
command[restart_tomcat]=/usr/local/bin/restart_tomcat.sh
systemd unit file

Code: Select all

(TEST-BOYERS-3|jenglish@coralsea ~)$ systemctl cat nrpe
# /usr/lib/systemd/system/nrpe.service
[Unit]
Description=Nagios Remote Program Executor
Documentation=http://www.nagios.org/documentation
Conflicts=nrpe.socket
Requires=network.target

[Install]
WantedBy=multi-user.target

[Service]
Type=forking
User=nrpe
Group=nrpe
EnvironmentFile=/etc/sysconfig/nrpe
ExecStart=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -d $NRPE_SSL_OPT
SELinux Info

Code: Select all

(TEST-BOYERS-3|jenglish@coralsea ~)$ getsebool -a | grep nagios_run_sudo ; ll -Z /usr/lib*/nagios/plugins/check_multipath.sh
nagios_run_sudo --> on
-rwxr-xr-x. nrpe nrpe system_u:object_r:nagios_unconfined_plugin_exec_t:s0 /usr/lib64/nagios/plugins/check_multipath.sh
-rwxr-xr-x. nrpe nrpe system_u:object_r:nagios_unconfined_plugin_exec_t:s0 /usr/lib/nagios/plugins/check_multipath.sh
At this point I may be overlooking something easy, but it's confusing me as to why only one command is failing.
Capture.PNG

Re: Return Code: 3, Output: NRPE: Unable to read output

Posted: Wed Oct 03, 2018 3:21 pm
by npolovenko
Hello, @jenglish. Can you add the following entry to the etc/sudoers file on the remote nrpe server and let me know if it fixes the issue?
nrpe ALL = NOPASSWD:/usr/lib64/nagios/plugins/check_multipath.sh *

Re: Return Code: 3, Output: NRPE: Unable to read output

Posted: Wed Oct 03, 2018 3:30 pm
by jenglish
No difference after updating sudoers.

Code: Select all

Oct  3 16:29:15 coralsea nrpe[38060]: Host 10.0.130.70 is asking for command 'check_multipath' to be run...
Oct  3 16:29:15 coralsea nrpe[38060]: Running command: /usr/lib/nagios/plugins/check_multipath.sh
Oct  3 16:29:15 coralsea nrpe[38061]: WARNING: my_system() seteuid(0): Operation not permitted
Oct  3 16:29:15 coralsea nrpe[38060]: Command completed with return code 0 and output:
Oct  3 16:29:15 coralsea nrpe[38060]: Return Code: 3, Output: NRPE: Unable to read output

Code: Select all

(TEST-BOYERS-3|jenglish@coralsea ~)$ sudo grep nrpe /etc/sudoers
nrpe ALL=NOPASSWD:!ALL, /usr/sbin/hpacucli, /bin/ping, /usr/sbin/dmidecode, /usr/bin/openssl, /bin/egrep, /sbin/ethtool -S *, /sbin/service * restart, /usr/lib/nagios/plugins/check_fts_t1.sh, /usr/lib/nagios/plugins/check_zero_length_files.sh, /usr/lib/nagios/plugins/check_file_age, /usr/bin/radwho, /usr/bin/radlast, /usr/sbin/postqueue, /bin/cat, /bin/ls, /usr/bin/find, /usr/lib/nagios/plugins/check_dir, /sbin/multipath -ll, /sbin/service iptables status, /usr/sbin/hpacucli, /bin/ping, /usr/sbin/dmidecode, /usr/bin/openssl, /bin/egrep, /usr/sbin/ethtool -S, /usr/openv/volmgr/bin/vmquery, /usr/openv/volmgr/bin/tpconfig, /var/ossec/bin/list_agents, /usr/openv/netbackup/bin/admincmd/bpplclients, /usr/openv/volmgr/bin/vmoprcmd, /usr/lib/nagios/plugins/check_multipath.sh *

Re: Return Code: 3, Output: NRPE: Unable to read output

Posted: Wed Oct 03, 2018 3:50 pm
by npolovenko
@jenglish, Is your plugin in the lib or lib64 directory?

This is from the command definitions:
command[check_multipath]=/usr/lib/nagios/plugins/check_multipath.sh
And this is from the SElinux config:
-rwxr-xr-x. nrpe nrpe system_u:object_r:nagios_unconfined_plugin_exec_t:s0 /usr/lib64/nagios/plugins/check_multipath.sh
-rwxr-xr-x. nrpe nrpe system_u:object_r:nagios_unconfined_plugin_exec_t:s0 /usr/lib/nagios/plugins/check_multipath.sh
So if the plugin is in the lib folder please change the command I gave you:
nrpe ALL = NOPASSWD:/usr/lib/nagios/plugins/check_multipath.sh *

Next, open a console session to the nrpe server, sign in as the nagios user and run the plugin:
su - nagios
/usr/lib/nagios/plugins/check_multipath.sh
And show me the output.

Re: Return Code: 3, Output: NRPE: Unable to read output

Posted: Wed Oct 03, 2018 3:59 pm
by jenglish
Hi. Sorry for the confusion. We use /usr/lib/nagios/plugins. That's why I modified the suggested input for the sudoers file. (side question - is there a default to use?)

The command works as expected locally:

Code: Select all

(TEST-BOYERS-3|jenglish@coralsea ~)$ sudo su - nagios
Last login: Mon Oct  1 15:00:26 EDT 2018 on pts/1
(TEST-BOYERS-3|nagios@coralsea ~)$ /usr/lib/nagios/plugins/check_multipath.sh
+ STATE_OK=0
+ STATE_WARNING=1
+ STATE_CRITICAL=2
+ STATE_UNKNOWN=3
+ STATE_DEPENDENT=4
+ OUR_STATE=0
+ OUR_EXIT=OK
+ ECHO=/bin/echo
+ GREP=/bin/grep
++ cat /proc/scsi/scsi
++ /bin/grep 3PAR
+ PAR='  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: SES              Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: SES              Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: SES              Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: SES              Rev: 3226'
++ ps -ef
++ grep -v grep
++ grep -v check_multipath.sh
++ grep multipath
+ MULTIPATH='root      1014     1  0 Sep25 ?        00:18:36 /sbin/multipathd'
+ '[' '!' '  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: SES              Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: SES              Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: SES              Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: VV               Rev: 3226
  Vendor: 3PARdata Model: SES              Rev: 3226' ']'
+ '[' '!' 'root      1014     1  0 Sep25 ?        00:18:36 /sbin/multipathd' ']'
+ exit 0

Re: Return Code: 3, Output: NRPE: Unable to read output

Posted: Wed Oct 03, 2018 4:35 pm
by npolovenko
@jenglish, Looks like this plugin doesn't return a proper output supported by Nagios.
We have quite a few check_mulipath plugins on the exchange and Im not sure which one you're using right now. But can you try using a different plugin instead?
https://exchange.nagios.org/index.php?o ... =multipath
Or this perl plugin.
https://exchange.nagios.org/directory/P ... pl/details

The default directory for plugins is /usr/local/nagios/etc/libexec/, but since all the other plugins are working fine I don't think that's the issue.

Also, try temporarily disabling SELinux to see if it fixes the issue:
setenforce 0

Re: Return Code: 3, Output: NRPE: Unable to read output

Posted: Thu Oct 04, 2018 9:03 am
by jenglish
I've copied the check_multipath.sh plugin from a working host. No change.

I tried disabling SELinux. No change.

Code: Select all

(TEST-BOYERS-3|jenglish@coralsea plugins)$ getenforce
Permissive

Code: Select all

Oct  4 10:02:30 coralsea nrpe[21879]: Running command: /usr/lib/nagios/plugins/check_multipath.sh
Oct  4 10:02:30 coralsea nrpe[21880]: WARNING: my_system() seteuid(0): Operation not permitted
Oct  4 10:02:30 coralsea nrpe[21879]: Command completed with return code 0 and output:
Oct  4 10:02:30 coralsea nrpe[21879]: Return Code: 3, Output: NRPE: Unable to read output

Re: Return Code: 3, Output: NRPE: Unable to read output

Posted: Thu Oct 04, 2018 11:29 am
by lmiltchev
Oct 3 16:29:15 coralsea nrpe[38061]: WARNING: my_system() seteuid(0): Operation not permitted
What is the version of NRPE that you are currently using? You may need to upgrade it to the latest. See this:
https://github.com/NagiosEnterprises/nrpe/issues/140

Re: Return Code: 3, Output: NRPE: Unable to read output

Posted: Thu Oct 04, 2018 1:03 pm
by jenglish

Code: Select all

(TEST-BOYERS-3|jenglish@coralsea ~)$ nrpe -V
NRPE - Nagios Remote Plugin Executor
Version: 3.2.0

(TEST-BOYERS-3|jenglish@coralsea ~)$ sudo rpm -qa | grep nrpe
nrpe-3.2.0-6.el7.x86_64
nagios-plugins-nrpe-3.2.0-6.el7.x86_64

Re: Return Code: 3, Output: NRPE: Unable to read output

Posted: Thu Oct 04, 2018 1:11 pm
by lmiltchev
The latest NRPE is 3.2.1.
https://exchange.nagios.org/directory/A ... or/details

I haven't been able to recreate the issue in 3.2.1. I would recommend upgrading NRPE to the latest to see if this is going to solve the problem.