check_jmx4perl using NRPE Daemon/agent configuration

gmills · Post by **gmills** » Mon Jul 08, 2019 12:27 pm

it works on both servers, locally, executing the command.
./check_jmx4perl --user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --warning 80 --critical 90

gmills · Post by **gmills** » Mon Jul 08, 2019 2:37 pm

BUT I CANNOT GET IT TO WORK REMOTELY ON NRPE SERVER
NRPE.cfg on NRPE server

Code: Select all

command[check_remote_container_heap_memory_usage]=/usr/local/nagios/libexec/check_jmx4perl $ARG1$

i've also tried

Code: Select all

command[check_remote_container_heap_memory_usage]=/usr/local/nagios/libexec/check_jmx4perl $ARG1$ $ARG2$ $ARG3$ $ARG4$ $ARG5$ $ARG6$ $ARG7$ $ARG8$

because of
Done. Final output: '/usr/local/nagios/libexec/check_nrpe -H 3.34.2.87 -c check_remote_container_heap_memory_usage -a '"--user passthru" "--password B@dC0mpany" "--url http://localhost:9090/jolokia" "--mbean java.lang:type=Memory" "--attribute HeapMemoryUsage" "--path used" "--base java.lang:type=Memory/HeapMemoryUsage/max" "--warning 80 --critical 90"' '

NAGIOS SERVER
NRPE CHECK COMMAND

Code: Select all

define command{
        command_name check_nrpe
        command_line $USER1$/check_nrpe -H $HOSTADDRESS$ -c $ARG1$ $ARG2$ $ARG3$ $ARG4$
        }

NAGIOS SERVER
NRPE CHECK COMMAND
################################################################################
#
# SAMPLE SERVICE CHECK COMMANDS
#
# These are some example service check commands. They may or may not work on
# your system, as they must be modified for your plugins. See the HTML
# documentation on the plugins for examples of how to configure command definitions.
#
# NOTE: The following 'check_local_...' functions are designed to monitor
# various metrics on the host that Nagios is running on (i.e. this one).
################################################################################
check_local_container_heap_memory_usage is GOOD

Code: Select all

define command{
        command_name    check_local_container_heap_memory_usage
        command_line    $USER1$/check_jmx4perl --user $ARG1$ --password $ARG2$ --url $ARG3$ --mbean $ARG4$ --attribute $ARG5$ --path $ARG6$ --base $ARG7$ $ARG8$
        }

check_remote_container_heap_memory_usage is BAD

Code: Select all

define command{
        command_name    check_remote_container_heap_memory_usage
        command_line    $USER1$/check_jmx4perl $ARG1$
        }

NAGIOS SERVER
SERVICE DEF

Code: Select all

###############################################################################
###############################################################################
#
# SERVICE DEFINITIONS
#
###############################################################################
###############################################################################

define service{
       use                             generic-service
       host_name                       alphprdfuse1i
       service_description             PassThru Container Heap Memory Usage
       check_command                   check_nrpe!check_remote_container_heap_memory_usage!-a '"--user passthru" "--password B@dC0mpany" "--url http://localhost:9090/jolokia" "--mbean java.lang:type=Memory" "--attribute HeapMemoryUsage" "--path used" "--base java.lang:type=Memory/HeapMemoryUsage/max" "--warning 80 --critical 90"'
        }

NRPE.log
Host address is in allowed_hosts
[1562625691] Host 3.x.x.x is asking for command 'check_remote_container_heap_memory_usage!"--user passthru" "--password B@dC0mpany" "--url http://localhost:9090/jolokia" "--mbean java.lang:type=Memory" "--attribute HeapMemoryUsage" "--path used" "--base java.lang:type=Memory/HeapMemoryUsage/max" "--warning 80 --critical 90"' to be run...
[1562625691] NRPE: Command 'check_remote_container_heap_memory_usage!"--user passthru" "--password B@dC0mpany" "--url http://localhost:9090/jolokia" "--mbean java.lang:type=Memory" "--attribute HeapMemoryUsage" "--path used" "--base java.lang:type=Memory/HeapMemoryUsage/max" "--warning 80 --critical 90"' not defined
[1562625691] Return Code: 3, Output: NRPE: Command 'check_remote_container_heap_memory_usage!"--user passthru" "--password B@dC0mpany" "--url http://localhost:9090/jolokia" "--mbean java.lang:type=Memory" "--attribute HeapMemoryUsage" "--path used" "--base java.lang:type=Memory/HeapMemoryUsage/max" "--warning 80 --critical 90"' not defined
[1562625691] Connection from 3.x.x.x closed.

nagios.debug
Done. Final output: '/usr/local/nagios/libexec/check_nrpe -H 3.x.x.x -c check_remote_container_heap_memory_usage -a '"--user passthru" "--password B@dC0mpany" "--url http://localhost:9090/jolokia" "--mbean java.lang:type=Memory" "--attribute HeapMemoryUsage" "--path used" "--base java.lang:type=Memory/HeapMemoryUsage/max" "--warning 80 --critical 90"' '

it appears to be losing the /usr/local/nagios/libexec/check_jmx4perl part - please help, thanks!

Post by **tgriep** » Tue Jul 09, 2019 3:52 pm

Couple of things.
The NRPE agent runs the plugins as the nagios user so make sure the plugin can be executed as the nagios user on the remote hosts.

When making changes to the NRPE config files, the NRPE agent needs to be restarted to load the changes.
Make sure that is done on the remote systems.

gmills · Post by **gmills** » Tue Jul 09, 2019 5:11 pm

thanks tgriep

yeah, those are great points, well taken. I am observing these, I recycle nrpe after each modification to the nrpe.cfg file. Also, yes, services can be run as nagios user. I do have around 62 services running, half are executed on the remote NRPE server. This is not my situation.
All my monitoring services are static type, or do not pass args. e.g.

Code: Select all

command[check_ping]=/usr/local/nagios/libexec/check_ping -H localhost -w 100.0,20% -c 500.0,60% -p 5
command[check_users]=/usr/local/nagios/libexec/check_users -w 5 -c 10
command[check_swap]=/usr/local/nagios/libexec/check_swap -w 15 -c 10
command[check_disk]=/usr/local/nagios/libexec/check_disk -w 10% -c 5%
command[check_load]=/usr/local/nagios/libexec/check_load -w 100.0,20% -c 500.0,60%
command[check_ftp]=/usr/local/nagios/libexec/check_ftp -H localhost
command[check_http]=/usr/local/nagios/libexec/check_http -I localhost
command[check_ssh]=/usr/local/nagios/libexec/check_ssh localhost
command[check_mem]=/usr/local/nagios/libexec/check_mem.pl -u -w 85 -c 95
command[check_total_procs]=/usr/local/nagios/libexec/check_procs -w 300 -c 400 -s RSZDT
command[check_folder_size_Noble]=/usr/local/nagios/libexec/check_folder_size.sh -f GlobalScapeSftpRepo/Noble -s k -w 1024 -c 2048

[/color]
EXCEPT THESE types, I'm trying to pass the args to NRPE

Code: Select all

command[check_remote_container_heap_memory_usage]=/usr/local/nagios/libexec/check_jmx4perl $ARG1$

if you have time, please look at this, this is my problem.
I have built nrpe with ./configure --enable-command-args, make all - and my dont_blame_nrpe=1
so I should be able to send and recieve arguments remotely. it looks like I can, however, ....

After the command executes on the NRPE server

CONN_CHECK_PEER: checking if host is allowed: 3.239.200.29 port 28899
Connection from 3.239.200.29 port 28899
is_an_allowed_host (AF_INET): is host >3.239.200.209< an allowed host >3.239.200.29<
is_an_allowed_host (AF_INET): is host >3.239.200.209< an allowed host >3.239.200.29<
is_an_allowed_host (AF_INET): host is in allowed host list!
Host address is in allowed_hosts
Host 3.239.200.29 is asking for command 'check_remote_container_heap_memory_usage!"--user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --warning 80 --critical 90"' to be run...

NRPE: Command 'check_remote_container_heap_memory_usage!"--user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --warning 80 --critical 90"' not defined

Return Code: 3, Output: NRPE: Command 'check_remote_container_heap_memory_usage!"--user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --warning 80 --critical 90"' not defined
Connection from 3.239.200.29 closed.

So, it is suggesting that the command is not defined. BUT, it is...
nrpe.cfg

Code: Select all

command[check_remote_container_heap_memory_usage]=/usr/local/nagios/libexec/check_jmx4perl $ARG1$

nagios server

Code: Select all

define command{
        command_name    check_remote_container_heap_memory_usage
        command_line    $USER1$/check_jmx4perl $ARG1$
        }

define service{
       use                             generic-service
       host_name                       alphprdfuse1i
       service_description             PassThru Container Heap Memory Usage
       check_command                   check_nrpe!check_remote_container_heap_memory_usage!-a '"--user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --warning 80 --critical 90"'
        }

ALSO, the log snip above clearly shows the args are being sent to the NRPE server. What am I doing wrong?

It works if I define the command on the NRPE like

Code: Select all

command[check_remote_container_heap_memory_usage]=/usr/local/nagios/libexec/check_jmx4perl --user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --warning 80 --critical 90

So, looking at the log above, NRPE thinks it is not defined, ALSO, that the NRPE server IS getting the passed ARGS,
What am I doing wrong??? Can't execute command based on passed args???

Post by **tgriep** » Wed Jul 10, 2019 1:00 pm

Sometimes mixing single and double quotes in the arguments causes issues.
Try using either this as the argument in the nagios config file

Code: Select all

check_command                   check_nrpe!check_remote_container_heap_memory_usage!-a '--user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --warning 80 --critical 90'

Or this

Code: Select all

check_command                   check_nrpe!check_remote_container_heap_memory_usage!-a "--user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --warning 80 --critical 90"

Sometimes that effects the command.

Can you post the full nrpe.cfg file from the remote server as well as the output of the commands ran as root on the remote server?

Code: Select all

netstat -anp |grep 5666
ps -ef |grep nrpe

Thanks

gmills · Post by **gmills** » Thu Jul 11, 2019 10:00 am

thank you so much!!!

[root@alphprdfuse1i ~]# netstat -anp |grep 5666
tcp 0 0 0.0.0.0:5666 0.0.0.0:* LISTEN 23212/nrpe
tcp 0 0 :::5666 :::* LISTEN 23212/nrpe
tcp 0 0 ::ffff:127.0.0.1:3306 ::ffff:127.0.0.1:56660 TIME_WAIT -
tcp 0 0 ::ffff:127.0.0.1:3306 ::ffff:127.0.0.1:56668 TIME_WAIT -
tcp 0 0 ::ffff:127.0.0.1:3306 ::ffff:127.0.0.1:56662 TIME_WAIT -
tcp 0 0 ::ffff:127.0.0.1:3306 ::ffff:127.0.0.1:55666 TIME_WAIT -
tcp 0 0 ::ffff:127.0.0.1:3306 ::ffff:127.0.0.1:35666 TIME_WAIT -
tcp 0 0 ::ffff:127.0.0.1:3306 ::ffff:127.0.0.1:56664 TIME_WAIT -
tcp 0 0 ::ffff:127.0.0.1:3306 ::ffff:127.0.0.1:56666 TIME_WAIT -
unix 3 [ ] STREAM CONNECTED 311025666 21748/sshd
[root@alphprdfuse1i ~]# ps -ef |grep nrpe
nagios 23212 1 0 10:52 ? 00:00:00 /usr/local/nagios/bin/nrpe -c /usr/local/nagios/etc/nrpe.cfg -f
root 27355 26060 0 10:59 pts/3 00:00:00 grep nrpe

Code: Select all

#############################################################################
#
#  Sample NRPE Config File
#
#  Notes:
#
#  This is a sample configuration file for the NRPE daemon.  It needs to be
#  located on the remote host that is running the NRPE daemon, not the host
#  from which the check_nrpe client is being executed.
#
#############################################################################


# LOG FACILITY
# The syslog facility that should be used for logging purposes.

log_facility=daemon



# LOG FILE
# If a log file is specified in this option, nrpe will write to
# that file instead of using syslog.

log_file=/usr/local/nagios/var/nrpe.log



# DEBUGGING OPTION
# This option determines whether or not debugging messages are logged to the
# syslog facility.
# Values: 0=debugging off, 1=debugging on

debug=1



# PID FILE
# The name of the file in which the NRPE daemon should write it's process ID
# number.  The file is only written if the NRPE daemon is started by the root
# user and is running in standalone mode.

pid_file=/usr/local/nagios/var/nrpe.pid

# PORT NUMBER
# Port number we should wait for connections on.
# NOTE: This must be a non-privileged port (i.e. > 1024).
# NOTE: This option is ignored if NRPE is running under either inetd or xinetd

server_port=5666



# SERVER ADDRESS
# Address that nrpe should bind to in case there are more than one interface
# and you do not want nrpe to bind on all interfaces.
# NOTE: This option is ignored if NRPE is running under either inetd or xinetd

#server_address=127.0.0.1



# LISTEN QUEUE SIZE
# Listen queue size (backlog) for serving incoming connections.
# You may want to increase this value under high load.

#listen_queue_size=5



# NRPE USER
# This determines the effective user that the NRPE daemon should run as.
# You can either supply a username or a UID.
#
# NOTE: This option is ignored if NRPE is running under either inetd or xinetd

nrpe_user=nagios



# NRPE GROUP
# This determines the effective group that the NRPE daemon should run as.
# You can either supply a group name or a GID.
#
# NOTE: This option is ignored if NRPE is running under either inetd or xinetd

nrpe_group=nagios

# ALLOWED HOST ADDRESSES
# This is an optional comma-delimited list of IP address or hostnames
# that are allowed to talk to the NRPE daemon. Network addresses with a bit mask
# (i.e. 192.168.1.0/24) are also supported. Hostname wildcards are not currently
# supported.
#
# Note: The daemon only does rudimentary checking of the client's IP
# address.  I would highly recommend adding entries in your /etc/hosts.allow
# file to allow only the specified host to connect to the port
# you are running this daemon on.
#
# NOTE: This option is ignored if NRPE is running under either inetd or xinetd

allowed_hosts=127.0.0.1,::1,3.239.245.209



# COMMAND ARGUMENT PROCESSING
# This option determines whether or not the NRPE daemon will allow clients
# to specify arguments to commands that are executed.  This option only works
# if the daemon was configured with the --enable-command-args configure script
# option.
#
# *** ENABLING THIS OPTION IS A SECURITY RISK! ***
# Read the SECURITY file for information on some of the security implications
# of enabling this variable.
#
# Values: 0=do not allow arguments, 1=allow command arguments

dont_blame_nrpe=1
# BASH COMMAND SUBSTITUTION
# This option determines whether or not the NRPE daemon will allow clients
# to specify arguments that contain bash command substitutions of the form
# $(...).  This option only works if the daemon was configured with both
# the --enable-command-args and --enable-bash-command-substitution configure
# script options.
#
# *** ENABLING THIS OPTION IS A HIGH SECURITY RISK! ***
# Read the SECURITY file for information on some of the security implications
# of enabling this variable.
#
# Values: 0=do not allow bash command substitutions,
#         1=allow bash command substitutions

allow_bash_command_substitution=0



# COMMAND PREFIX
# This option allows you to prefix all commands with a user-defined string.
# A space is automatically added between the specified prefix string and the
# command line from the command definition.
#
# *** THIS EXAMPLE MAY POSE A POTENTIAL SECURITY RISK, SO USE WITH CAUTION! ***
# Usage scenario:
# Execute restricted commmands using sudo.  For this to work, you need to add
# the nagios user to your /etc/sudoers.  An example entry for allowing
# execution of the plugins from might be:
#
# nagios          ALL=(ALL) NOPASSWD: /usr/lib/nagios/plugins/
#
# This lets the nagios user run all commands in that directory (and only them)
# without asking for a password.  If you do this, make sure you don't give
# random users write access to that directory or its contents!

# command_prefix=/usr/bin/sudo
# MAX COMMANDS
# This specifies how many children processes may be spawned at any one
# time, essentially limiting the fork()s that occur.
# Default (0) is set to unlimited
# max_commands=0



# COMMAND TIMEOUT
# This specifies the maximum number of seconds that the NRPE daemon will
# allow plugins to finish executing before killing them off.

command_timeout=60



# CONNECTION TIMEOUT
# This specifies the maximum number of seconds that the NRPE daemon will
# wait for a connection to be established before exiting. This is sometimes
# seen where a network problem stops the SSL being established even though
# all network sessions are connected. This causes the nrpe daemons to
# accumulate, eating system resources. Do not set this too low.

connection_timeout=300



# WEAK RANDOM SEED OPTION
# This directive allows you to use SSL even if your system does not have
# a /dev/random or /dev/urandom (on purpose or because the necessary patches
# were not applied). The random number generator will be seeded from a file
# which is either a file pointed to by the environment valiable $RANDFILE
# or $HOME/.rnd. If neither exists, the pseudo random number generator will
# be initialized and a warning will be issued.
# Values: 0=only seed from /dev/[u]random, 1=also seed from weak randomness

#allow_weak_random_seed=1
# SSL/TLS OPTIONS
# These directives allow you to specify how to use SSL/TLS.

# SSL VERSION
# This can be any of: SSLv2 (only use SSLv2), SSLv2+ (use any version),
#        SSLv3 (only use SSLv3), SSLv3+ (use SSLv3 or above), TLSv1 (only use
#        TLSv1), TLSv1+ (use TLSv1 or above), TLSv1.1 (only use TLSv1.1),
#        TLSv1.1+ (use TLSv1.1 or above), TLSv1.2 (only use TLSv1.2),
#        TLSv1.2+ (use TLSv1.2 or above)
# If an "or above" version is used, the best will be negotiated. So if both
# ends are able to do TLSv1.2 and use specify SSLv2, you will get TLSv1.2.
# If you are using openssl 1.1.0 or above, the SSLv2 options are not available.

#ssl_version=SSLv2+

# SSL USE ADH
# This is for backward compatibility and is DEPRECATED. Set to 1 to enable
# ADH or 2 to require ADH. 1 is currently the default but will be changed
# in a later version.

#ssl_use_adh=1

# SSL CIPHER LIST
# This lists which ciphers can be used. For backward compatibility, this
# defaults to 'ssl_cipher_list=ALL:!MD5:@STRENGTH' for < OpenSSL 1.1.0,
# and 'ssl_cipher_list=ALL:!MD5:@STRENGTH:@SECLEVEL=0' for OpenSSL 1.1.0 and
# greater.

#ssl_cipher_list=ALL:!MD5:@STRENGTH
#ssl_cipher_list=ALL:!MD5:@STRENGTH:@SECLEVEL=0
#ssl_cipher_list=ALL:!aNULL:!eNULL:!SSLv2:!LOW:!EXP:!RC4:!MD5:@STRENGTH

# SSL Certificate and Private Key Files

#ssl_cacert_file=/etc/ssl/servercerts/ca-cert.pem
#ssl_cert_file=/etc/ssl/servercerts/nagios-cert.pem
#ssl_privatekey_file=/etc/ssl/servercerts/nagios-key.pem
#ssl_cacert_file=/etc/ssl/servercerts/ca-cert.pem
#ssl_cert_file=/etc/ssl/servercerts/nagios-cert.pem
#ssl_privatekey_file=/etc/ssl/servercerts/nagios-key.pem

# SSL USE CLIENT CERTS
# This options determines client certificate usage.
# Values: 0 = Don't ask for or require client certificates (default)
#         1 = Ask for client certificates
#         2 = Require client certificates

#ssl_client_certs=0

# SSL LOGGING
# This option determines which SSL messages are send to syslog. OR values
# together to specify multiple options.

# Values: 0x00 (0)  = No additional logging (default)
#         0x01 (1)  = Log startup SSL/TLS parameters
#         0x02 (2)  = Log remote IP address
#         0x04 (4)  = Log SSL/TLS version of connections
#         0x08 (8)  = Log which cipher is being used for the connection
#         0x10 (16) = Log if client has a certificate
#         0x20 (32) = Log details of client's certificate if it has one
#         -1 or 0xff or 0x2f = All of the above

#ssl_logging=0x00



# NASTY METACHARACTERS
# This option allows you to override the list of characters that cannot
# be passed to the NRPE daemon.

# nasty_metachars="|`&><'\\[]{};\r\n"
# COMMAND DEFINITIONS
# Command definitions that this daemon will run.  Definitions
# are in the following format:
#
# command[<command_name>]=<command_line>
#
# When the daemon receives a request to return the results of <command_name>
# it will execute the command specified by the <command_line> argument.
#
# Unlike Nagios, the command line cannot contain macros - it must be
# typed exactly as it should be executed.
#
# Note: Any plugins that are used in the command lines must reside
# on the machine that this daemon is running on!  The examples below
# assume that you have plugins installed in a /usr/local/nagios/libexec
# directory.  Also note that you will have to modify the definitions below
# to match the argument format the plugins expect.  Remember, these are
# examples only!


# The following examples use hardcoded command arguments...
# This is by far the most secure method of using NRPE

#command[check_load]=/usr/local/nagios/libexec/check_load -r -w .65,.60,.50 -c .90,.85,.75
#command[check_hda1]=/usr/local/nagios/libexec/check_disk -w 20% -c 10% -p /dev/hda1
#command[check_zombie_procs]=/usr/local/nagios/libexec/check_procs -w 5 -c 10 -s Z
#command[check_total_procs]=/usr/local/nagios/libexec/check_procs -w 150 -c 200
command[check_ping]=/usr/local/nagios/libexec/check_ping -H localhost -w 100.0,20% -c 500.0,60% -p 5
command[check_users]=/usr/local/nagios/libexec/check_users -w 5 -c 10
command[check_swap]=/usr/local/nagios/libexec/check_swap -w 15 -c 10
command[check_disk]=/usr/local/nagios/libexec/check_disk -w 10% -c 5%
command[check_load]=/usr/local/nagios/libexec/check_load -w 100.0,20% -c 500.0,60%
command[check_ftp]=/usr/local/nagios/libexec/check_ftp -H localhost
command[check_http]=/usr/local/nagios/libexec/check_http -I localhost
command[check_ssh]=/usr/local/nagios/libexec/check_ssh localhost
command[check_mem]=/usr/local/nagios/libexec/check_mem.pl -u -w 85 -c 95
command[check_total_procs]=/usr/local/nagios/libexec/check_procs -w 300 -c 400 -s RSZDT
command[check_folder_size_Noble]=/usr/local/nagios/libexec/check_folder_size.sh -f GlobalScapeSftpRepo/Noble -s k -w 1024 -c 2048
command[check_folder_size_CoP_Alaska]=/usr/local/nagios/libexec/check_folder_size.sh -f GlobalScapeSftpRepo/CoP_Alaska -s k -w 1024 -c 2048
command[check_folder_size_BPCRP]=/usr/local/nagios/libexec/check_folder_size.sh -f GlobalScapeSftpRepo/BPCRP -s k -w 1024 -c 2048
command[check_folder_size_GCMS]=/usr/local/nagios/libexec/check_folder_size.sh -f GlobalScapeSftpRepo/GCMS -s k -w 1024 -c  2048
command[check_folder_size_MaerskDrilling]=/usr/local/nagios/libexec/check_folder_size.sh -f GlobalScapeSftpRepo/MaerskDrilling -s k -w 1024 -c 2048
command[check_folder_size_MSCommand]=/usr/local/nagios/libexec/check_folder_size.sh -f GlobalScapeSftpRepo/MSCommand -s k -w 1024 -c 2048
command[check_dir_files_CoP_Alaska]=/usr/local/nagios/libexec/check_dir_files.sh -d GlobalScapeSftpRepo/CoP_Alaska -w 10 -c 100 -f
command[check_dir_files_BPCRP]=/usr/local/nagios/libexec/check_dir_files.sh -d GlobalScapeSftpRepo/BPCRP -w 10 -c 100 -f
command[check_dir_files_MaerskDrilling]=/usr/local/nagios/libexec/check_dir_files.sh -d GlobalScapeSftpRepo/MaerskDrilling -w 10 -c 100 -f
command[check_dir_files_GCMS]=/usr/local/nagios/libexec/check_dir_files.sh -d GlobalScapeSftpRepo/GCMS -w 10 -c 100 -f
command[check_dir_files_MSCommand]=/usr/local/nagios/libexec/check_dir_files.sh -d GlobalScapeSftpRepo/MSCommand -w 10 -c 100 -f
command[check_dir_files_Noble]=/usr/local/nagios/libexec/check_dir_files.sh -d GlobalScapeSftpRepo/Noble -w 10 -c 100 -f
command[check_passthru_container_heap]=/usr/local/nagios/libexec/check_jmx4perl --user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --warning 80 --critical 90
command[check_iprcmt1_container_heap]=/usr/local/nagios/libexec/check_jmx4perl --user iprcmtx --password G00gl3M3 --url http://localhost:9091/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --warning 80 --critical 90
command[check_deltamro_container_heap]=/usr/local/nagios/libexec/check_jmx4perl --user deltamro --password F@c3B00k --url http://localhost:9092/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --warning 80 --critical 90
command[check_deltafadec_container_heap]=/usr/local/nagios/libexec/check_jmx4perl --user deltafadec --password B@dM0nk3y --url http://localhost:9093/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --warning 80 --critical 90

command[check_remote_container_heap_avail]=/usr/local/nagios/libexec/check_jmx4perl $ARG1$

# The following examples allow user-supplied arguments and can
# only be used if the NRPE daemon was compiled with support for
# command arguments *AND* the dont_blame_nrpe directive in this
# config file is set to '1'.  This poses a potential security risk, so
# make sure you read the SECURITY file before doing this.

### MISC SYSTEM METRICS ###
#command[check_users]=/usr/local/nagios/libexec/check_users $ARG1$
#command[check_load]=/usr/local/nagios/libexec/check_load $ARG1$
#command[check_disk]=/usr/local/nagios/libexec/check_disk $ARG1$
#command[check_swap]=/usr/local/nagios/libexec/check_swap $ARG1$
#command[check_cpu_stats]=/usr/local/nagios/libexec/check_cpu_stats.sh $ARG1$
#command[check_mem]=/usr/local/nagios/libexec/custom_check_mem -n $ARG1$

### GENERIC SERVICES ###
#command[check_init_service]=sudo /usr/local/nagios/libexec/check_init_service $ARG1$
#command[check_services]=/usr/local/nagios/libexec/check_services -p $ARG1$

### SYSTEM UPDATES ###
#command[check_yum]=/usr/local/nagios/libexec/check_yum
#command[check_apt]=/usr/local/nagios/libexec/check_apt

### PROCESSES ###
#command[check_all_procs]=/usr/local/nagios/libexec/custom_check_procs
#command[check_procs]=/usr/local/nagios/libexec/check_procs $ARG1$

### OPEN FILES ###
#command[check_open_files]=/usr/local/nagios/libexec/check_open_files.pl $ARG1$

### NETWORK CONNECTIONS ###
#command[check_netstat]=/usr/local/nagios/libexec/check_netstat.pl -p $ARG1$ $ARG2$
### ASTERISK ###
#command[check_asterisk]=/usr/local/nagios/libexec/check_asterisk.pl $ARG1$
#command[check_sip]=/usr/local/nagios/libexec/check_sip $ARG1$
#command[check_asterisk_sip_peers]=sudo /usr/local/nagios/libexec/check_asterisk_sip_peers.sh $ARG1$
#command[check_asterisk_version]=/usr/local/nagios/libexec/nagisk.pl -c version
#command[check_asterisk_peers]=/usr/local/nagios/libexec/nagisk.pl -c peers
#command[check_asterisk_channels]=/usr/local/nagios/libexec/nagisk.pl -c channels
#command[check_asterisk_zaptel]=/usr/local/nagios/libexec/nagisk.pl -c zaptel
#command[check_asterisk_span]=/usr/local/nagios/libexec/nagisk.pl -c span -s 1



# INCLUDE CONFIG FILE
# This directive allows you to include definitions from an external config file.

#include=<somefile.cfg>



# INCLUDE CONFIG DIRECTORY
# This directive allows you to include definitions from config files (with a
# .cfg extension) in one or more directories (with recursion).

#include_dir=<somedirectory>
#include_dir=<someotherdirectory>

I have tried the following as suggested...

Code: Select all

define service{
       use                              generic-service
       host_name                        alphprdfuse1i
       service_description              Container PassThru Heap Available
       check_command                    check_nrpe!check_remote_container_heap_avail!-a '--user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --critical :85'
       }
define service{
       use                              generic-service
       host_name                        alphprdfuse1i
       service_description              Container IPRCMT1 Heap Available
       check_command                    check_nrpe!check_remote_container_heap_avail!-a "--user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --critical :85"
       }

RESULTS

[root@alphprdfuse1i var]# tail -f nrpe.log
[1562857018] CONN_CHECK_PEER: checking if host is allowed: 3.239.245.209 port 4329
[1562857018] Connection from 3.239.245.209 port 4329
[1562857018] is_an_allowed_host (AF_INET): is host >3.239.245.209< an allowed host >3.239.245.209<
[1562857018] is_an_allowed_host (AF_INET): is host >3.239.245.209< an allowed host >3.239.245.209<
[1562857018] is_an_allowed_host (AF_INET): host is in allowed host list!
[1562857018] Host address is in allowed_hosts
[1562857018] Host 3.239.245.209 is asking for command 'check_remote_container_heap_avail!--user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lmoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --critical :85' to be run...
[1562857018] NRPE: Command 'check_remote_container_heap_avail!--user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lang:type=Memory --attributee java.lang:type=Memory/HeapMemoryUsage/max --critical :85' not defined
[1562857018] Return Code: 3, Output: NRPE: Command 'check_remote_container_heap_avail!--user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.langyUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --critical :85' not defined
[1562857018] Connection from 3.239.245.209 closed.

based on the above, It looks like this should work????
The NRPE is being passed:
'check_remote_container_heap_avail!--user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lang:type=Memory --attributee java.lang:type=Memory/HeapMemoryUsage/max --critical :85'

and the NRPE command is
command[check_remote_container_heap_avail]=/usr/local/nagios/libexec/check_jmx4perl $ARG1$

should call check_remote_container_heap_avail which executes
/usr/local/nagios/libexec/check_jmx4perl $ARG1$

substituting ARG1 with --user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lang:type=Memory --attributee java.lang:type=Memory/HeapMemoryUsage/max --critical :85

FINAL
/usr/local/nagios/libexec/check_jmx4perl --user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lang:type=Memory --attributee java.lang:type=Memory/HeapMemoryUsage/max --critical :85

Why isn't this working ??? thanks so much !!!

Post by **tgriep** » Thu Jul 11, 2019 2:32 pm

I setup a test NRPE agent and added the plugin and command in the NRPE config and it did find the command and it ran the plugin.

Lets test this further.
Login to the Nagios server as root and run the command without any arguments just to see if it responds at all.
Replace xxx.xxx.xxx.xxx with the IP address of the remote server.

Code: Select all

/usr/local/nagios/libexec/check_nrpe -H xxx.xxx.xxx.xxx -c check_remote_container_heap_avail

Then run it with the arguments.

Code: Select all

/usr/local/nagios/libexec/check_nrpe -H xxx.xxx.xxx.xxx -c check_remote_container_heap_avail -a '--user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --critical :85'
/usr/local/nagios/libexec/check_nrpe -H xxx.xxx.xxx.xxx -c check_remote_container_heap_avail -a "--user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --critical :85"

Post the output of the check_nrpe and ant errors in the nrpe.log file.

One thing that looks strange, The argument in the Nagios command do not match the argument in the in the nrpe.log file.

Command arguments

Code: Select all

--user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --critical :85

error log

Code: Select all

--user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.langyUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --critical :85

The only other thing I can thing of is that either the NRPE agent had some issues when it was compiled or that it was not restarted.

gmills · Post by **gmills** » Thu Jul 11, 2019 3:09 pm

Nagios Monitoring Server

Code: Select all

[root@alphprdfuse2i objects]# /usr/local/nagios/libexec/check_nrpe -H 3.34.2.87 -c check_remote_container_heap_avail

RESPONSE on Nagios Server
UNKNOWN - No Server URL given
RESPONSE on NRPE Server
[1562874869] CONN_CHECK_PEER: checking if host is allowed: 3.239.245.209 port 6837
[1562874869] Connection from 3.239.245.209 port 6837
[1562874869] is_an_allowed_host (AF_INET): is host >3.239.245.209< an allowed host >3.239.245.209<
[1562874869] is_an_allowed_host (AF_INET): is host >3.239.245.209< an allowed host >3.239.245.209<
[1562874869] is_an_allowed_host (AF_INET): host is in allowed host list!
[1562874869] Host address is in allowed_hosts
[1562874869] Host 3.239.245.209 is asking for command 'check_remote_container_heap_avail' to be run...
[1562874869] Running command: /usr/local/nagios/libexec/check_jmx4perl
[1562874869] Command completed with return code 3 and output: UNKNOWN - No Server URL given
[1562874869] Return Code: 3, Output: UNKNOWN - No Server URL given
[1562874869] Connection from 3.239.245.209 closed.

The other complete test

Code: Select all

[root@alphprdfuse2i objects]# /usr/local/nagios/libexec/check_nrpe -H 3.34.2.87 -c check_remote_container_heap_avail -a "--user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --critical :85"
NRPE: Command 'check_remote_container_heap_avail!--user passthru --password B@dC0mpany --url http://localhost:9090/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --critical :85' not defined

RESPONSE on NRPE Server
[1562874997] CONN_CHECK_PEER: checking if host is allowed: 3.239.245.209 port 31413
[1562874997] Connection from 3.239.245.209 port 31413
[1562874997] is_an_allowed_host (AF_INET): is host >3.239.245.209< an allowed host >3.239.245.209<
[1562874997] is_an_allowed_host (AF_INET): is host >3.239.245.209< an allowed host >3.239.245.209<
[1562874997] is_an_allowed_host (AF_INET): host is in allowed host list!
[1562874997] Host address is in allowed_hosts
[1562874997] Host 3.239.245.209 is asking for command 'check_deltafadec_container_heap!--user deltafadec --password B@dM0nk3y --url http://localhost:9093/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --critical :85' to be run...
[1562874997] NRPE: Command 'check_deltafadec_container_heap!--user deltafadec --password B@dM0nk3y --url http://localhost:9093/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --critical :85' not defined
[1562874997] Return Code: 3, Output: NRPE: Command 'check_deltafadec_container_heap!--user deltafadec --password B@dM0nk3y --url http://localhost:9093/jolokia --mbean java.lang:type=Memory --attribute HeapMemoryUsage --path used --base java.lang:type=Memory/HeapMemoryUsage/max --critical :85' not defined
[1562874997] Connection from 3.239.245.209 closed.

It looks like the data is being passed to NRPE

One thing that looks strange, The argument in the Nagios command do not match the argument in the in the nrpe.log file.
Thats me, cut and paste. sorry.

The only other thing I can thing of is that either the NRPE agent had some issues when it was compiled or that it was not restarted.
It is not that the agent is not being recycled. I recycle it each time I make a change to config.

so, I'm leaning more towards something happened or didn't happen when compiled. can you give me some pointers, I'll try to build it again.

gmills · Post by **gmills** » Thu Jul 11, 2019 3:30 pm

How should I recompile the nrpe service ?

should I uninstall NRPE?

gmills · Post by **gmills** » Thu Jul 11, 2019 4:37 pm

Hey HEy HEY...

well, geese, I don't get it, but it is what it is... I rebuilt the NRPE code, and it works now. so much wasted time. I thank you very much! have a great week and weekend!!!

I built from the following link both times, something went wrong obviously. using the NRPE.pdf ( but this doesn't give details on args compile ) so, I use both the PDF and the link...
https://support.nagios.com/kb/article.php?id=515#RHEL

just wanted to let you know, I'm working now, and thanks again, it is great having you guys to bounce things off of and get ideas, and solutions.

kudos!!!

Nagios Support Forum

check_jmx4perl using NRPE Daemon/agent configuration

check_jmx4perl using NRPE Daemon/agent configuration

Re: check_jmx4perl using NRPE Daemon/agent configuration

Re: check_jmx4perl using NRPE Daemon/agent configuration

Re: check_jmx4perl using NRPE Daemon/agent configuration

Re: check_jmx4perl using NRPE Daemon/agent configuration

Re: check_jmx4perl using NRPE Daemon/agent configuration

Re: check_jmx4perl using NRPE Daemon/agent configuration

Re: check_jmx4perl using NRPE Daemon/agent configuration

Re: check_jmx4perl using NRPE Daemon/agent configuration

Re: check_jmx4perl using NRPE Daemon/agent configuration