Page 1 of 1

Errors with Nagios oracle client checks

Posted: Wed Jun 10, 2015 10:52 am
by bmiadmins
Hello,

I have ran through the install using instructions at https://assets.nagios.com/downloads/nag ... ios-XI.pdf. What is happening is that tnsnames.ora is never read in I think. This would result in being unable to connect to the oracle services. That being said, the line used to test, the tnsnames.ora file, and strace output have been included below.

I the strace output you will notice a number of missing files. The exact packages used for the install are listed for you to review as well.

INSTALLED ORACLE PACKAGES :

Code: Select all


nagios-plugins-oracle.x86_64                     1.4.16-10.el6             @epel
oracle-instantclient11.2-basic.x86_64        11.2.0.2.0-1              @/oracle-instantclient11.2-basic-11.2.0.2.0.x86_64
oracle-instantclient11.2-devel.x86_64       11.2.0.2.0-1              @/oracle-instantclient11.2-devel-11.2.0.2.0.x86_64
oracle-instantclient11.2-sqlplus.x86_64     11.2.0.2.0-1              @/oracle-instantclient11.2-sqlplus-11.2.0.2.0.x86_64


TNSNAMES.ORA FILE : ( I was forced to create the directory structure for this )

Code: Select all


cat /usr/lib/oracle/11.2/client64/network/admin/tnsnames.ora


METAPRDEA =
  (DESCRIPTION =
    (ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = ORACLE_EDITED.bmi.org)(PORT = 1521))
    )
    (CONNECT_DATA =
      (SERVICE_NAME = METAPRDEA)
    )
  )



COMMAND RAN :

Code: Select all


strace -e open -o /home/nagios/sql1_debug_run -f /usr/bin/env LD_LIBRARY_PATH=/usr/lib/oracle/11.2/client64/lib ORACLE_HOME=/usr/lib/oracle/11.2/client64 ORACLE_SID=METAPRDEA ORACLE_SID=METAPRDEA /usr/lib/oracle/11.2/client64/bin/sqlplus


STRACE OUTPUT:

Code: Select all


2716  open("/etc/ld.so.cache", O_RDONLY) = 3
2716  open("/lib64/libc.so.6", O_RDONLY) = 3
2716  open("/usr/lib/locale/locale-archive", O_RDONLY) = 3
2716  open("/ade/aime_sqlplus_759908/oracle/lib/tls/x86_64/libsqlplus.so", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/ade/aime_sqlplus_759908/oracle/lib/tls/libsqlplus.so", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/ade/aime_sqlplus_759908/oracle/lib/x86_64/libsqlplus.so", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/ade/aime_sqlplus_759908/oracle/lib/libsqlplus.so", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/usr/lib/oracle/11.2/client64/lib/tls/x86_64/libsqlplus.so", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/usr/lib/oracle/11.2/client64/lib/tls/libsqlplus.so", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/usr/lib/oracle/11.2/client64/lib/x86_64/libsqlplus.so", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/usr/lib/oracle/11.2/client64/lib/libsqlplus.so", O_RDONLY) = 3
2716  open("/usr/lib/oracle/11.2/client64/lib/libclntsh.so.11.1", O_RDONLY) = 3
2716  open("/usr/lib/oracle/11.2/client64/lib/libnnz11.so", O_RDONLY) = 3
2716  open("/usr/lib/oracle/11.2/client64/lib/libdl.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/etc/ld.so.cache", O_RDONLY) = 3
2716  open("/lib64/libdl.so.2", O_RDONLY) = 3
2716  open("/usr/lib/oracle/11.2/client64/lib/libm.so.6", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/lib64/libm.so.6", O_RDONLY) = 3
2716  open("/usr/lib/oracle/11.2/client64/lib/libpthread.so.0", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/lib64/libpthread.so.0", O_RDONLY) = 3
2716  open("/usr/lib/oracle/11.2/client64/lib/libnsl.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/lib64/libnsl.so.1", O_RDONLY) = 3
2716  open("/usr/lib/oracle/11.2/client64/lib/libc.so.6", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/lib64/libc.so.6", O_RDONLY) = 3
2716  open("/usr/lib/oracle/11.2/client64/lib/libaio.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/lib64/libaio.so.1", O_RDONLY) = 3
2716  open("/usr/lib/oracle/11.2/client64/lib/libsqlplusic.so", O_RDONLY) = 3
2716  open("/usr/lib/oracle/11.2/client64/lib/libociei.so", O_RDONLY) = 3
2716  open("/etc/nsswitch.conf", O_RDONLY) = 3
2716  open("/usr/lib/oracle/11.2/client64/lib/libnss_files.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/etc/ld.so.cache", O_RDONLY) = 3
2716  open("/lib64/libnss_files.so.2", O_RDONLY) = 3
2716  open("/etc/passwd", O_RDONLY|O_CLOEXEC) = 3
2716  open("/etc/passwd", O_RDONLY|O_CLOEXEC) = 3
2716  open("/usr/lib/oracle/11.2/client64/rdbms/mesg/diaus.msb", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/usr/lib/oracle/11.2/client64/rdbms/mesg/diaus.msb", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/proc/self/fd/", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = 3
2716  open("/etc/passwd", O_RDONLY|O_CLOEXEC) = 4
2716  open("/etc/passwd", O_RDONLY|O_CLOEXEC) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/metadata/ADR_CONTROL.ams", O_RDONLY) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/metadata/ADR_CONTROL.ams", O_RDONLY|O_DIRECT) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/metadata/ADR_CONTROL.ams", O_RDONLY|O_DSYNC|O_DIRECT) = 4
2716  open("/etc/host.conf", O_RDONLY)  = 4
2716  open("/etc/resolv.conf", O_RDONLY) = 4
2716  open("/etc/hosts", O_RDONLY|O_CLOEXEC) = 4
2716  open("/usr/lib/oracle/11.2/client64/lib/libnss_dns.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/etc/ld.so.cache", O_RDONLY) = 4
2716  open("/lib64/libnss_dns.so.2", O_RDONLY) = 4
2716  open("/usr/lib/oracle/11.2/client64/lib/libresolv.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/lib64/libresolv.so.2", O_RDONLY) = 4
2716  open("/etc/localtime", O_RDONLY)  = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/proc/sys/kernel/shmmax", O_RDONLY) = 4
2716  open("/proc/meminfo", O_RDONLY)   = 4
2716  open("/proc/meminfo", O_RDONLY)   = 4
2716  open("/usr/lib64/libnuma.so", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/usr/lib64/libnuma.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/proc/2716/stat", O_RDONLY) = 4
2716  open("/proc/2716/stat", O_RDONLY) = 4
2716  open("/usr/lib/oracle/11.2/client64/dbs/cm_METAPRDEA.dat", O_RDONLY|O_DSYNC) = -1 ENOENT (No such file or directory)
2716  open("/proc/self/cmdline", O_RDONLY) = 4
2716  open("/etc/passwd", O_RDONLY|O_CLOEXEC) = 4
2716  open("/usr/lib/oracle/11.2/client64/lib/libnque11.so", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  --- SIGCHLD (Child exited) @ 0 (0) ---
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/usr/lib/oracle/11.2/client64/network/mesg/tnsus.msb", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/usr/lib/oracle/11.2/client64/network/mesg/tnsus.msb", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/usr/lib/oracle/11.2/client64/network/mesg/tnsus.msb", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/usr/lib/oracle/11.2/client64/network/mesg/tnsus.msb", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/proc/2716/stat", O_RDONLY) = 4
2716  open("/proc/2716/stat", O_RDONLY) = 4
2716  open("/usr/lib/oracle/11.2/client64/dbs/cm_METAPRDEA.dat", O_RDONLY|O_DSYNC) = -1 ENOENT (No such file or directory)
2716  open("/etc/passwd", O_RDONLY|O_CLOEXEC) = 4
2716  --- SIGCHLD (Child exited) @ 0 (0) ---
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/usr/lib/oracle/11.2/client64/network/mesg/tnsus.msb", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/usr/lib/oracle/11.2/client64/network/mesg/tnsus.msb", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/usr/lib/oracle/11.2/client64/network/mesg/tnsus.msb", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/usr/lib/oracle/11.2/client64/network/mesg/tnsus.msb", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/proc/2716/stat", O_RDONLY) = 4
2716  open("/proc/2716/stat", O_RDONLY) = 4
2716  open("/usr/lib/oracle/11.2/client64/dbs/cm_METAPRDEA.dat", O_RDONLY|O_DSYNC) = -1 ENOENT (No such file or directory)
2716  open("/etc/passwd", O_RDONLY|O_CLOEXEC) = 4
2716  --- SIGCHLD (Child exited) @ 0 (0) ---
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/usr/lib/oracle/11.2/client64/network/mesg/tnsus.msb", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/usr/lib/oracle/11.2/client64/network/mesg/tnsus.msb", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/usr/lib/oracle/11.2/client64/network/mesg/tnsus.msb", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/usr/lib/oracle/11.2/client64/network/mesg/tnsus.msb", O_RDONLY) = -1 ENOENT (No such file or directory)
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/alert/log.xml", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4
2716  open("/home/nagios/oradiag_nagios/diag/clients/user_nagios/host_2781178943_80/trace/sqlnet.log", O_WRONLY|O_CREAT|O_APPEND, 0660) = 4


As you can see, no tnsnames is ever looked for. Also, no matter what I do an error of "ORA-12545: Connect failed because target host or object does not exist" returns. Could I get some help with this please?

Re: Errors with Nagios oracle client checks

Posted: Wed Jun 10, 2015 11:31 am
by lmiltchev
Log in the Oracle server and run the following command to verify the name of the instances running:

Code: Select all

lsnrctl status
Then, run the following command from the CLI on the Nagios XI server:

Code: Select all

/usr/bin/env LD_LIBRARY_PATH=usr/lib/oracle/11.2/client64/lib ORACLE_HOME=/usr/lib/oracle/11.2/client64 /usr/local/nagios/libexec/check_oracle_health --connect '<ip address>:1521/<instance name>' --username '<username>' --password '<password>' --mode tnsping
substituting the <ip address>, <instance name>, <username>, and the <password> with the actual values.

Did the command work? You should see something like this:

Code: Select all

OK - connection established to x.x.x.x:1521/xxxx.

Re: Errors with Nagios oracle client checks

Posted: Wed Jun 10, 2015 12:05 pm
by bmiadmins
Hello,


Looks like I am missing some libs.

Code: Select all


install_driver(Oracle) failed: Can't load '/usr/local/lib64/perl5/auto/DBD/Oracle/Oracle.so' for module DBD::Oracle: libocci.so.11.1: cannot open shared object file: No such file or directory at /usr/lib64/perl5/DynaLoader.pm line 200.
 at (eval 19) line 3
Compilation failed in require at (eval 19) line 3.
Perhaps a required shared library or dll isn't installed where expected
 at /usr/local/nagios/libexec/check_oracle_health line 4755

Let me see if I can find those from some place.

Re: Errors with Nagios oracle client checks

Posted: Wed Jun 10, 2015 12:10 pm
by bmiadmins
Hello,


This looks like a perl issue. I took a look and here is what I found :

Code: Select all



[nagios@n2xnagiosxip02 ~]$ ll /usr/bin/perl
-rwxr-xr-x. 2 root root 7184 Nov 12  2014 /usr/bin/perl
[nagios@n2xnagiosxip02 ~]$ perl -v

This is perl, v5.10.1 (*) built for x86_64-linux-thread-multi

Copyright 1987-2009, Larry Wall

Perl may be copied only under the terms of either the Artistic License or the
GNU General Public License, which may be found in the Perl 5 source kit.

Complete documentation for Perl, including FAQ lists, should be found on
this system using "man perl" or "perldoc perl".  If you have access to the
Internet, point your browser at http://www.perl.org/, the Perl Home Page.
Module  = DBD::Oracle            (PYTHIAN/DBD-Oracle-1.74.tar.gz)
Module  = DBD::Oracle::GetInfo   (PYTHIAN/DBD-Oracle-1.74.tar.gz)
Module  = DBD::Oracle::Object    (PYTHIAN/DBD-Oracle-1.74.tar.gz)



Re: Errors with Nagios oracle client checks

Posted: Wed Jun 10, 2015 12:56 pm
by lmiltchev
We have this issue described in our documentation:
Nagios reports CRITICAL with the message:

“install_driver(Oracle) failed: Can't load '/usr/lib/perl5/site_perl/5.8.8/i386-linux-thread-multi/auto/DBD/Oracle/Oracle.so' for module
DBD::Oracle: libocci.so.11.1: cannot open shared object file: No such file or directory at /usr/lib/perl5/5.8.8/i386-linux-threadmulti/
DynaLoader.pm line 230.”

This problem is due to environment variable not being set properly. This Oracle plugin relies on these environment variables being set.
Make you have probably set the variables as indicated above. Also verify that the proper path is being given. Usual paths are:

x86: /usr/lib/oracle/<YOUR ORACLE VERSION>/client
x86_64: /usr/lib64/oracle/<YOUR ORACLE VERSION>/client

See the section about editing the environment variables of the services. Make sure the environment variables are set to proper value.
These can be verified by actually going to them on the command line.
https://assets.nagios.com/downloads/nag ... ios-XI.pdf

Re: Errors with Nagios oracle client checks

Posted: Wed Jun 10, 2015 1:24 pm
by bmiadmins
Hello,

I had checked the install doc to make sure. Those paths do exist. So, again the issues are that when using strace I can see that libs are missing. I can also see that libs are missing related to PERl. I did copy your line and use it; however, I did not catch the missing "/" inside the LD lib path. After fixing that I continued to get the following error :

Code: Select all


CRITICAL - cannot connect to n2xoraracp01vip.bmi.org:1521/METAPRDEA. ORA-12514: TNS:listener does not currently know of service requested in connect descriptor (DBD ERROR: OCIServerAttach)

The strace output still shows the following are missing :

Code: Select all


30934 open("/usr/lib64/perl5/CORE/tls/x86_64/libperl.so", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/perl5/CORE/tls/libperl.so", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/perl5/CORE/x86_64/libperl.so", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/perl5/CORE/libresolv.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/lib/tls/x86_64/libresolv.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/lib/tls/libresolv.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/lib/x86_64/libresolv.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/lib/libresolv.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/perl5/CORE/libnsl.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/lib/libnsl.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/perl5/CORE/libdl.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/lib/libdl.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/perl5/CORE/libm.so.6", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/lib/libm.so.6", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/perl5/CORE/libcrypt.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/lib/libcrypt.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/perl5/CORE/libutil.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/lib/libutil.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/perl5/CORE/libpthread.so.0", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/lib/libpthread.so.0", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/perl5/CORE/libc.so.6", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/lib/libc.so.6", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/perl5/CORE/libfreebl3.so", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/lib/libfreebl3.so", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/perl5/CORE/librt.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/lib/librt.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/share/locale/en_US.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/share/locale/en_US.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/share/locale/en_US/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/share/locale/en.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/share/locale/en.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/share/locale/en/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/perl5/CORE/libocci.so.11.1", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/perl5/CORE/libclntsh.so.11.1", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/perl5/CORE/libstdc++.so.6", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/lib/libstdc++.so.6", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/perl5/CORE/libgcc_s.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/lib/libgcc_s.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/perl5/CORE/libnnz11.so", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/perl5/CORE/libaio.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/lib/libaio.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/perl5/CORE/libnss_files.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/lib/libnss_files.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/rdbms/mesg/diaus.msb", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/rdbms/mesg/diaus.msb", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/perl5/CORE/libnss_dns.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/lib/libnss_dns.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/libnuma.so", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib64/libnuma.so.1", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/lib/libnque11.so", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/network/mesg/tnsus.msb", O_RDONLY) = -1 ENOENT (No such file or directory)
30934 open("/usr/lib/oracle/11.2/client64/network/mesg/tnsus.msb", O_RDONLY) = -1 ENOENT (No such file or directory)


I am not seeing that the tnsnames.ora is being used. Additionally, I know that service exist. It is used on other applications. I will be glad to check into other issues.

Re: Errors with Nagios oracle client checks

Posted: Wed Jun 10, 2015 2:18 pm
by ssax
Is SELinux enabled?

Code: Select all

sestatus

Re: Errors with Nagios oracle client checks

Posted: Wed Jun 10, 2015 4:25 pm
by bmiadmins
Hello,

OK, its working. However, I am seeing some very odd results.


1. the command returns results from the cli. Results containing a 0,1,2,3 for state.

2. the xi service details show the expected return for service state to represent what was ran from the cli.

3. while inside core > service, a test of the oracle check returns a UNKNOWN value. In essence, its like another server.


I am trying to see how it is possible to get a return code for state that shows up in the XI ui for OK, WARN, or CRITICAL. I would thin that the service state would be the same as what core is seeing when a test is ran against the service.

Re: Errors with Nagios oracle client checks

Posted: Thu Jun 11, 2015 12:42 pm
by tmcdonald
bmiadmins wrote:when a test is ran against the service.
How are you testing this? From the CLI, by letting the check run naturally, or by using the Test Check Command button? If the latter, that button has some known issues with running checks, since it runs as the apache user and does some filtering on certain characters. The true test is to let it run naturally and view the results.