problems of nagios core 4.0.8 on aix 5.3

[lichaofeng]

I am running nagios core 4.0.8 on aix 5.3 .
and i have some question .


1) the processes are defunct
$ ps -ef | grep nagios
nagios 1179788 1286550 0 0:00 <defunct>
nagios 1417358 1286550 0 0:00 <defunct>
nagios 1527888 1286550 0 0:00 <defunct>
nagios 655624 1286550 0 0:00 <defunct>
nagios 1286550 1 0 Jul 22 - 0:53 /opt/freeware/bin/nagios -d /etc/nagios/nagios.cfg
nagios 1540406 1286550 0 0:00 <defunct>
nagios 1626548 1286550 0 0:00 <defunct>
nagios 1720830 1286550 0 Jul 22 - 0:13 /opt/freeware/bin/nagios -d /etc/nagios/nagios.cfg
appsup 1753522 1531956 0 10:25:13 pts/0 0:00 grep nagios

2) and the log shows :
$ tail -f nagios.log

[1469413780] Nagios 4.0.8 starting... (PID=1540446)
[1469413780] Local time is Mon Jul 25 10:29:40 BEIST 2016
[1469413780] LOG VERSION: 2.0
[1469413780] qh: Socket '/var/nagios/rw/nagios.qh' successfully initialized
[1469413780] qh: core query handler registered
[1469413780] nerd: Channel hostchecks registered successfully
[1469413780] nerd: Channel servicechecks registered successfully
[1469413780] nerd: Channel opathchecks registered successfully
[1469413780] nerd: Fully initialized and ready to rock!
[1469413780] wproc: Successfully registered manager as @wproc with query handler
[1469413782] Successfully launched command file worker with pid 1544286
[1469413782] Unable to send check for host 'localhost' to worker (ret=-2)
[1469413819] Unable to run check for service 'Current Load' on host 'localhost'
[1469413857] Unable to run check for service 'Current Users' on host 'localhost'
[1469413894] Unable to run check for service 'HTTP' on host 'localhost'



any one could help me , thank you very much !

[tgriep]

When a plugin is executed by the Nagios process, it is executed by the by the nagios user account.
Can you verify that the plugins can be executed while logged in to the server as the nagios user?
Can you post the directory listing of the folder where the plugins are installed so we can view the settings?

[lichaofeng]

When a plugin is executed by the Nagios process, it is executed by the by the nagios user account.
Can you verify that the plugins can be executed while logged in to the server as the nagios user?
Can you post the directory listing of the folder where the plugins are installed so we can view the settings?

thanks for your reply .


1/

Code: Select all

$ /opt/freeware/lib/nagios/plugins/check_ping -H localhost -w 20,20% -c 50,50%
PING OK - Packet loss = 0%, RTA = 0.00 ms|rta=0.000000ms;20.000000;50.000000;0.000000 pl=0%;20;50;0
$ id
uid=64320(nagios) gid=64320(nagios) groups=64321(nagiscmd)
$ ls -l /opt/freeware/lib/nagios/plugins/check_ping
-rwxr-xr-x    1 root     system        76366 Jul 02 2014  /opt/freeware/lib/nagios/plugins/check_ping

2/

Code: Select all

$ rpm -qal | grep nagios | grep plug
/opt/freeware/lib/nagios/plugins
/opt/freeware/doc/nagios-plugins-2.0.3
/opt/freeware/doc/nagios-plugins-2.0.3/ACKNOWLEDGEMENTS
/opt/freeware/doc/nagios-plugins-2.0.3/AUTHORS
/opt/freeware/doc/nagios-plugins-2.0.3/CODING
/opt/freeware/doc/nagios-plugins-2.0.3/COPYING
/opt/freeware/doc/nagios-plugins-2.0.3/ChangeLog
/opt/freeware/doc/nagios-plugins-2.0.3/FAQ
/opt/freeware/doc/nagios-plugins-2.0.3/LEGAL
/opt/freeware/doc/nagios-plugins-2.0.3/NEWS
/opt/freeware/doc/nagios-plugins-2.0.3/README
/opt/freeware/doc/nagios-plugins-2.0.3/REQUIREMENTS
/opt/freeware/doc/nagios-plugins-2.0.3/SUPPORT
/opt/freeware/doc/nagios-plugins-2.0.3/THANKS
/opt/freeware/lib/nagios/plugins
/opt/freeware/lib/nagios/plugins/check_apt
/opt/freeware/lib/nagios/plugins/check_breeze
/opt/freeware/lib/nagios/plugins/check_by_ssh
/opt/freeware/lib/nagios/plugins/check_clamd
/opt/freeware/lib/nagios/plugins/check_cluster
/opt/freeware/lib/nagios/plugins/check_dbi
/opt/freeware/lib/nagios/plugins/check_dhcp
/opt/freeware/lib/nagios/plugins/check_disk
/opt/freeware/lib/nagios/plugins/check_disk_smb
/opt/freeware/lib/nagios/plugins/check_dns
/opt/freeware/lib/nagios/plugins/check_dummy
/opt/freeware/lib/nagios/plugins/check_file_age
/opt/freeware/lib/nagios/plugins/check_flexlm
/opt/freeware/lib/nagios/plugins/check_ftp
/opt/freeware/lib/nagios/plugins/check_http
/opt/freeware/lib/nagios/plugins/check_icmp
/opt/freeware/lib/nagios/plugins/check_ifoperstatus
/opt/freeware/lib/nagios/plugins/check_ifstatus
/opt/freeware/lib/nagios/plugins/check_imap
/opt/freeware/lib/nagios/plugins/check_ircd
/opt/freeware/lib/nagios/plugins/check_jabber
/opt/freeware/lib/nagios/plugins/check_ldap
/opt/freeware/lib/nagios/plugins/check_ldaps
/opt/freeware/lib/nagios/plugins/check_load
/opt/freeware/lib/nagios/plugins/check_log
/opt/freeware/lib/nagios/plugins/check_mailq
/opt/freeware/lib/nagios/plugins/check_mrtg
/opt/freeware/lib/nagios/plugins/check_mrtgtraf
/opt/freeware/lib/nagios/plugins/check_nagios
/opt/freeware/lib/nagios/plugins/check_nntp
/opt/freeware/lib/nagios/plugins/check_nntps
/opt/freeware/lib/nagios/plugins/check_nt
/opt/freeware/lib/nagios/plugins/check_ntp
/opt/freeware/lib/nagios/plugins/check_ntp_peer
/opt/freeware/lib/nagios/plugins/check_ntp_time
/opt/freeware/lib/nagios/plugins/check_nwstat
/opt/freeware/lib/nagios/plugins/check_oracle
/opt/freeware/lib/nagios/plugins/check_overcr
/opt/freeware/lib/nagios/plugins/check_ping
/opt/freeware/lib/nagios/plugins/check_pop
/opt/freeware/lib/nagios/plugins/check_procs
/opt/freeware/lib/nagios/plugins/check_real
/opt/freeware/lib/nagios/plugins/check_rpc
/opt/freeware/lib/nagios/plugins/check_sensors
/opt/freeware/lib/nagios/plugins/check_simap
/opt/freeware/lib/nagios/plugins/check_smtp
/opt/freeware/lib/nagios/plugins/check_spop
/opt/freeware/lib/nagios/plugins/check_ssh
/opt/freeware/lib/nagios/plugins/check_ssmtp
/opt/freeware/lib/nagios/plugins/check_swap
/opt/freeware/lib/nagios/plugins/check_tcp
/opt/freeware/lib/nagios/plugins/check_time
/opt/freeware/lib/nagios/plugins/check_udp
/opt/freeware/lib/nagios/plugins/check_ups
/opt/freeware/lib/nagios/plugins/check_users
/opt/freeware/lib/nagios/plugins/check_wave
/opt/freeware/lib/nagios/plugins/negate
/opt/freeware/lib/nagios/plugins/urlize
/opt/freeware/lib/nagios/plugins/utils.pm
/opt/freeware/lib/nagios/plugins/utils.sh

any suggestions ?

[tgriep]

Can you run the following on that server and post the output?

Code: Select all

ls -l /opt/freeware/lib/nagios/plugins/

[lichaofeng]

Can you run the following on that server and post the output?

Code: Select all

ls -l /opt/freeware/lib/nagios/plugins/

Code: Select all

$ id
uid=64320(nagios) gid=64320(nagios) groups=64321(nagiscmd)
$ ls -l /opt/freeware/lib/nagios/plugins/
total 5847
-rwxr-xr-x    1 root     system       141522 Jul 02 2014  check_apt
-rwxr-xr-x    1 root     system         2249 Jul 02 2014  check_breeze
-rwxr-xr-x    1 root     system        74662 Jul 02 2014  check_by_ssh
lrwxrwxrwx    1 root     system            9 Jul 21 17:34 check_clamd -> check_tcp
-rwxr-xr-x    1 root     system        59009 Jul 02 2014  check_cluster
-rwxr-xr-x    1 root     system       147981 Jul 02 2014  check_dbi
-r-sr-xr-x    1 root     system        67604 Jul 02 2014  check_dhcp
-rwxr-xr-x    1 root     system       150872 Jul 02 2014  check_disk
-rwxr-xr-x    1 root     system         9296 Jul 02 2014  check_disk_smb
-rwxr-xr-x    1 root     system        79350 Jul 02 2014  check_dns
-rwxr-xr-x    1 root     system        44397 Jul 02 2014  check_dummy
-rwxr-xr-x    1 root     system         3356 Jul 02 2014  check_file_age
-rwxr-xr-x    1 root     system         6322 Jul 02 2014  check_flexlm
lrwxrwxrwx    1 root     system            9 Jul 21 17:34 check_ftp -> check_tcp
-rwxr-xr-x    1 root     system       214724 Jul 02 2014  check_http
-r-sr-xr-x    1 root     system        73571 Jul 02 2014  check_icmp
-rwxr-xr-x    1 root     system        15130 Jul 02 2014  check_ifoperstatus
-rwxr-xr-x    1 root     system        12607 Jul 02 2014  check_ifstatus
lrwxrwxrwx    1 root     system            9 Jul 21 17:35 check_imap -> check_tcp
-rwxr-xr-x    1 root     system         6894 Jul 02 2014  check_ircd
lrwxrwxrwx    1 root     system            9 Jul 21 17:35 check_jabber -> check_tcp
-rwxr-xr-x    1 root     system        67087 Jul 02 2014  check_ldap
lrwxrwxrwx    1 root     system           10 Jul 21 17:35 check_ldaps -> check_ldap
-rwxr-xr-x    1 root     system        63753 Jul 02 2014  check_load
-rwxr-xr-x    1 root     system         5986 Jul 02 2014  check_log
-rwxr-xr-x    1 root     system        21487 Jul 02 2014  check_mailq
-rwxr-xr-x    1 root     system        61953 Jul 02 2014  check_mrtg
-rwxr-xr-x    1 root     system        60665 Jul 02 2014  check_mrtgtraf
-rwxr-xr-x    1 root     system        64141 Jul 02 2014  check_nagios
lrwxrwxrwx    1 root     system            9 Jul 21 17:35 check_nntp -> check_tcp
lrwxrwxrwx    1 root     system            9 Jul 21 17:35 check_nntps -> check_tcp
-rwxr-xr-x    1 root     system        75566 Jul 02 2014  check_nt
-rwxr-xr-x    1 root     system        87026 Jul 02 2014  check_ntp
-rwxr-xr-x    1 root     system        73295 Jul 02 2014  check_ntp_peer
-rwxr-xr-x    1 root     system        83362 Jul 02 2014  check_ntp_time
-rwxr-xr-x    1 root     system        84758 Jul 02 2014  check_nwstat
-rwxr-xr-x    1 root     system         8784 Jul 02 2014  check_oracle
-rwxr-xr-x    1 root     system        67730 Jul 02 2014  check_overcr
-rwxr-xr-x    1 root     system        76366 Jul 02 2014  check_ping
lrwxrwxrwx    1 root     system            9 Jul 21 17:35 check_pop -> check_tcp
-rwxr-xr-x    1 root     system       148289 Jul 02 2014  check_procs
-rwxr-xr-x    1 root     system        65858 Jul 02 2014  check_real
-rwxr-xr-x    1 root     system         9588 Jul 02 2014  check_rpc
-rwxr-xr-x    1 root     system         1458 Jul 02 2014  check_sensors
lrwxrwxrwx    1 root     system            9 Jul 21 17:35 check_simap -> check_tcp
-rwxr-xr-x    1 root     system       155814 Jul 02 2014  check_smtp
lrwxrwxrwx    1 root     system            9 Jul 21 17:35 check_spop -> check_tcp
-rwxr-xr-x    1 root     system        64126 Jul 02 2014  check_ssh
lrwxrwxrwx    1 root     system            9 Jul 21 17:35 check_ssmtp -> check_tcp
-rwxr-xr-x    1 root     system        66478 Jul 02 2014  check_swap
-rwxr-xr-x    1 root     system        81205 Jul 02 2014  check_tcp
-rwxr-xr-x    1 root     system        65142 Jul 02 2014  check_time
lrwxrwxrwx    1 root     system            9 Jul 21 17:35 check_udp -> check_tcp
-rwxr-xr-x    1 root     system        70994 Jul 02 2014  check_ups
-rwxr-xr-x    1 root     system        57649 Jul 02 2014  check_users
-rwxr-xr-x    1 root     system         2943 Jul 02 2014  check_wave
-rwxr-xr-x    1 root     system        58333 Jul 02 2014  negate
-rwxr-xr-x    1 root     system        55349 Jul 02 2014  urlize
-rw-r--r--    1 root     system         1895 Jul 02 2014  utils.pm
-rwxr-xr-x    1 root     system         2791 Jul 02 2014  utils.sh

[tgriep]

Try changing the group ownership for all of the plugins to the nagios group and then try and run the plugins in question while logged in as the nagios user.
If that fails, we would have to see the commands.cfg file and the config files for those services that are failing. Could you post that?

[lichaofeng]

Try changing the group ownership for all of the plugins to the nagios group and then try and run the plugins in question while logged in as the nagios user.
If that fails, we would have to see the commands.cfg file and the config files for those services that are failing. Could you post that?

when i logged in as the nagios user , the plugins run always correct manually . even if the plugins don't belongs to the nagios group&user .
see commands.cfg and config for those sevices that are failing ???
nonono , all services are pending . but i can run the plugins success manually . And when I startup the nagios , there are no alive process (defunct) .

Code: Select all

root:/ >chown -R nagios:nagios /opt/freeware/lib/nagios/plugins
root:/ >
root:/ >su - nagios
$ ls -l /opt/freeware/lib/nagios/plugins
total 5847
-rwxr-xr-x    1 nagios   nagios       141522 Jul 02 2014  check_apt
-rwxr-xr-x    1 nagios   nagios         2249 Jul 02 2014  check_breeze
-rwxr-xr-x    1 nagios   nagios        74662 Jul 02 2014  check_by_ssh
lrwxrwxrwx    1 root     system            9 Jul 21 17:34 check_clamd -> check_tcp
-rwxr-xr-x    1 nagios   nagios        59009 Jul 02 2014  check_cluster
-rwxr-xr-x    1 nagios   nagios       147981 Jul 02 2014  check_dbi
-r-sr-xr-x    1 nagios   nagios        67604 Jul 02 2014  check_dhcp
-rwxr-xr-x    1 nagios   nagios       150872 Jul 02 2014  check_disk
-rwxr-xr-x    1 nagios   nagios         9296 Jul 02 2014  check_disk_smb
-rwxr-xr-x    1 nagios   nagios        79350 Jul 02 2014  check_dns
-rwxr-xr-x    1 nagios   nagios        44397 Jul 02 2014  check_dummy
-rwxr-xr-x    1 nagios   nagios         3356 Jul 02 2014  check_file_age
-rwxr-xr-x    1 nagios   nagios         6322 Jul 02 2014  check_flexlm
lrwxrwxrwx    1 root     system            9 Jul 21 17:34 check_ftp -> check_tcp
-rwxr-xr-x    1 nagios   nagios       214724 Jul 02 2014  check_http
-r-sr-xr-x    1 nagios   nagios        73571 Jul 02 2014  check_icmp
-rwxr-xr-x    1 nagios   nagios        15130 Jul 02 2014  check_ifoperstatus
-rwxr-xr-x    1 nagios   nagios        12607 Jul 02 2014  check_ifstatus
lrwxrwxrwx    1 root     system            9 Jul 21 17:35 check_imap -> check_tcp
-rwxr-xr-x    1 nagios   nagios         6894 Jul 02 2014  check_ircd
lrwxrwxrwx    1 root     system            9 Jul 21 17:35 check_jabber -> check_tcp
-rwxr-xr-x    1 nagios   nagios        67087 Jul 02 2014  check_ldap
lrwxrwxrwx    1 root     system           10 Jul 21 17:35 check_ldaps -> check_ldap
-rwxr-xr-x    1 nagios   nagios        63753 Jul 02 2014  check_load
-rwxr-xr-x    1 nagios   nagios         5986 Jul 02 2014  check_log
-rwxr-xr-x    1 nagios   nagios        21487 Jul 02 2014  check_mailq
-rwxr-xr-x    1 nagios   nagios        61953 Jul 02 2014  check_mrtg
-rwxr-xr-x    1 nagios   nagios        60665 Jul 02 2014  check_mrtgtraf
-rwxr-xr-x    1 nagios   nagios        64141 Jul 02 2014  check_nagios
lrwxrwxrwx    1 root     system            9 Jul 21 17:35 check_nntp -> check_tcp
lrwxrwxrwx    1 root     system            9 Jul 21 17:35 check_nntps -> check_tcp
-rwxr-xr-x    1 nagios   nagios        75566 Jul 02 2014  check_nt
-rwxr-xr-x    1 nagios   nagios        87026 Jul 02 2014  check_ntp
-rwxr-xr-x    1 nagios   nagios        73295 Jul 02 2014  check_ntp_peer
-rwxr-xr-x    1 nagios   nagios        83362 Jul 02 2014  check_ntp_time
-rwxr-xr-x    1 nagios   nagios        84758 Jul 02 2014  check_nwstat
-rwxr-xr-x    1 nagios   nagios         8784 Jul 02 2014  check_oracle
-rwxr-xr-x    1 nagios   nagios        67730 Jul 02 2014  check_overcr
-rwxr-xr-x    1 nagios   nagios        76366 Jul 02 2014  check_ping
lrwxrwxrwx    1 root     system            9 Jul 21 17:35 check_pop -> check_tcp
-rwxr-xr-x    1 nagios   nagios       148289 Jul 02 2014  check_procs
-rwxr-xr-x    1 nagios   nagios        65858 Jul 02 2014  check_real
-rwxr-xr-x    1 nagios   nagios         9588 Jul 02 2014  check_rpc
-rwxr-xr-x    1 nagios   nagios         1458 Jul 02 2014  check_sensors
lrwxrwxrwx    1 root     system            9 Jul 21 17:35 check_simap -> check_tcp
-rwxr-xr-x    1 nagios   nagios       155814 Jul 02 2014  check_smtp
lrwxrwxrwx    1 root     system            9 Jul 21 17:35 check_spop -> check_tcp
-rwxr-xr-x    1 nagios   nagios        64126 Jul 02 2014  check_ssh
lrwxrwxrwx    1 root     system            9 Jul 21 17:35 check_ssmtp -> check_tcp
-rwxr-xr-x    1 nagios   nagios        66478 Jul 02 2014  check_swap
-rwxr-xr-x    1 nagios   nagios        81205 Jul 02 2014  check_tcp
-rwxr-xr-x    1 nagios   nagios        65142 Jul 02 2014  check_time
lrwxrwxrwx    1 root     system            9 Jul 21 17:35 check_udp -> check_tcp
-rwxr-xr-x    1 nagios   nagios        70994 Jul 02 2014  check_ups
-rwxr-xr-x    1 nagios   nagios        57649 Jul 02 2014  check_users
-rwxr-xr-x    1 nagios   nagios         2943 Jul 02 2014  check_wave
-rwxr-xr-x    1 nagios   nagios        58333 Jul 02 2014  negate
-rwxr-xr-x    1 nagios   nagios        55349 Jul 02 2014  urlize
-rw-r--r--    1 nagios   nagios         1895 Jul 02 2014  utils.pm
-rwxr-xr-x    1 nagios   nagios         2791 Jul 02 2014  utils.sh

$ /opt/freeware/lib/nagios/plugins/check_ping -H localhost -w 20,20% -c 50,50%
PING OK - Packet loss = 0%, RTA = 0.00 ms|rta=0.000000ms;20.000000;50.000000;0.000000 pl=0%;20;50;0
$ id
uid=64320(nagios) gid=64320(nagios) groups=64321(nagiscmd)
$ /opt/freeware/lib/nagios/plugins/check_disk  -w 80 -c 90
DISK CRITICAL - free space: / 1227 MB (29% inode=99%); /usr 757 MB (11% inode=94%); /var 383 MB (24% inode=98%); /tmp 3161 MB (60% inode=99%); /home 1042 MB (23% inode=98%); /proc 0 MB (0% inode=-); /opt 54 MB (14% inode=96%); /tsmfs 1927 MB (94% inode=99%); /datavg09 510200 MB (63% inode=99%); /datavg08 0 MB (0% inode=1%); /datavg43 51932 MB (19% inode=86%);| /=2868MB;4016;4006;0;4096 /usr=5962MB;6640;6630;0;6720 /var=1152MB;1456;1446;0;1536 /tmp=2022MB;5104;5094;0;5184 /home=3309MB;4272;4262;0;4352 /proc=2147483647MB;2147483647;2147483647;0;2147483647 /opt=329MB;304;294;0;384 /tsmfs=120MB;1968;1958;0;2048 /datavg09=294663MB;804784;804774;0;804864 /datavg08=802304MB;802224;802214;0;802304 /datavg43=214308MB;266160;266150;0;266240

$ /opt/freeware/bin/nagios -d /etc/nagios/nagios.cfg
$ 
$ ps -ef | grep nagios
  nagios  282680 1327108   2 10:32:13  pts/0  0:00 ps -ef
  nagios  979078  643524   0                  0:00 <defunct>
  nagios 1188064  643524   0                  0:00 <defunct>
  nagios 1327108 1544300   0 10:27:08  pts/0  0:00 -ksh
  nagios 1388630  643524   0 10:32:10      -  0:00 /opt/freeware/bin/nagios -d /etc/nagios/nagios.cfg
  nagios 1556636  643524   0                  0:00 <defunct>
  nagios  643524       1   0 10:32:07      -  0:00 /opt/freeware/bin/nagios -d /etc/nagios/nagios.cfg
  nagios 1323316  643524   0                  0:00 <defunct>
  nagios 1532178  643524   0                  0:00 <defunct>
  nagios 1630558 1327108   0 10:32:13  pts/0  0:00 grep nagios
  nagios 1761584  643524   0                  0:00 <defunct>

[tgriep]

What you can do is to stop the nagios processes and the defunct one.
Turn on debugging in the nagios.cfg file and start up the nagios daemon and see what types of errors show up in the nagios.debug file.

[lichaofeng]

I set daemon_dumps_core=1 & debug_level=-1 in nagios.cfg ,
and start up the nagios daemon .

Code: Select all

$/opt/freeware/bin/nagios -d /etc/nagios/nagios.cfg

and here is the log file , debug file , and the cfg file . I can not find something useful .

nagios.rar

(47.14 KiB) Downloaded 87 times

I am running nagios on aix 5.3 , does aix supported by nagios ?
I download nagios rpm from perzl.org .

[tgriep]

We don't have access to an AIX server so that make it difficult for us to support it. Nagios core works very well on Centos and Redhat if you have access to one of those OS's.

You may want to verify the settings in the nagios.cfg file and make sure that they match where things are installed and running from.

One thing, you may want to enable auto_reschedule in nagios by editing the nagios.cfg file and change the following from

Code: Select all

auto_reschedule_checks=0

to

Code: Select all

auto_reschedule_checks=1

Save and restart nagios

It looks like the checks didn't run and that could be a time issue or with the scheduling settings from above. If you are still having problems, post the following files so we can view them.

Code: Select all

/etc/nagios/objects/commands.cfg
/etc/nagios/objects/localhost.cfg
/etc/nagios/resource.cfg