Alerts not clearing correctly

This support forum board is for support questions relating to Nagios XI, our flagship commercial network monitoring solution.
isadmin
Posts: 151
Joined: Thu Nov 08, 2012 10:49 am

Alerts not clearing correctly

Post by isadmin »

Our EMC CX4 alerted the other day but when I checked there where no alerts on the SAN.
The status shows everything ok except SPS faulted on both SP's.
If I run the manual check i receive
./check_emc_clariion.pl -H [ip address] -u ******* -p ****** -t faults
The array is operating normally.
I have deleted files from the tmp directory and rebooted with no change showing in the web interface under ALL SERVICE PROBLEMS
Thanks
isadmin
Posts: 151
Joined: Thu Nov 08, 2012 10:49 am

Re: Alerts not clearing correctly

Post by isadmin »

Reviewing the SPS's they are functioning normally
abrist
Red Shirt
Posts: 8334
Joined: Thu Nov 15, 2012 1:20 pm

Re: Alerts not clearing correctly

Post by abrist »

What is the output for the check on the service details page in xi?
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
isadmin
Posts: 151
Joined: Thu Nov 08, 2012 10:49 am

Re: Alerts not clearing correctly

Post by isadmin »

Service detail page results

Critical
SP A Present,Power ok,Power ok,SPS failed,Cabling ok

But on the SAN Unisphere under hardware the SPS's have no alerts and are working correctly
isadmin
Posts: 151
Joined: Thu Nov 08, 2012 10:49 am

Re: Alerts not clearing correctly

Post by isadmin »

Now EMC does do SPS failure checks every weekend in which they are bounced to test them which triggered the original alerts but it has done this before without
hanging the alerting.
abrist
Red Shirt
Posts: 8334
Joined: Thu Nov 15, 2012 1:20 pm

Re: Alerts not clearing correctly

Post by abrist »

This is strange. What does the command you configured in XI look like?
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
isadmin
Posts: 151
Joined: Thu Nov 08, 2012 10:49 am

Re: Alerts not clearing correctly

Post by isadmin »

check_emc_clariion!$HOSTADDRESS$!-u *******!-p **********!-t sp!--sp A!!!
isadmin
Posts: 151
Joined: Thu Nov 08, 2012 10:49 am

Re: Alerts not clearing correctly

Post by isadmin »

results from commandline
./check_emc_clariion.pl -H IPADDRESS -u ******* -p ******** -t sp --sp A
SP A Present,Power ok,SPS ok,Cabling ok
Something on the Web Interface side is not updating correctly
abrist
Red Shirt
Posts: 8334
Joined: Thu Nov 15, 2012 1:20 pm

Re: Alerts not clearing correctly

Post by abrist »

How big is this script? Could you post it? It seems really odd that only 1 of the 4 or so checks are behaving differently. Is the SPS check the only one that requires a password? Do you have any special, non alphanumeric, nasty meta chars in your username or password?
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
isadmin
Posts: 151
Joined: Thu Nov 08, 2012 10:49 am

Re: Alerts not clearing correctly

Post by isadmin »

No username or password issue and I had tested this script for a few months with Troy ([email protected]) now [email protected]
The script is working fine it is the Web Portion of Nagios not accurately resetting/updating or getting the data.
I have even rebuilt the DB thinking maybe there was an error.
The script is from the EMC Wizard and is pretty large to post.
Version : 2013-02-09
# Date : February 9th 2013
Locked