Re: schedule downtime issue
Posted: Tue Feb 09, 2016 5:09 am
Attempt to schedulle downtime on host amss-onair-kvm-26
As you can see, no trace of this schedulle found in logs.
Here is the trace of nagios log file
As you can see, no trace of this schedulle found in logs.
Here is the trace of nagios log file
Code: Select all
[1455011990] HOST ALERT: onair-tel-ops-img-01b;UP;SOFT;2;OK - onair-tel-ops-img-01b: rta 0.191ms, lost 0%
[1455011990] GLOBAL HOST EVENT HANDLER: onair-tel-ops-img-01b;UP;SOFT;2;xi_host_event_handler
[1455011990] HOST EVENT HANDLER: onair-tel-ops-img-01b;UP;SOFT;2;amos_handler_host
[1455011993] SERVICE ALERT: onair-tel-ops-img-01b;Ping;OK;SOFT;2;OK - onair-tel-ops-img-01b: rta 0.257ms, lost 0%
[1455011993] GLOBAL SERVICE EVENT HANDLER: onair-tel-ops-img-01b;Ping;OK;SOFT;2;xi_service_event_handler
[1455011993] SERVICE EVENT HANDLER: onair-tel-ops-img-01b;Ping;OK;SOFT;2;amos_handler_service
[1455011999] SERVICE ALERT: onair-tel-cf-02;Physical memory;WARNING;HARD;3;Physical memory: 95%used(3764MB/3953MB) (>95%) : WARNING
[1455011999] SERVICE NOTIFICATION: dad;onair-tel-cf-02;Physical memory;WARNING;notify-service-by-email;Physical memory: 95%used(3764MB/3953MB) (>95%) : WARNING
[1455011999] SERVICE NOTIFICATION: opstaff;onair-tel-cf-02;Physical memory;WARNING;notify-service-by-email;Physical memory: 95%used(3764MB/3953MB) (>95%) : WARNING
[1455011999] GLOBAL SERVICE EVENT HANDLER: onair-tel-cf-02;Physical memory;WARNING;HARD;3;xi_service_event_handler
[1455011999] SERVICE EVENT HANDLER: onair-tel-cf-02;Physical memory;WARNING;HARD;3;amos_handler_service
[1455012013] SERVICE ALERT: amsp-onair-nxt-db-12;Replication status for Portal/billing database;CRITICAL;SOFT;1;POSTGRES_HOT_STANDBY_DELAY CRITICAL: DB "portal" (host:amsp-onair-nxt-db-11) 17304
[1455012013] GLOBAL SERVICE EVENT HANDLER: amsp-onair-nxt-db-12;Replication status for Portal/billing database;CRITICAL;SOFT;1;xi_service_event_handler
[1455012013] SERVICE EVENT HANDLER: amsp-onair-nxt-db-12;Replication status for Portal/billing database;CRITICAL;SOFT;1;amos_handler_service
[1455012071] SERVICE ALERT: amsp-onair-nxt-db-12;Replication status for Portal/billing database;OK;SOFT;2;POSTGRES_HOT_STANDBY_DELAY OK: DB "portal" (host:amsp-onair-nxt-db-11) 0
[1455012071] GLOBAL SERVICE EVENT HANDLER: amsp-onair-nxt-db-12;Replication status for Portal/billing database;OK;SOFT;2;xi_service_event_handler
[1455012071] SERVICE EVENT HANDLER: amsp-onair-nxt-db-12;Replication status for Portal/billing database;OK;SOFT;2;amos_handler_service
[1455012291] HOST ALERT: onair-tel-ops-img-01b;DOWN;SOFT;1;CRITICAL - onair-tel-ops-img-01b: Host unreachable @ 10.121.8.59. rta nan, lost 100%
[1455012291] GLOBAL HOST EVENT HANDLER: onair-tel-ops-img-01b;DOWN;SOFT;1;xi_host_event_handler
[1455012291] HOST EVENT HANDLER: onair-tel-ops-img-01b;DOWN;SOFT;1;amos_handler_host
[1455012294] SERVICE ALERT: onair-tel-ops-img-01b;Ping;CRITICAL;SOFT;1;CRITICAL - onair-tel-ops-img-01b: Host unreachable @ 10.121.8.59. rta nan, lost 100%
[1455012294] GLOBAL SERVICE EVENT HANDLER: onair-tel-ops-img-01b;Ping;CRITICAL;SOFT;1;xi_service_event_handler
[1455012294] SERVICE EVENT HANDLER: onair-tel-ops-img-01b;Ping;CRITICAL;SOFT;1;amos_handler_service
[1455012297] SERVICE ALERT: onair-tel-cf-02;Physical memory;OK;HARD;3;Physical memory: 89%used(3531MB/3953MB) (<95%) : OK
[1455012297] SERVICE NOTIFICATION: dad;onair-tel-cf-02;Physical memory;OK;notify-service-by-email;Physical memory: 89%used(3531MB/3953MB) (<95%) : OK
[1455012297] SERVICE NOTIFICATION: opstaff;onair-tel-cf-02;Physical memory;OK;notify-service-by-email;Physical memory: 89%used(3531MB/3953MB) (<95%) : OK
[1455012297] GLOBAL SERVICE EVENT HANDLER: onair-tel-cf-02;Physical memory;OK;HARD;3;xi_service_event_handler
[1455012297] SERVICE EVENT HANDLER: onair-tel-cf-02;Physical memory;OK;HARD;3;amos_handler_service
[1455012308] HOST ALERT: onair-tel-ops-img-01b;DOWN;SOFT;2;CRITICAL - onair-tel-ops-img-01b: Host unreachable @ 10.121.8.59. rta nan, lost 100%
[1455012308] GLOBAL HOST EVENT HANDLER: onair-tel-ops-img-01b;DOWN;SOFT;2;xi_host_event_handler
[1455012308] HOST EVENT HANDLER: onair-tel-ops-img-01b;DOWN;SOFT;2;amos_handler_host
[1455012352] SERVICE ALERT: onair-tel-ops-img-01b;Ping;CRITICAL;SOFT;2;CRITICAL - onair-tel-ops-img-01b: Host unreachable @ 10.121.8.59. rta nan, lost 100%
[1455012352] GLOBAL SERVICE EVENT HANDLER: onair-tel-ops-img-01b;Ping;CRITICAL;SOFT;2;xi_service_event_handler
[1455012352] SERVICE EVENT HANDLER: onair-tel-ops-img-01b;Ping;CRITICAL;SOFT;2;amos_handler_service
[1455012355] HOST ALERT: onair-tel-ops-img-01b;DOWN;SOFT;3;CRITICAL - onair-tel-ops-img-01b: Host unreachable @ 10.121.8.59. rta nan, lost 100%
[1455012355] GLOBAL HOST EVENT HANDLER: onair-tel-ops-img-01b;DOWN;SOFT;3;xi_host_event_handler
[1455012355] HOST EVENT HANDLER: onair-tel-ops-img-01b;DOWN;SOFT;3;amos_handler_host
[1455012355] SERVICE ALERT: amsp-onair-nxt-portal-02;Web Page Content;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 200 OK - string 'Your browser' not found on 'http://10.121.9.219:80/confirm_cookies' - 2675 bytes in 0.180 second response time
[1455012355] GLOBAL SERVICE EVENT HANDLER: amsp-onair-nxt-portal-02;Web Page Content;CRITICAL;SOFT;1;xi_service_event_handler
[1455012355] SERVICE EVENT HANDLER: amsp-onair-nxt-portal-02;Web Page Content;CRITICAL;SOFT;1;amos_handler_service