Page 1 of 1

PagerDuty Integration Suddenly Broken

Posted: Tue Jun 15, 2021 2:04 pm
by matson-itops
unable to send pages out again. agent is installed and freshly restarted.
HELP

Details :

[1623783341] SERVICE NOTIFICATION: pagerduty_prod_ops;localhost;Swap Usage;CRITICAL;notify-service-by-pagerduty;SWAP CRITICAL - 1% free (2 MB out of 10239 MB)
[1623783341] wproc: NOTIFY job 2390 from worker Core Worker 1449185 is a non-check helper but exited with return code 2
[1623783341] wproc: host=localhost; service=Swap Usage; contact=pagerduty_prod_ops
[1623783341] wproc: early_timeout=0; exited_ok=1; wait_status=512; error_code=0;
[1623783341] wproc: stderr line 01: execvp(/usr/share/pdagent-integrations/bin/pd-nagios, ...) failed. errno is 2: No such file or directory

]# ls -la /usr/share/pdagent-integrations/bin/pd-nagios
-rwxr-xr-x 1 root root 6762 May 12 2020 /usr/share/pdagent-integrations/bin/pd-nagios

Re: PagerDuty Integration Suddenly Broken

Posted: Wed Jun 16, 2021 10:15 am
by ssax
Please PM me a copy of your profile, you can download it from Admin > System Profile by clicking the Download Profile button.

SSH into the XI server, then run these commands, and send the output:

Code: Select all

su - nagios
/usr/share/pdagent-integrations/bin/pd-nagios -h

Re: PagerDuty Integration Suddenly Broken

Posted: Wed Jun 16, 2021 1:34 pm
by matson-itops
have PM'd you the profile

here is the output you also requested :
[nagios@orec2upm04 bin]$ /usr/share/pdagent-integrations/bin/pd-nagios -h
-bash: /usr/share/pdagent-integrations/bin/pd-nagios: /usr/bin/python: bad interpreter: No such file or directory
[nagios@orec2upm04 bin]$ ls -la /usr/bin/python
ls: cannot access '/usr/bin/python': No such file or directory

looks like python went missing somehow
I do have python3

please point me to instructions on how to best to reinstall python
not sure which versions are required.

Re: PagerDuty Integration Suddenly Broken

Posted: Thu Jun 17, 2021 12:11 pm
by ssax
You should be able to do this:

Code: Select all

ln -sfn /usr/bin/python3 /usr/bin/python
What OS/version is it running?

Code: Select all

uname -a
cat /etc/*release

Re: PagerDuty Integration Suddenly Broken

Posted: Tue Jun 29, 2021 6:46 pm
by matson-itops
yes thank you. that worked.

Re: PagerDuty Integration Suddenly Broken

Posted: Wed Jun 30, 2021 2:17 pm
by ssax
Great, let us know when we're okay to lock this up and mark it as resolved.