URGENT Postgresql server unalaiable Production server down!

[benhank]

something has gone terribly wrong
I uninstalled nagiosxi using the uninstall script, reasoning that I would just reinstall and do a restore.
Postgresql will not install. i attached the install.log file
I even tried to install using a pre nagiosxi 5.0 version so the install would install postgresql. Can I get a ticket for a session tomorrow morning? These are my production servers i have to get them up.
thanks guys

[tgriep]

Try starting the Postgres daemon and then go to this folder

Code: Select all

/var/lib/pgsql/data/pg_log

Look at the latest log file for any errors and post them here.

To open up a ticket, you can use the instructions in the following link.
https://support.nagios.com/kb/article/c ... r-769.html

[benhank]

this is all set looks like it was caused by an outage at my company that seemed unrelated but wasnt. leave this one unlocked. i want to share the ending of the mystery.

[tgriep]

OK, we'll leave the post open so you can update it.

[benhank]

Gentlemen, we all know that there are words and phrases that when used in the IT world, cause those in the IT cry like a constipated Chewbacca after a marathon burrito pigout session.
Things like "nothing changed" " should" and the dreaded guaranteed used by the boldest of soon to be unemployed " lets let it run over the weekend and check it on monday".
But today's word, is the worst, the vilest, the horrific nightmare of nightmares.
The cause of my issue will cause the readers of this post to experience IT cognitive dissonance as you think "AH and ouch at the same exact time.

Yes, my fellow keyboard warriors, the culprit of my situation, can be summed up with the evilest, worst word in our repertoire. and that word is :
vendor.
Yep, a vendor, deployed a vm that somehow made sweeping changes to the enterprise causing any and all linux devices configured as localhost and not to a hosts file( I'm still a little fuzzy on the explanation) to get total screwed up.
Thanks to you all for the rapid response to my issue and for the help, but this one was bigger than all of us.

[lmiltchev]

@benhank, I am glad you got to the bottom of this... and you made us laugh so much!

...cause those in the IT cry like a constipated Chewbacca after a marathon burrito pigout session.

LOL

[benhank]

=D

[lmiltchev]

@benhank, is it safe to close this topic?

[benhank]

Yeah bro.
Moral of the story: when all things are equal and two separate systems get hit with the same insane problem, there is a vendor lose in the castle.

Nut on a serious note I really really appreciate the fast responses fellas. Nobody realizes how crucial monitoring is until you don't have it and need it. you guys were there for a bro as always.