Acknowledgement Data missing

[rajasegar]

Nagios XI 2014R1.2

Yesterday we had an incident where the partition hosting Nagios became full.
Today we noticed all the acknowledgement data is missing

Please advice

1) Where is the acknowledgement, comments etc stored? If DB which table.
2) How to restore the data from backup

Thanks

[Box293]

Where abouts are you noticing all the acknowledgement data is missing. Some screenshots will help.

[rajasegar]

Where abouts are you noticing all the acknowledgement data is missing. Some screenshots will help.

From the monitors itself, all previous acknowledgement is gone from host & service history.
Only the ones added on that day are there.

Same thing from Incident Management->Acknowledgement & Comments.
Previous scheduled tasks history are also gone.

In short it is gone from everywhere.

[abrist]

If retention.dat could not be written out, runtime state data (acks,comments, etc) will be lost. As you had a partition filled, that would be my guess.

[rajasegar]

If retention.dat could not be written out, runtime state data (acks,comments, etc) will be lost. As you had a partition filled, that would be my guess.

So are you saying the acknowledgement, comments are stored in retention.dat?

[abrist]

Yes.

[rajasegar]

Yes.

I recall Nagios support asked me to delete the retention.dat as part of the solution to solve the upgrade problem.
Nobody told us about the side effects. Lucky I reverted back else there would have been big time noise from the monitoring team.

[slansing]

That is correct, there are some issues that can be "jump-start" resolved by removing retention.dat, however, it does get re-created upon restart if it was missing. As abrist noted, it contains things such as state information, comments, and downtime so it can be used to bring your nagios system back to where it was if the main process is killed off and restarted.