Consolidate / Aggregate messages from multiple Nagios

[ffeingol]

Hello All,

We have three different nagios systems running. One is on the East Coast, one on the West Coast and one in the Midwest. All three systems pull the exact same configuration from a private git repository. The general idea is to monitor our services from a customers point of view (mostly if there are network issues).

The system works fine if there is a network issue related to one carrier / part of the US. That one system starts to alert and we know that part of the country 'may' have issues. The problem is when there is an actual host/service issue and then we get 3x the alerts.

I'm trying to see if there is any 3rd party system that will accept the Nagios alerts and then consolidate/aggragate them. We tired look at flapjack (flapjack.io) but we're not really Ruby people which makes it a bit difficult to configure contacts etc.

Is anyone running anything similar or have a solution?

Thanks

[rkennedy]

Are you able to create a file accessible to all 3 machines? I believe you could do this by using a lock file sort of logic. Though, it could be done many different ways.Here's a way I thought about, that would sit in front of your notifications as a wrapper.

For example, we have three machines, a, b, and c -
a - checks lock folder for $hostname$.lock, doesn't exist, sends notification
b - checks lock folder for $hostname$.lock, exists, doesn't send notification
c - checks lock folder for $hostname$.lock, exists, doesn't send notification

Then, you would need to setup global event handlers with a script to remove the lock files when a host / service returns to an OK state.

[ffeingol]

Hello,

No, they really don't have any shared storage between them. There are running on VPS's in different data centers (so they come across different network providers).

Thanks

[rkennedy]

Well, the solution to what I mentioned above would be using shared storage, or some sort of web handler. The logic is all there, now you just need to build.