Very Slow populating the dashboard

[digitallook]

Hello All.

I am currently monitoring around 350 hosts with 3500 different service checks running. Whilst trying to populate a dashboard, this process has got VERY slow, and it takes around 10 minutes just to add a host group dashlet to a dashboard.
Im running a HP server with 2 Intel Xeon 2.8G multithreaded processors (16) with 4 cores and 36GB ram.

I have tried querying the mysql database for slow running queries whilst this delay is going on, but i cannot see anything obvious.
Has anyone come across this before??

[tonyyarusso]

To be honest, we don't have enough things to check to create a situation of that size on any of our testing stuff, so no, I can't say I have seen that. Hopefully one of the other guys may be able to speculate as to what's happening.

[digitallook]

Ok, could someone tell me what the processes are in place when adding a hostgroup to a dashboard?
Which mysql or postgres queries run for this and/or what other processes are running while this is happening. I really do need some sort of answer as i have another 500 hosts to add!

[mguthrie]

Postgres handles most of the user and session data, while mysql has the more processor intensive functions for XI. It's used by ndoutils and also the nagiosQL (the CCM).

Just to clarify, are you experiencing slowness during the creation of the host group, or just for adding the created group to the dashboard?

As mentioned above, we don't have a good way to compare on our test boxes here, but maybe we can narrow down the issue.

What kind of load time are you experiencing when viewing a hostgroup from the hostgroups page, and roughly how many hosts are in your groups?

[digitallook]

Hostgroups can have a number of hosts in them...ranging from 1 to 20 or 30. The main problem i have here is populating dashboards with hostgroups.
That is the bulk of my dashboard make up - just hostgroups. I have not tested adding other types yet. It has not always been like this, but has got slower and slower over time as more and more hosts/services have been added.
I have realised it is just getting slower and slower over time (adding a hostgroup to a dashboard). Im doing one now as we speak...here is my method and times taken..

click home, hostgroup overview, click to add hostgroup(wait about 5 mins), add to dashboard box appears, give dashlet title, select dashboard to add to(another 7 minute wait).

Total time to add a hostgroup = 12mins. This hostgroup has 25 hosts.

[mguthrie]

Thanks for the input. That definitely shouldn't be taking that long, but I'm not sure as to what would cause that yet. I'll do some investigating on this and let you know what I find...

[admin]

Just a thought - it might be related to some kind of blocking behavior in the browser. Each hostgroup dashlet is set to be updated via ajax every 10-30 seconds. If there are many hostgroup dashlets on the page, the browser could be busy with other ajax requests.

This shouldn't be the cause of problems, because the ajax updates are supposed to be asynchronous, so they shouldn't block browser activity. Could be something to look into though...

[digitallook]

I doubt this is the case (caused by browser). I have 3 different browsers on my desktop and it is the same using any of them.
Also, some of my other users have also tried the process with the same or similar results.

[mguthrie]

What kind of load times are you getting when you view your hosts groups from the details pages?

[digitallook]

Roughly 90 seconds.