BPI Takes a lot time to load

[bosecorp]

got it

updated the file, I still see these errors

b=high
[Fri Nov 09 14:19:50.806139 2018] [:error] [pid 80436] [client 10.144.3.20:38726] PHP Notice: Undefined variable: host_name in /usr/local/nagiosxi/html/includes/components/nagiosbpi/classes/BpGroup_class.php on line 0, referer: http://nagiosxi/nagiosxi/includes/compo ... p?tab=high
[Fri Nov 09 14:19:50.806167 2018] [:error] [pid 80436] [client 10.144.3.20:38726] PHP Warning: array_map(): Argument #2 should be an array in /usr/local/nagiosxi/html/includes/components/nagiosbpi/classes/BpGroup_class.php on line 0, referer: http://nagiosxi/nagiosxi/includes/compo ... p?tab=high
[Fri Nov 09 14:19:50.806179 2018] [:error] [pid 80436] [client 10.144.3.20:38726] PHP Notice: Undefined variable: service_description in /usr/local/nagiosxi/html/includes/components/nagiosbpi/classes/BpGroup_class.php on line 0, referer: http://nagiosxi/nagiosxi/includes/compo ... p?tab=high
[Fri Nov 09 14:19:50.806215 2018] [:error] [pid 80436] [client 10.144.3.20:38726] PHP Warning: array_map(): Argument #2 should be an array in /usr/local/nagiosxi/html/includes/components/nagiosbpi/classes/BpGroup_class.php on line 0, referer: http://nagiosxi/nagiosxi/includes/compo ... p?tab=high
[Fri Nov 09 14:19:50.806229 2018] [:error] [pid 80436] [client 10.144.3.20:38726] PHP Warning: array_multisort(): Argument #1 is expected to be an array or a sort flag in /usr/local/nagiosxi/html/includes/components/nagiosbpi/classes/BpGroup_class.php on line 0, referer: http://nagiosxi/nagiosxi/includes/compo ... p?tab=high

[benjaminsmith]

Hi @bosecorp

Thanks for posting the error log, while we're reviewing those php notices/errors, I have a few more suggestions to improve performance.

Also, how much time is the BPI taking to load now? Have you noticed any improvement?

1. In Admin > Performance Settings > Subsystem, if you're not using Outbound Data Transfers, make sure this is unchecked. Also, turn off Enable Subsystem Logging to free up resources during normal operations.

2. Turn off SNMPTT logs in /etc/snmp/snmptt.ini by setting syslog_enable = 0

3. Let's run a repair and optimize process on your databases:

Code: Select all

mysqlcheck -f -r -u root -pnagiosxi --all-databases
mysqlcheck -f -o -u root -pnagiosxi --all-databases

4. In Home > Details > BPI > Edit BPI Settings, increase the AJAX multiplier to reduce CPU usage.

5. It would be helpful for us to review your BPI config file ( /usr/local/nagiosxi/etc/components/bpi.conf)

[bosecorp]

Hi

Noticed only about 2 seconds improvements. Still take good solid 9-10 seconds

I implemented all the recommendations above

and I still see these errors

[Sat Nov 10 09:43:38.154261 2018] [:error] [pid 124635] [client 10.144.3.20:5772] PHP Notice: Undefined variable: host_name in /usr/local/nagiosxi/html/includes/components/nagiosbpi/classes/BpGroup_class.php on line 0, referer: http://nagiosxi/nagiosxi/includes/compo ... p?tab=high
[Sat Nov 10 09:43:38.160461 2018] [:error] [pid 124635] [client 10.144.3.20:5772] PHP Warning: array_map(): Argument #2 should be an array in /usr/local/nagiosxi/html/includes/components/nagiosbpi/classes/BpGroup_class.php on line 0, referer: http://nagiosxi/nagiosxi/includes/compo ... p?tab=high
[Sat Nov 10 09:43:38.160525 2018] [:error] [pid 124635] [client 10.144.3.20:5772] PHP Notice: Undefined variable: service_description in /usr/local/nagiosxi/html/includes/components/nagiosbpi/classes/BpGroup_class.php on line 0, referer: http://nagiosxi/nagiosxi/includes/compo ... p?tab=high
[Sat Nov 10 09:43:38.160578 2018] [:error] [pid 124635] [client 10.144.3.20:5772] PHP Warning: array_map(): Argument #2 should be an array in /usr/local/nagiosxi/html/includes/components/nagiosbpi/classes/BpGroup_class.php on line 0, referer: http://nagiosxi/nagiosxi/includes/compo ... p?tab=high
[Sat Nov 10 09:43:38.160628 2018] [:error] [pid 124635] [client 10.144.3.20:5772] PHP Warning: array_multisort(): Argument #1 is expected to be an array or a sort flag in /usr/local/nagiosxi/html/includes/components/nagiosbpi/classes/BpGroup_class.php on line 0, referer: http://nagiosxi/nagiosxi/includes/compo ... p?tab=high
[Sat Nov 10 09:43:38.162746 2018] [:error] [pid 124635] [client 10.144.3.20:5772] PHP Notice: Undefined variable: host_name in /usr/local/nagiosxi/html/includes/components/nagiosbpi/classes/BpGroup_class.php on line 0, referer: http://nagiosxi/nagiosxi/includes/compo ... p?tab=high
[Sat Nov 10 09:43:38.162815 2018] [:error] [pid 124635] [client 10.144.3.20:5772] PHP Warning: array_map(): Argument #2 should be an array in /usr/local/nagiosxi/html/includes/components/nagiosbpi/classes/BpGroup_class.php on line 0, referer: http://nagiosxi/nagiosxi/includes/compo ... p?tab=high
[Sat Nov 10 09:43:38.162857 2018] [:error] [pid 124635] [client 10.144.3.20:5772] PHP Notice: Undefined variable: service_description in /usr/local/nagiosxi/html/includes/components/nagiosbpi/classes/BpGroup_class.php on line 0, referer: http://nagiosxi/nagiosxi/includes/compo ... p?tab=high
[Sat Nov 10 09:43:38.162907 2018] [:error] [pid 124635] [client 10.144.3.20:5772] PHP Warning: array_map(): Argument #2 should be an array in /usr/local/nagiosxi/html/includes/components/nagiosbpi/classes/BpGroup_class.php on line 0, referer: http://nagiosxi/nagiosxi/includes/compo ... p?tab=high
[Sat Nov 10 09:43:38.162949 2018] [:error] [pid 124635] [client 10.144.3.20:5772] PHP Warning: array_multisort(): Argument #1 is expected to be an array or a sort flag in /usr/local/nagiosxi/html/includes/components/nagiosbpi/classes/BpGroup_class.php on line 0, referer: http://nagiosxi/nagiosxi/includes/compo ... p?tab=high

[benjaminsmith]

Hi,@bosecorp

Thank you for making those changes. We have a maintenance release, Nagios 5.5.7, coming out tomorrow with security patches and and improvements to the BPI component that should address those php warnings. Please backup your system and upgrade to 5.5.7 when available. Let me know if your still getting errors, and your approximate page loads after updating.

In the meantime, can you run top command while the BPI is loading, and let me know if your hitting 100% CPU load or not.

[bosecorp]

here you go

top - 11:40:23 up 76 days, 19:28, 2 users, load average: 5.54, 5.23, 6.03
Tasks: 741 total, 8 running, 732 sleeping, 0 stopped, 0 zombie
%Cpu(s): 37.5 us, 8.2 sy, 0.0 ni, 54.3 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st
KiB Mem : 12565518+total, 17913708 free, 5024196 used, 10271728+buff/cache
KiB Swap: 0 total, 0 free, 0 used. 11536059+avail Mem

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
34835 apache 20 0 888872 278656 5996 R 100.0 0.2 0:03.61 httpd
93363 nagios 20 0 168144 16224 2384 S 62.5 0.0 0:00.12 check_wmi_plus.
93487 nagios 20 0 161324 11396 2288 R 62.5 0.0 0:00.10 check_wmi_plus.
93492 root 20 0 431108 24124 8984 R 50.0 0.0 0:00.08 php
71126 apache 20 0 644000 34000 5680 R 43.8 0.0 0:01.23 httpd
93301 nagios 20 0 168148 16328 2404 S 43.8 0.0 0:00.17 check_wmi_plus.
93491 nagios 20 0 155532 11948 2380 S 37.5 0.0 0:00.06 check_ifopersta
20665 apache 20 0 640304 30948 6348 R 25.0 0.0 0:04.09 httpd
69015 mysql 20 0 9078932 1.2g 6948 S 25.0 1.0 1484:25 mysqld
93497 nagios 20 0 146344 8872 2180 R 25.0 0.0 0:00.04 check_ifopersta
73397 apache 20 0 540092 32960 4928 S 12.5 0.0 0:01.34 httpd
93382 root 20 0 172820 2700 1580 R 12.5 0.0 0:00.03 top
93498 nagios 20 0 133660 6316 2040 R 12.5 0.0 0:00.02 check_snmp_stor
79456 nagios 20 0 435712 29976 9360 S 6.2 0.0 0:00.26 php
84119 root 20 0 260232 111068 2200 S 6.2 0.1 0:00.36 mrtg
84121 root 20 0 260392 111084 2152 S 6.2 0.1 0:01.36 mrtg
90721 nagios 20 0 120712 980 812 S 6.2 0.0 0:00.01 check_icmp
93295 nagios 20 0 168148 16328 2404 S 6.2 0.0 0:00.12 check_wmi_plus.
124217 nagios 20 0 77732 42584 1508 S 6.2 0.0 2:53.76 nagios
124229 nagios 20 0 148536 20736 1248 S 6.2 0.0 4:26.73 ndo2db
1 root 20 0 192044 4616 2148 S 0.0 0.0 107:13.62 systemd
2 root 20 0 0 0 0 S 0.0 0.0 0:08.28 kthreadd
3 root 20 0 0 0 0 S 0.0 0.0 2:11.49 ksoftirqd/0
5 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 kworker/0:0H
7 root rt 0 0 0 0 S 0.0 0.0 5:45.06 migration/0
8 root 20 0 0 0 0 S 0.0 0.0 0:00.00 rcu_bh
9 root 20 0 0 0 0 S 0.0 0.0 405:20.33 rcu_sched
10 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 lru-add-drain
11 root rt 0 0 0 0 S 0.0 0.0 0:30.83 watchdog/0
12 root rt 0 0 0 0 S 0.0 0.0 0:28.60 watchdog/1
13 root rt 0 0 0 0 S 0.0 0.0 5:43.15 migration/1
14 root 20 0 0 0 0 S 0.0 0.0 2:08.19 ksoftirqd/1

[benjaminsmith]

Hello @bosecorp

Thank you for the last update. Currently, the whole set of objects for your environment is parsed and checked in BPI, and this requires significant system resources for larger systems. Please monitor the host/service check latencies (Amin > System Information > Monitoring Engine Status). If your seeing high average latencies (over 10 seconds), then we recommend increasing the average check interval, reducing the number of checks or upgrading the server environment.

Please let me know the load times when you update to 5.5.7.

[bosecorp]

I upgraded Nagios to the latest version but I have the same performance problem with BPI

[benjaminsmith]

Hi @bosecorp,

Thanks for updating to 5.5.7 and getting back to us. We are doing are best to improve speed and performance of Nagios XI on large systems, and appreciate the time you've spent tuning your server. At times, we have to query large amount of information from the database, and this requires optimization in both software and hardware. Would you be able to send me your bpi.conf file, so that we can review it?

Also, are you still seeing the php warnings as before?

[bosecorp]

HI

I pm you the file

[benjaminsmith]

Hi @bosecorp

Thanks for sending over the configuration file. I'm working on setting up a test environment with your profile and BPI configuration and will update you tomorrow.