Page 1 of 1

polled.extras.ibd size keep increasing on fusion server

Posted: Fri Sep 28, 2018 5:27 am
by amane
Hi,

/var/lib/mysql is 100% full on our Nagios fusion servers,

polled.extras.ibd size is around 140GB which is located at /var/lib/mysql/fusion.

Please find below the dir sizes which are in /var/lib/mysql/

143391 fusion
18 ibdata1
5 ib_logfile1
5 ib_logfile0
1 test
1 performance_schema
1 mysql
1 aria_log_control
1 aria_log.00000001
0 mysql.sock

We have recently upgraded our fusion to 4.1.5.

Could you please tell me why polled.extras.ibd file size keep increasing and how we can reduce the file size.

Re: polled.extras.ibd size keep increasing on fusion server

Posted: Fri Sep 28, 2018 4:08 pm
by ssax
Please download the attached zip, no need to extract it.
trimpolled.zip
Then go to Admin > Manage Components:
- Click the Browse button
- Select the downloaded trimpolled.zip file
- Click the Upload & Install button

You should now see Trim Polled as a component listed.

Then run these commands (as root):

Code: Select all

pkill -9 -u nagios
service crond restart
cd /usr/local/nagiosfusion/scripts/
./truncate_polled.php
Then wait for it to poll and rebuild the data and it should keep the size smaller.

Let us know the results.

Re: polled.extras.ibd size keep increasing on fusion server

Posted: Mon Oct 01, 2018 9:14 am
by amane
Hi Ssax,

Thanks for the update.

We have follow the process and /var/lib/mysql size is reduces to 1% however our fusion console performance has been reduces after running these steps. Now the fusion is working very slow.
mysqld is using more memory usage on fusion server

[nagios@lxfusengprd001 ~]$ top
top - 10:12:31 up 10 days, 10:01, 1 user, load average: 38.06, 75.43, 100.08
Tasks: 288 total, 8 running, 280 sleeping, 0 stopped, 0 zombie
%Cpu(s): 44.7 us, 40.0 sy, 0.0 ni, 1.3 id, 9.6 wa, 0.0 hi, 4.4 si, 0.0 st
KiB Mem : 3881052 total, 113756 free, 3654796 used, 112500 buff/cache
KiB Swap: 8388604 total, 4291072 free, 4097532 used. 28080 avail Mem

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
14502 mysql 20 0 2649972 251412 3284 S 184.5 6.5 3:49.31 mysqld
47 root 20 0 0 0 0 R 19.5 0.0 161:35.10 kswapd0
14814 nagios 20 0 391300 22156 1808 R 5.6 0.6 0:08.32 poll_subsys.php
14788 nagios 20 0 391300 17892 1808 R 5.0 0.5 0:08.86 poll_subsys.php
14805 nagios 20 0 391300 24844 1808 R 5.0 0.6 0:08.80 poll_subsys.php
6941 root 20 0 0 0 0 S 4.6 0.0 0:08.16 kworker/u8:2
11205 nagios 20 0 418000 38936 1460 S 3.0 1.0 0:25.60 poll_subsys.php
14849 nagios 20 0 418028 64992 1824 S 3.0 1.7 0:11.80 poll_subsys.php
14890 nagios 20 0 418028 50036 1824 S 3.0 1.3 0:12.73 poll_subsys.php
14919 nagios 20 0 418028 61920 1824 S 3.0 1.6 0:11.65 poll_subsys.php
14954 nagios 20 0 418028 46048 1824 S 3.0 1.2 0:11.91 poll_subsys.php
14985 nagios 20 0 422560 47740 1824 S 3.0 1.2 0:12.61 poll_subsys.php
15002 nagios 20 0 393420 36048 1928 D 3.0 0.9 0:07.88 poll_subsys.php
17452 root 20 0 0 0 0 R 3.0 0.0 0:11.12 kworker/u8:4
14840 nagios 20 0 418028 54792 1824 S 2.6 1.4 0:11.52 poll_subsys.php
14854 nagios 20 0 418028 46556 1824 S 2.6 1.2 0:12.11 poll_subsys.php
14869 nagios 20 0 418028 54260 1824 S 2.6 1.4 0:11.41 poll_subsys.php
14874 nagios 20 0 418028 64696 1824 S 2.6 1.7 0:11.77 poll_subsys.php
14900 nagios 20 0 418028 49872 1824 S 2.6 1.3 0:11.66 poll_subsys.php
14912 nagios 20 0 418028 46024 1824 S 2.6 1.2 0:11.84 poll_subsys.php
14936 nagios 20 0 418028 48084 1824 S 2.6 1.2 0:11.87 poll_subsys.php
14941 nagios 20 0 418028 65984 1824 S 2.6 1.7 0:11.71 poll_subsys.php
14949 nagios 20 0 418028 52412 1824 S 2.6 1.4 0:11.65 poll_subsys.php
14959 nagios 20 0 418028 61608 1824 S 2.6 1.6 0:11.54 poll_subsys.php
14991 nagios 20 0 422304 55872 1824 S 2.6 1.4 0:12.18 poll_subsys.php
5428 nagios 20 0 417716 35868 1452 S 2.3 0.9 0:51.06 poll_subsys.php
6183 nagios 20 0 417704 34588 1452 S 2.3 0.9 0:49.98 poll_subsys.php
6904 nagios 20 0 417688 24420 1288 S 2.3 0.6 2:12.52 poll_subsys.php
13644 nagios 20 0 422300 40040 1464 S 2.3 1.0 0:17.14 poll_subsys.php
14798 nagios 20 0 391300 6160 1816 R 2.3 0.2 0:08.43 poll_subsys.php
14828 nagios 20 0 418028 53936 1824 S 2.3 1.4 0:11.71 poll_subsys.php
14845 nagios 20 0 418028 64372 1824 S 2.3 1.7 0:11.51 poll_subsys.php
14857 nagios 20 0 418028 63924 1824 S 2.3 1.6 0:11.80 poll_subsys.php
14862 nagios 20 0 418028 54300 1824 S 2.3 1.4 0:11.50 poll_subsys.php
14865 nagios 20 0 418028 63532 1824 R 2.3 1.6 0:11.47 poll_subsys.php
14878 nagios 20 0 418028 52804 1824 S 2.3 1.4 0:11.64 poll_subsys.php

Re: polled.extras.ibd size keep increasing on fusion server

Posted: Mon Oct 01, 2018 5:00 pm
by ssax
Can you try rebooting the system to clear up those poll_subsys.php processes?