Slow web interface

[CameronWP]

Hello:

I am having an issue where the web front-end continually slows to a crawl. I restart the logstash and elasticsearch and after a few minutes it starts working again until the next time. I have edited the memory allocated but that hasn't made a difference and I am not sure where to go from here.

Thanks!

[CameronWP]

I have had this issue before and was asked for the following information:

free -m
total used free shared buff/cache available
Mem: 64225 38343 606 3189 25276 21884
Swap: 999 257 742

df -h

Filesystem Size Used Avail Use% Mounted on
/dev/mapper/centos-root 118G 67G 51G 58% /
devtmpfs 32G 0 32G 0% /dev
tmpfs 32G 0 32G 0% /dev/shm
tmpfs 32G 3.3G 29G 11% /run
tmpfs 32G 0 32G 0% /sys/fs/cgroup
/dev/sda1 492M 205M 287M 42% /boot
/dev/mapper/centos-home 15G 72M 15G 1% /home
/dev/mapper/centos-NagLogs 5.5T 2.7T 2.9T 48% /NagLogs
tmpfs 6.3G 0 6.3G 0% /run/user/0
tmpfs 6.3G 0 6.3G 0% /run/user/1000

df -l

Filesystem 1K-blocks Used Available Use% Mounted on
/dev/mapper/centos-root 122815744 69973168 52842576 57% /
devtmpfs 32872272 0 32872272 0% /dev
tmpfs 32883596 0 32883596 0% /dev/shm
tmpfs 32883596 3401096 29482500 11% /run
tmpfs 32883596 0 32883596 0% /sys/fs/cgroup
/dev/sda1 503040 209664 293376 42% /boot
/dev/mapper/centos-home 15345664 73180 15272484 1% /home
/dev/mapper/centos-NagLogs 5858285568 2794189036 3064096532 48% /NagLogs
tmpfs 6576720 0 6576720 0% /run/user/0
tmpfs 6576720 0 6576720 0% /run/user/1000

PS aux and top captures are attached.

[kyang]

Have you tried increasing the php limit?
https://support.nagios.com/kb/article.php?id=132

Code: Select all

sed -i 's/^memory_limit.*/memory_limit = 256M/g' /etc/php.ini
service httpd restart

Try that and see if it helps, if not let us know.

Could you also post your filters?

[CameronWP]

Thanks for the response! My current php.ini setting is set as:

memory_limit = 512M

My filters are forthcoming, very delayed responsiveness currently.

[kyang]

Could you give us your logstash config?

Code: Select all

/usr/local/nagioslogserver/logstash/etc/conf.d/*

[CameronWP]

Here they are!

[mcapra]

It might also be worth having a look at the Logstash and ElasticSearch logs. They can typically be found here:

Code: Select all

/var/log/logstash/logstash.log
/var/log/elasticsearch/<some_cluster_hash_id>.log

[kyang]

Thanks @mcapra!

[CameronWP]

Thanks!

[kyang]

@CameronWP,

If you could post your output as @mcapra suggested, that would be great!

Code: Select all

/var/log/logstash/logstash.log
/var/log/elasticsearch/<some_cluster_hash_id>.log