cluster status and actual size

This support forum board is for support questions relating to Nagios Log Server, our solution for managing and monitoring critical log data.
Locked
cdcsysadmin
Posts: 55
Joined: Tue Dec 04, 2018 9:52 pm

cluster status and actual size

Post by cdcsysadmin »

At the Cluster status page , i got the following info
1,768,892,710 Documents
1.3TB Primary Size
1.3TB Total Size
1 Data Instances
332 Total Shards
34 Indices

but my linux system
total used free
/dev/mapper/centos-root 6.9T 6.5T 123G 99% /

is it normal or i have to archive the log to clean up space?

Thanks
User avatar
cdienger
Support Tech
Posts: 5045
Joined: Tue Feb 07, 2017 11:26 am

Re: cluster status and actual size

Post by cdienger »

Closed indices will take up space on the hard drive but will not be counted on the Cluster Status page. I would recommend setting up a repo to store old data if you need to save it and configuring NLS to delete older indices to free up space on the local drive.

The delete option is found under Admin > System > Snapshots & Maintenance > Maintenance Settings > Delete indexes older than.

Setting up a repo is covered in:

https://assets.nagios.com/downloads/nag ... enance.pdf
https://assets.nagios.com/downloads/nag ... ations.pdf
As of May 25th, 2018, all communications with Nagios Enterprises and its employees are covered under our new Privacy Policy.
cdcsysadmin
Posts: 55
Joined: Tue Dec 04, 2018 9:52 pm

Re: cluster status and actual size

Post by cdcsysadmin »

now the indices folder take up 6.6TB and continue to grow

can I gzip it after put it in snapshot respository?

or just gzip logstash-2019-xxx folder and delete the original one?
User avatar
cdienger
Support Tech
Posts: 5045
Joined: Tue Feb 07, 2017 11:26 am

Re: cluster status and actual size

Post by cdienger »

The deletion process should happen automatically. You can also force it from the command line by running:

Code: Select all

curator delete indices --older-than DAYS --time-unit days --timestring %Y.%m.%d
Replacing DAYS with a number.
As of May 25th, 2018, all communications with Nagios Enterprises and its employees are covered under our new Privacy Policy.
Locked