Architecture and Sizing

This support forum board is for support questions relating to Nagios Log Server, our solution for managing and monitoring critical log data.
Locked
biswajit.banerjee
Posts: 152
Joined: Fri Dec 08, 2017 10:24 pm

Architecture and Sizing

Post by biswajit.banerjee »

What is recomenetation for Log Server Architecture and Sizing for
40 GB / Day from 3000 Devices .
Kindly Suggest

Thanks
User avatar
cdienger
Support Tech
Posts: 5045
Joined: Tue Feb 07, 2017 11:26 am

Re: Architecture and Sizing

Post by cdienger »

I would recommend two NLS instances to have the redundancy. NLS stores a copy of the data whether you have multiple nodes in a cluster or not so plan to use twice the disk space if the 'cluster' only as a single node.

4 core CPU and 32GB of memory total are a good place to start(or dual core and 16GB per node if there are multiple nodes in the cluster).
As of May 25th, 2018, all communications with Nagios Enterprises and its employees are covered under our new Privacy Policy.
biswajit.banerjee
Posts: 152
Joined: Fri Dec 08, 2017 10:24 pm

Re: Architecture and Sizing

Post by biswajit.banerjee »

Thanks for the Input .
So if specs are
- 40 GB Per Day
- 3000 Devices for Logging
- 3 Month Online Logs
- 1 Year Log Retention
What Would be your Ideal Server and Storage Sizing for the Same keeping in view the environment be redundant with cluster

TIA
User avatar
cdienger
Support Tech
Posts: 5045
Joined: Tue Feb 07, 2017 11:26 am

Re: Architecture and Sizing

Post by cdienger »

Rounding up to give us some wiggle room, I'd say 4TB of space on each node to store the last 3 months and 11TB of space on a remote share to hold archived data for the other ~270 days. Depending on how much parsing/filtering of the logs you plan to do this may fluctuate - for example, are you adding geo location, DNS info, or parsing out data from the logs to store into separate fields? Per event this may require little extra space but over billions of events this could add up. I would recommend setting up a test machine if possible and send a typical day's worth of logs at it to get an idea of what to expect for index sizes.
As of May 25th, 2018, all communications with Nagios Enterprises and its employees are covered under our new Privacy Policy.
biswajit.banerjee
Posts: 152
Joined: Fri Dec 08, 2017 10:24 pm

Re: Architecture and Sizing

Post by biswajit.banerjee »

Thanks For your Suggestion
User avatar
mbellerue
Posts: 1403
Joined: Fri Jul 12, 2019 11:10 am

Re: Architecture and Sizing

Post by mbellerue »

Is there anything else we can do to assist with regards to sizing, or should we close this thread?
As of May 25th, 2018, all communications with Nagios Enterprises and its employees are covered under our new Privacy Policy.

Be sure to check out our Knowledgebase for helpful articles and solutions!
biswajit.banerjee
Posts: 152
Joined: Fri Dec 08, 2017 10:24 pm

Re: Architecture and Sizing

Post by biswajit.banerjee »

Please Close
Thanks
Locked