Recommended architecture and how to export the filtered data

This support forum board is for support questions relating to Nagios Log Server, our solution for managing and monitoring critical log data.
Locked
skywalker
Posts: 26
Joined: Tue Jan 14, 2014 7:27 pm

Recommended architecture and how to export the filtered data

Post by skywalker »

I'm a partner in Korea.

My customer want to know more Nagios Log Server product. so there are two questions.


First is that how to design big data input Nagios Log Server :


I saw Nagios Log Server 10 instance which is recommended to support maximum redundancy, indexing speed, and query speed.

Do you have a architecture guide to implement the solution like Nagios XI Hardware Requirements document? because my customer want to store 300GB per day and 10TB per month.

Hence, can I Log Server design guide to accept the requirements?


Second is that how to export filtered data on dash-board :

Is it possible to export the filtered/listed information from Nagios Log Server to for example a csv file?


My customer wants to get raw data from filted data on Log Server dashboard.

I tested Nagios Log Server on test machine. but I can't find any other exprort menu or method.

So could you tell me how to get raw data?


My customer information is below.

Company : PIOLINK

Web site : piolink.com

PIOLINK is the biggest network, security solution in Korea.
rkennedy
Posts: 6579
Joined: Mon Oct 05, 2015 11:45 am

Re: Recommended architecture and how to export the filtered

Post by rkennedy »

Do you have a architecture guide to implement the solution like Nagios XI Hardware Requirements document? because my customer want to store 300GB per day and 10TB per month.
We do not, but I'll lay out a bit of the basics for your use case.
- 10 instances @ 64GB ram each should be able to keep ~1TB of logs in open memory (1.5x-2x ram)
- With that said, you'll want to close indexes after 2-3 days, you will only be able to actively search back this far. Keep in mind, you can always go back in time to reopen an already closed index to search through it.
Is it possible to export the filtered/listed information from Nagios Log Server to for example a csv file?

My customer wants to get raw data from filted data on Log Server dashboard.
- There is a feature request in for CSV output. One way to get raw data is by querying the machine directly, for example - curl -XGET "http://localhost:9200/nagioslogserver/_search?size=100"
Former Nagios Employee
Locked