multiple indexes per day possible?

This support forum board is for support questions relating to Nagios Log Server, our solution for managing and monitoring critical log data.
Locked
_asp_
Posts: 91
Joined: Mon May 23, 2016 4:30 am

multiple indexes per day possible?

Post by _asp_ »

Hi,

during developement of logstash configuration and grok parsing, sometimes it is necessary for us to delete indexes to input the data again. Especially it is needed if we had some mistakes in type parsing.

Since we have multiple developement streams (developing on multiple logs in parallel) it would be nice if it is possible to create multiple indexes and to tell logstash to put the data into a custom index container. Routing may be of a field which is set during the processing of the message.
Doing so would also enable us to have different retention times for different logs.

How can this be done?

Regards, Andreas
User avatar
hsmith
Agent Smith
Posts: 3539
Joined: Thu Jul 30, 2015 11:09 am
Location: 127.0.0.1
Contact:

Re: multiple indexes per day possible?

Post by hsmith »

Right now we don't have a way to separate what logs go in to which index. This is something that may be coming along as a feature in a major release - but at the moment we use a daily index.
Former Nagios Employee.
me.
paylocity
Posts: 1
Joined: Wed Aug 10, 2016 3:05 pm

Re: multiple indexes per day possible?

Post by paylocity »

Just wanted to chime in on this - my users are clamoring for this exact feature.

+1 on getting this into the next major release, if at all possible!
rkennedy
Posts: 6579
Joined: Mon Oct 05, 2015 11:45 am

Re: multiple indexes per day possible?

Post by rkennedy »

I filed a feature request for this, #9424. I think it would be really useful, not only for deleting, but also for user granularity.
Former Nagios Employee
Locked