Problem index log every day

This support forum board is for support questions relating to Nagios Log Server, our solution for managing and monitoring critical log data.
abrist
Red Shirt
Posts: 8334
Joined: Thu Nov 15, 2012 1:20 pm

Re: Problem index log every day

Post by abrist »

We will have to revisit this tomorrow when Luke (one of the devs on this thread) is back in the office. Apologies.
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
chris_Espoir
Posts: 19
Joined: Tue Dec 02, 2014 12:43 pm

Re: Problem index log every day

Post by chris_Espoir »

Wait,

I think it's good... I have no problem since 1 day.

Maybe that the index had a problem the day when files (connection.rb & pool.rb) change (2015.01.13)
If tomorrow I still have no problem, I think it's good.

I'll let you know
sreinhardt
-fno-stack-protector
Posts: 4366
Joined: Mon Nov 19, 2012 12:10 pm

Re: Problem index log every day

Post by sreinhardt »

Sounds great, thanks for the update!
Nagios-Plugins maintainer exclusively, unless you have other C language bugs with open-source nagios projects, then I am happy to help! Please pm or use other communication to alert me to issues as I no longer track the forum.
chris_Espoir
Posts: 19
Joined: Tue Dec 02, 2014 12:43 pm

Re: Problem index log every day

Post by chris_Espoir »

Bad news,

Without reboot server during three day (14-15-16 January) no problem, then it come back.

Still the same problem, but there's better. The problem occurs three days after the reboot of the server instead of 24 hours.
abrist
Red Shirt
Posts: 8334
Joined: Thu Nov 15, 2012 1:20 pm

Re: Problem index log every day

Post by abrist »

Have you seen this 3 day interval happen multiple times yet, or just once?
Former Nagios employee
"It is turtles. All. The. Way. Down. . . .and maybe an elephant or two."
VI VI VI - The editor of the Beast!
Come to the Dark Side.
chris_Espoir
Posts: 19
Joined: Tue Dec 02, 2014 12:43 pm

Re: Problem index log every day

Post by chris_Espoir »

abrist wrote:Have you seen this 3 day interval happen multiple times yet, or just once?
Just once for the moment...
User avatar
lgroschen
Posts: 384
Joined: Wed Nov 27, 2013 1:17 pm

Re: Problem index log every day

Post by lgroschen »

Do you find anything in the tail -f /var/log/httpd/error_log now that you made the update? After running that command try reloading the pages a few times to see if it will kick off some errors if it's feeling generous.
/Luke
chris_Espoir
Posts: 19
Joined: Tue Dec 02, 2014 12:43 pm

Re: Problem index log every day

Post by chris_Espoir »


[Sun Jan 18 03:07:03 2015] [notice] Digest: generating secret for digest authentication ...
[Sun Jan 18 03:07:03 2015] [notice] Digest: done
[Sun Jan 18 03:07:03 2015] [notice] Apache/2.2.15 (Unix) DAV/2 PHP/5.3.3 configured -- resuming normal operations
[Sun Jan 18 20:50:18 2015] [notice] caught SIGTERM, shutting down
[Sun Jan 18 20:51:22 2015] [notice] suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)
[Sun Jan 18 20:51:22 2015] [notice] Digest: generating secret for digest authentication ...
[Sun Jan 18 20:51:22 2015] [notice] Digest: done
[Sun Jan 18 20:51:22 2015] [notice] Apache/2.2.15 (Unix) DAV/2 PHP/5.3.3 configured -- resuming normal operations
[Mon Jan 19 16:09:58 2015] [notice] caught SIGTERM, shutting down
[Mon Jan 19 16:10:43 2015] [notice] suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)
[Mon Jan 19 16:10:43 2015] [notice] Digest: generating secret for digest authentication ...
[Mon Jan 19 16:10:43 2015] [notice] Digest: done
[Mon Jan 19 16:10:43 2015] [notice] Apache/2.2.15 (Unix) DAV/2 PHP/5.3.3 configured -- resuming normal operations
[Tue Jan 20 12:13:28 2015] [notice] caught SIGTERM, shutting down
[Tue Jan 20 12:14:33 2015] [notice] suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)
[Tue Jan 20 12:14:33 2015] [notice] Digest: generating secret for digest authentication ...
[Tue Jan 20 12:14:33 2015] [notice] Digest: done
[Tue Jan 20 12:14:33 2015] [notice] Apache/2.2.15 (Unix) DAV/2 PHP/5.3.3 configured -- resuming normal operations
[Sun Jan 25 03:42:03 2015] [notice] SIGHUP received. Attempting to restart
[Sun Jan 25 03:42:03 2015] [notice] Digest: generating secret for digest authentication ...
[Sun Jan 25 03:42:03 2015] [notice] Digest: done
[Sun Jan 25 03:42:03 2015] [notice] Apache/2.2.15 (Unix) DAV/2 PHP/5.3.3 configured -- resuming normal operations
Nothing seems appears :/
scottwilkerson
DevOps Engineer
Posts: 19396
Joined: Tue Nov 15, 2011 3:11 pm
Location: Nagios Enterprises
Contact:

Re: Problem index log every day

Post by scottwilkerson »

To be clear by re-appear are you getting the same error you were before in the logstash.log?

Code: Select all

tail -n 100 /var/log/logstash/logstash.log
Former Nagios employee
Creator:
ahumandesign.com
enneagrams.com
chris_Espoir
Posts: 19
Joined: Tue Dec 02, 2014 12:43 pm

Re: Problem index log every day

Post by chris_Espoir »

scottwilkerson wrote:To be clear by re-appear are you getting the same error you were before in the logstash.log?

Code: Select all

tail -n 100 /var/log/logstash/logstash.log

Yes the line appears again, but much less often than before.
{:timestamp=>"2015-01-26T19:14:40.345000+0100", :message=>"A plugin had an unrecoverable error. Will restart this plugin.\n Plugin: <LogStash::Inputs::Tcp type=>\"eventlog\", host=>\"0.0.0.0\", mode=>\"server\">\n Error: closed stream", :level=>:error}
Locked