How to track db data of some other server2 from server1

[Monica7]

Hi ,

I am able to get syslog and apache logs of server1 and server2 in server1 nagios log server front end.

And I want to get the data which are available in server2 database (drupal application) and have to display this in server1 nagios logserver front end.

for that I have configured drupal_db log in input configuration to get the data from server2.

As per logstash logs in server1 , records are fetching from server2 database. But it is not showing up in nagioslogserver.

Whether any settings has to be done?Please advise

[Box293]

Does this KB article help diagnose the source of your issue:

https://support.nagios.com/kb/article.php?id=38

[Monica7]

No this link is for denoting the logs are not coming.

But I am able to get syslog and apache logs of the server2 in server1.Issue is with data which are stored in the database of server2.As per the logs, Logstash is collecting those data from server2 to server1 . But not sure why elastic search and kibana is not indexing and displaying the logs respectively.

whether any configuration has to be done in elastic search config file in order to achieve this. I am using drupal_dblog input configuration to get the data from the database.

And one more thing. Is there any way to find out whether logstash has sent my database data to elastic search? Because indices which are created are not in readable format.So I couldn't able to find out whether database data is indexed in elasticsearch.Need your help on this.

[rkennedy]

No this link is for denoting the logs are not coming.

But I am able to get syslog and apache logs of the server2 in server1.Issue is with data which are stored in the database of server2.As per the logs, Logstash is collecting those data from server2 to server1 . But not sure why elastic search and kibana is not indexing and displaying the logs respectively.

whether any configuration has to be done in elastic search config file in order to achieve this. I am using drupal_dblog input configuration to get the data from the database.

And one more thing. Is there any way to find out whether logstash has sent my database data to elastic search? Because indices which are created are not in readable format.So I couldn't able to find out whether database data is indexed in elasticsearch.Need your help on this.

As per logstash logs in server1 , records are fetching from server2 database. But it is not showing up in nagioslogserver.

The error your mentioning is indeed that the logs are not coming in. We need to troubleshoot this, and the KB article linked above has a lot of great information for figuring out what's going on. Can you please show us some of the output from the testing in the link @Box293 mentioned above? This will help us to see what's going on.

[Monica7]

I am not getting any error while searching for pattern "watchdog" in dashboard. But i am not getting any records for search pattern "watchdog" too.

I will explain the scenario which I want to achieve.

Objective:
------------
I am having two servers Server1 and Server2. Nagios log server is running in Server1. Drupal application is running in Server2. The drupal application logs will be stored in one database table called watchdog in Server2.

I want to track the data which is available in Server2 MySQL database table watchdog from Server1 Nagios logserver web interface.

I have explored in google and found out that we are having one input configuration called drupal_dblog in logstash which will take the data from the drupal database .

https://www.elastic.co/guide/en/logstas ... dblog.html

for example if i am having 10 records in watchdog table (which were already processed) and the max record id(10) will be stored in another table called variable. when 5 new records come into that watchdog table via drupal application, it will take the records which is greater than max record id(available in variable table) and process the latest 5 records and show .every time max record id will be updated in variable table after processing. so in this case 15 will be updated after processing.

I have written configuration for that in inputs conf file. now it is picking the records and processing . as a result max record id of watchdog table is updated in variable table after processing. But i am not able to see the table data in nagios log server web interface.

Moreover i am not seeing the type watchdog in documents also. Could you please help me on this.

i have installed plugins logstash-input-drupal_dblog . Whether any other thing is required to be installed. Please advise

[rkennedy]

Can you show us your input you're using in conjunction with drupal_dblog?