These are from the new EC2 image instance I installed, verified working from the image, and then ran the upgrade process.
Code: Select all
[~]$ cat /etc/*release*
CentOS release 6.7 (Final)
CentOS release 6.7 (Final)
CentOS release 6.7 (Final)
cpe:/o:centos:linux:6:GA
Code: Select all
[~]$ cat /usr/local/nagioslogserver/elasticsearch/config/*.yml
##################### Elasticsearch Configuration Example #####################
# This file contains an overview of various configuration settings,
# targeted at operations staff. Application developers should
# consult the guide at <http://elasticsearch.org/guide>.
#
# The installation procedure is covered at
# <http://elasticsearch.org/guide/en/elasticsearch/reference/current/setup.html>.
#
# Elasticsearch comes with reasonable defaults for most settings,
# so you can try it out without bothering with configuration.
#
# Most of the time, these defaults are just fine for running a production
# cluster. If you're fine-tuning your cluster, or wondering about the
# effect of certain configuration option, please _do ask_ on the
# mailing list or IRC channel [http://elasticsearch.org/community].
# Any element in the configuration can be replaced with environment variables
# by placing them in ${...} notation. For example:
#
# node.rack: ${RACK_ENV_VAR}
# For information on supported formats and syntax for the config file, see
# <http://elasticsearch.org/guide/en/elasticsearch/reference/current/setup-configuration.html>
################################### Cluster ###################################
# Cluster name identifies your cluster for auto-discovery. If you're running
# multiple clusters on the same network, make sure you're using unique names.
#
cluster.name: nagios_elasticsearch
#################################### Node #####################################
# Node names are generated dynamically on startup, so you're relieved
# from configuring them manually. You can tie this node to a specific name:
#
# node.name: "Franz Kafka"
# Every node can be configured to allow or deny being eligible as the master,
# and to allow or deny to store the data.
#
# Allow this node to be eligible as a master node (enabled by default):
#
# node.master: true
#
# Allow this node to store data (enabled by default):
#
# node.data: true
# You can exploit these settings to design advanced cluster topologies.
#
# 1. You want this node to never become a master node, only to hold data.
# This will be the "workhorse" of your cluster.
#
# node.master: false
# node.data: true
#
# 2. You want this node to only serve as a master: to not store any data and
# to have free resources. This will be the "coordinator" of your cluster.
#
# node.master: true
# node.data: false
#
# 3. You want this node to be neither master nor data node, but
# to act as a "search load balancer" (fetching data from nodes,
# aggregating results, etc.)
#
# node.master: false
# node.data: false
# Use the Cluster Health API [http://localhost:9200/_cluster/health], the
# Node Info API [http://localhost:9200/_nodes] or GUI tools
# such as <http://www.elasticsearch.org/overview/marvel/>,
# <http://github.com/karmi/elasticsearch-paramedic>,
# <http://github.com/lukas-vlcek/bigdesk> and
# <http://mobz.github.com/elasticsearch-head> to inspect the cluster state.
Code: Select all
[~]$ cat /etc/hosts
127.0.0.1 localhost.localdomain localhost
::1 localhost6.localdomain6 localhost6
[~]$ cat /etc/sysconfig/elasticsearch /etc/sysconfig/logstash
# Directory where the Elasticsearch binary distribution resides
APP_DIR="/usr/local/nagioslogserver"
ES_HOME="$APP_DIR/elasticsearch"
# Heap Size (defaults to 256m min, 1g max)
# Nagios Log Server Default to 0.5 physical Memory
ES_HEAP_SIZE=$(expr $(free -m|awk '/^Mem:/{print $2}') / 2 )m
# Heap new generation
#ES_HEAP_NEWSIZE=
# max direct memory
#ES_DIRECT_SIZE=
# Additional Java OPTS
#ES_JAVA_OPTS=
# Maximum number of open files
MAX_OPEN_FILES=65535
# Maximum amount of locked memory
MAX_LOCKED_MEMORY=unlimited
# Maximum number of VMA (Virtual Memory Areas) a process can own
MAX_MAP_COUNT=262144
# Elasticsearch log directory
LOG_DIR=/var/log/elasticsearch
# Elasticsearch data directory
DATA_DIR="$ES_HOME/data"
# Elasticsearch work directory
WORK_DIR="$APP_DIR/tmp/elasticsearch"
# Elasticsearch conf directory
CONF_DIR="$ES_HOME/config"
# Elasticsearch configuration file (elasticsearch.yml)
CONF_FILE="$ES_HOME/config/elasticsearch.yml"
# User to run as, change this to a specific elasticsearch user if possible
# Also make sure, this user can write into the log directories in case you change them
# This setting only works for the init script, but has to be configured separately for systemd startup
ES_USER=nagios
ES_GROUP=nagios
# Configure restart on package upgrade (true, every other setting will lead to not restarting)
#RESTART_ON_UPGRADE=true
if [ "x$1" == "xstart" -o "x$1" == "xrestart" -o "x$1" == "xreload" -o "x$1" == "xforce-reload" ];then
GET_ES_CONFIG_MESSAGE="$( php $APP_DIR/scripts/get_es_config.php )"
GET_ES_CONFIG_RETURN=$?
if [ "$GET_ES_CONFIG_RETURN" != "0" ]; then
echo $GET_ES_CONFIG_MESSAGE
exit 1
else
ES_JAVA_OPTS="$GET_ES_CONFIG_MESSAGE"
fi
fi
###############################
# Default settings for logstash
###############################
# Override Java location
#JAVACMD=/usr/bin/java
# Set a home directory
APP_DIR=/usr/local/nagioslogserver
LS_HOME="$APP_DIR/logstash"
# set ES_CLUSTER
ES_CLUSTER=$(cat $APP_DIR/var/cluster_uuid)
# Arguments to pass to java
#LS_HEAP_SIZE="256m"
LS_JAVA_OPTS="-Djava.io.tmpdir=$APP_DIR/tmp"
# Logstash filter worker threads
#LS_WORKER_THREADS=1
# pidfiles aren't used for upstart; this is for sysv users.
#LS_PIDFILE=/var/run/logstash.pid
# user id to be invoked as; for upstart: edit /etc/init/logstash.conf
LS_USER=nagios
LS_GROUP=nagios
# logstash logging
#LS_LOG_FILE=/var/log/logstash/logstash.log
#LS_USE_GC_LOGGING="true"
# logstash configuration directory
LS_CONF_DIR="$LS_HOME/etc/conf.d"
# Open file limit; cannot be overridden in upstart
#LS_OPEN_FILES=2048
# Nice level
#LS_NICE=0
# Increate Filter workers to 4 threads
LS_OPTS=" -w 4"
if [ "x$1" == "xstart" -o "x$1" == "xrestart" -o "x$1" == "xreload" ];then
GET_LOGSTASH_CONFIG_MESSAGE=$( php /usr/local/nagioslogserver/scripts/get_logstash_config.php )
GET_LOGSTASH_CONFIG_RETURN=$?
if [ "$GET_LOGSTASH_CONFIG_RETURN" != "0" ]; then
echo $GET_LOGSTASH_CONFIG_MESSAGE
exit 1
fi
Code: Select all
[~]$ tail -n200 /var/log/elasticsearch/*.log
==> /var/log/elasticsearch/e5484b24-18a8-419a-bfea-a7de2bb2defe_index_indexing_slowlog.log <==
==> /var/log/elasticsearch/e5484b24-18a8-419a-bfea-a7de2bb2defe_index_search_slowlog.log <==
==> /var/log/elasticsearch/e5484b24-18a8-419a-bfea-a7de2bb2defe.log <==
[2016-01-14 14:11:46,375][WARN ][common.jna ] Unable to lock JVM memory (ENOMEM). This can result in part of the JVM being swapped out. Increase RLIMIT_MEMLOCK (ulimit).
[2016-01-14 14:11:47,272][INFO ][node ] [358bc8b4-69db-4f31-8311-70ea54fffe63] version[1.3.2], pid[1622], build[dee175d/2014-08-13T14:29:30Z]
[2016-01-14 14:11:47,273][INFO ][node ] [358bc8b4-69db-4f31-8311-70ea54fffe63] initializing ...
[2016-01-14 14:11:48,592][INFO ][plugins ] [358bc8b4-69db-4f31-8311-70ea54fffe63] loaded [knapsack-1.3.2.0-d5501ef], sites []
[2016-01-14 14:12:57,095][WARN ][common.jna ] Unable to lock JVM memory (ENOMEM). This can result in part of the JVM being swapped out. Increase RLIMIT_MEMLOCK (ulimit).
[2016-01-14 14:12:57,450][INFO ][node ] [358bc8b4-69db-4f31-8311-70ea54fffe63] version[1.3.2], pid[848], build[dee175d/2014-08-13T14:29:30Z]
[2016-01-14 14:12:57,450][INFO ][node ] [358bc8b4-69db-4f31-8311-70ea54fffe63] initializing ...
[2016-01-14 14:12:57,499][INFO ][plugins ] [358bc8b4-69db-4f31-8311-70ea54fffe63] loaded [knapsack-1.3.2.0-d5501ef], sites []
[2016-01-14 14:13:03,841][INFO ][node ] [358bc8b4-69db-4f31-8311-70ea54fffe63] initialized
[2016-01-14 14:13:03,841][INFO ][node ] [358bc8b4-69db-4f31-8311-70ea54fffe63] starting ...
[2016-01-14 14:13:04,008][INFO ][transport ] [358bc8b4-69db-4f31-8311-70ea54fffe63] bound_address {inet[/0:0:0:0:0:0:0:0:9300]}, publish_address {inet[/172.31.15.220:9300]}
[2016-01-14 14:13:04,016][INFO ][discovery ] [358bc8b4-69db-4f31-8311-70ea54fffe63] e5484b24-18a8-419a-bfea-a7de2bb2defe/mLE1LMNmTEKwBANNIMQbUw
[2016-01-14 14:13:07,074][INFO ][cluster.service ] [358bc8b4-69db-4f31-8311-70ea54fffe63] new_master [358bc8b4-69db-4f31-8311-70ea54fffe63][mLE1LMNmTEKwBANNIMQbUw][ip-172-31-15-220.us-west-2.compute.internal][inet[/172.31.15.220:9300]]{max_local_storage_nodes=1}, reason: zen-disco-join (elected_as_master)
[2016-01-14 14:13:07,112][INFO ][http ] [358bc8b4-69db-4f31-8311-70ea54fffe63] bound_address {inet[/127.0.0.1:9200]}, publish_address {inet[localhost/127.0.0.1:9200]}
[2016-01-14 14:13:07,113][INFO ][node ] [358bc8b4-69db-4f31-8311-70ea54fffe63] started
[2016-01-14 14:13:07,146][INFO ][gateway ] [358bc8b4-69db-4f31-8311-70ea54fffe63] recovered [0] indices into cluster_state
[2016-01-14 14:16:51,190][INFO ][cluster.metadata ] [358bc8b4-69db-4f31-8311-70ea54fffe63] [nagioslogserver] creating index, cause [auto(index api)], shards [1]/[1], mappings [cf_option, node, reactor_server, snapshot, alert, _default_, query, commands, snmp_reactor, nrdp_server, user]
[2016-01-14 14:16:52,101][INFO ][cluster.metadata ] [358bc8b4-69db-4f31-8311-70ea54fffe63] [nagioslogserver_log] creating index, cause [auto(index api)], shards [5]/[1], mappings []
[2016-01-14 14:16:52,594][INFO ][cluster.metadata ] [358bc8b4-69db-4f31-8311-70ea54fffe63] [nagioslogserver_log] update_mapping [SECURITY] (dynamic)
[2016-01-14 14:16:52,953][INFO ][cluster.metadata ] [358bc8b4-69db-4f31-8311-70ea54fffe63] [nagioslogserver] update_mapping [node] (dynamic)
[2016-01-14 14:17:02,612][INFO ][cluster.metadata ] [358bc8b4-69db-4f31-8311-70ea54fffe63] [nagioslogserver_log] update_mapping [POLLER] (dynamic)
[2016-01-14 14:17:03,107][INFO ][cluster.metadata ] [358bc8b4-69db-4f31-8311-70ea54fffe63] [nagioslogserver_log] update_mapping [JOBS] (dynamic)
[2016-01-14 14:17:18,668][INFO ][cluster.metadata ] [358bc8b4-69db-4f31-8311-70ea54fffe63] [kibana-int] creating index, cause [auto(index api)], shards [5]/[1], mappings []
[2016-01-14 14:17:18,991][INFO ][cluster.metadata ] [358bc8b4-69db-4f31-8311-70ea54fffe63] [kibana-int] update_mapping [dashboard] (dynamic)
[2016-01-14 14:18:08,133][INFO ][cluster.metadata ] [358bc8b4-69db-4f31-8311-70ea54fffe63] [logstash-2016.01.14] creating index, cause [auto(bulk api)], shards [5]/[1], mappings [_default_]
[2016-01-14 14:18:08,480][INFO ][cluster.metadata ] [358bc8b4-69db-4f31-8311-70ea54fffe63] [logstash-2016.01.14] update_mapping [syslog] (dynamic)
[2016-01-14 14:18:12,431][INFO ][cluster.metadata ] [358bc8b4-69db-4f31-8311-70ea54fffe63] [nagioslogserver_log] update_mapping [SECURITY] (dynamic)
[2016-01-14 14:21:45,454][INFO ][node ] [358bc8b4-69db-4f31-8311-70ea54fffe63] stopping ...
[2016-01-14 14:21:45,774][INFO ][node ] [358bc8b4-69db-4f31-8311-70ea54fffe63] stopped
[2016-01-14 14:21:45,774][INFO ][node ] [358bc8b4-69db-4f31-8311-70ea54fffe63] closing ...
[2016-01-14 14:21:45,801][INFO ][node ] [358bc8b4-69db-4f31-8311-70ea54fffe63] closed
Code: Select all
[~]$ sestatus
SELinux status: disabled