Upgraded to 2014R1.0: 'Network Outages' Unable to parse XML

[atuttle]

tail -50 /var/log/messages

Code: Select all

Jun 13 08:35:30 nagios-01 nagios: ndomod registered for adaptive contact data'
Jun 13 08:35:30 nagios-01 nagios: Event broker module '/usr/local/nagios/bin/ndomod.o' initialized successfully.
Jun 13 08:35:30 nagios-01 nagios: Error: Module loading failed. Aborting.
Jun 13 08:35:52 nagios-01 nagios: Nagios 4.0.6 starting... (PID=4505)
Jun 13 08:35:52 nagios-01 nagios: Local time is Fri Jun 13 08:35:52 PDT 2014
Jun 13 08:35:52 nagios-01 nagios: LOG VERSION: 2.0
Jun 13 08:35:52 nagios-01 nagios: qh: Socket '/usr/local/nagios/var/rw/nagios.qh' successfully initialized
Jun 13 08:35:52 nagios-01 nagios: qh: core query handler registered
Jun 13 08:35:52 nagios-01 nagios: nerd: Channel hostchecks registered successfully
Jun 13 08:35:52 nagios-01 nagios: nerd: Channel servicechecks registered successfully
Jun 13 08:35:52 nagios-01 nagios: nerd: Channel opathchecks registered successfully
Jun 13 08:35:52 nagios-01 nagios: nerd: Fully initialized and ready to rock!
Jun 13 08:35:52 nagios-01 nagios: wproc: Successfully registered manager as @wproc with query handler
Jun 13 08:35:52 nagios-01 nagios: wproc: Registry request: name=Core Worker 4508;pid=4508
Jun 13 08:35:52 nagios-01 nagios: wproc: Registry request: name=Core Worker 4509;pid=4509
Jun 13 08:35:52 nagios-01 nagios: wproc: Registry request: name=Core Worker 4512;pid=4512
Jun 13 08:35:52 nagios-01 nagios: wproc: Registry request: name=Core Worker 4511;pid=4511
Jun 13 08:35:52 nagios-01 nagios: wproc: Registry request: name=Core Worker 4510;pid=4510
Jun 13 08:35:52 nagios-01 nagios: wproc: Registry request: name=Core Worker 4513;pid=4513
Jun 13 08:35:52 nagios-01 nagios: Error: Module '/usr/local/pnp4nagios/lib/npcdmod.o' is using an old or unspecified version of the event broker API.  Module will be unloaded.
Jun 13 08:35:52 nagios-01 nagios: Event broker module '/usr/local/pnp4nagios/lib/npcdmod.o' deinitialized successfully.
Jun 13 08:35:52 nagios-01 nagios: Error: Failed to load module '/usr/local/pnp4nagios/lib/npcdmod.o'.
Jun 13 08:35:52 nagios-01 nagios: ndomod: NDOMOD 2.0.0 (02-28-2014) Copyright (c) 2009 Nagios Core Development Team and Community Contributors
Jun 13 08:35:52 nagios-01 nagios: ndomod: Successfully connected to data sink.  0 queued items to flush.
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for process data
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for log data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for system command data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for event handler data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for notification data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for comment data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for downtime data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for flapping data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for program status data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for host status data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for service status data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for adaptive program data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for adaptive host data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for adaptive service data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for external command data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for aggregated status data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for retention data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for contact data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for contact notification data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for acknowledgement data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for state change data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for contact status data'
Jun 13 08:35:52 nagios-01 nagios: ndomod registered for adaptive contact data'
Jun 13 08:35:52 nagios-01 nagios: Event broker module '/usr/local/nagios/bin/ndomod.o' initialized successfully.
Jun 13 08:35:52 nagios-01 nagios: Error: Module loading failed. Aborting.
Jun 13 08:36:09 nagios-01 automount[18834]: 4 remaining in /-
$
---------------------------------------

tail -50 /usr/local/nagios/var/nagios.log

Code: Select all

[1402673730] ndomod registered for contact status data'
[1402673730] ndomod registered for adaptive contact data'
[1402673730] Event broker module '/usr/local/nagios/bin/ndomod.o' initialized successfully.
[1402673730] Error: Module loading failed. Aborting.
[1402673752] Nagios 4.0.6 starting... (PID=4505)
[1402673752] Local time is Fri Jun 13 08:35:52 PDT 2014
[1402673752] LOG VERSION: 2.0
[1402673752] qh: Socket '/usr/local/nagios/var/rw/nagios.qh' successfully initialized
[1402673752] qh: core query handler registered
[1402673752] nerd: Channel hostchecks registered successfully
[1402673752] nerd: Channel servicechecks registered successfully
[1402673752] nerd: Channel opathchecks registered successfully
[1402673752] nerd: Fully initialized and ready to rock!
[1402673752] wproc: Successfully registered manager as @wproc with query handler
[1402673752] wproc: Registry request: name=Core Worker 4508;pid=4508
[1402673752] wproc: Registry request: name=Core Worker 4509;pid=4509
[1402673752] wproc: Registry request: name=Core Worker 4512;pid=4512
[1402673752] wproc: Registry request: name=Core Worker 4511;pid=4511
[1402673752] wproc: Registry request: name=Core Worker 4510;pid=4510
[1402673752] wproc: Registry request: name=Core Worker 4513;pid=4513
[1402673752] Error: Module '/usr/local/pnp4nagios/lib/npcdmod.o' is using an old or unspecified version of the event broker API.  Module will be unloaded.
[1402673752] Event broker module '/usr/local/pnp4nagios/lib/npcdmod.o' deinitialized successfully.
[1402673752] Error: Failed to load module '/usr/local/pnp4nagios/lib/npcdmod.o'.
[1402673752] ndomod: NDOMOD 2.0.0 (02-28-2014) Copyright (c) 2009 Nagios Core Development Team and Community Contributors
[1402673752] ndomod: Successfully connected to data sink.  0 queued items to flush.
[1402673752] ndomod registered for process data
[1402673752] ndomod registered for log data'
[1402673752] ndomod registered for system command data'
[1402673752] ndomod registered for event handler data'
[1402673752] ndomod registered for notification data'
[1402673752] ndomod registered for comment data'
[1402673752] ndomod registered for downtime data'
[1402673752] ndomod registered for flapping data'
[1402673752] ndomod registered for program status data'
[1402673752] ndomod registered for host status data'
[1402673752] ndomod registered for service status data'
[1402673752] ndomod registered for adaptive program data'
[1402673752] ndomod registered for adaptive host data'
[1402673752] ndomod registered for adaptive service data'
[1402673752] ndomod registered for external command data'
[1402673752] ndomod registered for aggregated status data'
[1402673752] ndomod registered for retention data'
[1402673752] ndomod registered for contact data'
[1402673752] ndomod registered for contact notification data'
[1402673752] ndomod registered for acknowledgement data'
[1402673752] ndomod registered for state change data'
[1402673752] ndomod registered for contact status data'
[1402673752] ndomod registered for adaptive contact data'
[1402673752] Event broker module '/usr/local/nagios/bin/ndomod.o' initialized successfully.
[1402673752] Error: Module loading failed. Aborting.
$

[lmiltchev]

Can you post the nagios.cfg file? Also, run the Write Config Tool, and show us the output (CCM->Tools->Write Config Files->Write->Verify).

[atuttle]

nagios.cfg:

Code: Select all

-----------------
# MODIFIED
[email protected]
admin_pager=root@localhost
translate_passive_host_checks=1
log_event_handlers=0
use_large_installation_tweaks=1
enable_environment_macros=0


# NDOUtils module
broker_module=/usr/local/nagios/bin/ndomod.o config_file=/usr/local/nagios/etc/ndomod.cfg


# PNP settings - bulk mode with NCPD
process_performance_data=1
# service performance data
service_perfdata_file=/usr/local/nagios/var/service-perfdata
service_perfdata_file_template=DATATYPE::SERVICEPERFDATA\tTIMET::$TIMET$\tHOSTNAME::$HOSTNAME$\tSERVICEDESC::$SERVICEDESC$\tSERVICEPERFDATA::$SERVICEPERFDATA$\tSERVICECHECKCOMMAND::$SERVICECHECKCOMMAND$\tHOSTSTATE::$HOSTSTATE$\tHOSTSTATETYPE::$HOSTSTATETYPE$\tSERVICESTATE::$SERVICESTATE$\tSERVICESTATETYPE::$SERVICESTATETYPE$\tSERVICEOUTPUT::$SERVICEOUTPUT$
service_perfdata_file_mode=a
service_perfdata_file_processing_interval=15
service_perfdata_file_processing_command=process-service-perfdata-file-bulk
# host performance data
host_perfdata_file=/usr/local/nagios/var/host-perfdata
host_perfdata_file_template=DATATYPE::HOSTPERFDATA\tTIMET::$TIMET$\tHOSTNAME::$HOSTNAME$\tHOSTPERFDATA::$HOSTPERFDATA$\tHOSTCHECKCOMMAND::$HOSTCHECKCOMMAND$\tHOSTSTATE::$HOSTSTATE$\tHOSTSTATETYPE::$HOSTSTATETYPE$\tHOSTOUTPUT::$HOSTOUTPUT$
host_perfdata_file_mode=a
host_perfdata_file_processing_interval=15
host_perfdata_file_processing_command=process-host-perfdata-file-bulk


# OBJECTS - UNMODIFIED
#cfg_file=/usr/local/nagios/etc/objects/commands.cfg
#cfg_file=/usr/local/nagios/etc/objects/contacts.cfg
#cfg_file=/usr/local/nagios/etc/objects/localhost.cfg
#cfg_file=/usr/local/nagios/etc/objects/templates.cfg
#cfg_file=/usr/local/nagios/etc/objects/timeperiods.cfg


# STATIC OBJECT DEFINITIONS (THESE DON'T GET EXPORTED/IMPORTED BY NAGIOSQL)
cfg_dir=/usr/local/nagios/etc/static

# OBJECTS EXPORTED FROM NAGIOSQL
cfg_file=/usr/local/nagios/etc/contacttemplates.cfg
cfg_file=/usr/local/nagios/etc/contactgroups.cfg
cfg_file=/usr/local/nagios/etc/contacts.cfg
cfg_file=/usr/local/nagios/etc/timeperiods.cfg
cfg_file=/usr/local/nagios/etc/commands.cfg
cfg_file=/usr/local/nagios/etc/hostgroups.cfg
cfg_file=/usr/local/nagios/etc/servicegroups.cfg
cfg_file=/usr/local/nagios/etc/hosttemplates.cfg
cfg_file=/usr/local/nagios/etc/servicetemplates.cfg
cfg_file=/usr/local/nagios/etc/servicedependencies.cfg
cfg_file=/usr/local/nagios/etc/serviceescalations.cfg
cfg_file=/usr/local/nagios/etc/hostdependencies.cfg
cfg_file=/usr/local/nagios/etc/hostescalations.cfg
cfg_file=/usr/local/nagios/etc/hostextinfo.cfg
cfg_file=/usr/local/nagios/etc/serviceextinfo.cfg
cfg_dir=/usr/local/nagios/etc/hosts
cfg_dir=/usr/local/nagios/etc/services

# GLOBAL EVENT HANDLERS
global_host_event_handler=xi_host_event_handler
global_service_event_handler=xi_service_event_handler



# UNMODIFIED
accept_passive_host_checks=1
accept_passive_service_checks=1
additional_freshness_latency=15
auto_reschedule_checks=0
auto_rescheduling_interval=30
auto_rescheduling_window=180
bare_update_check=0
cached_host_check_horizon=15
cached_service_check_horizon=15
check_external_commands=1
check_for_orphaned_hosts=1
check_for_orphaned_services=1
check_for_updates=1
check_host_freshness=0
check_result_path=/usr/local/nagios/var/spool/checkresults
check_result_reaper_frequency=10
check_service_freshness=1
command_check_interval=-1
command_file=/usr/local/nagios/var/rw/nagios.cmd
daemon_dumps_core=0
date_format=us
debug_file=/usr/local/nagios/var/nagios.debug
debug_level=0
debug_verbosity=1
enable_embedded_perl=1
enable_event_handlers=1
enable_flap_detection=1
enable_notifications=1
enable_predictive_host_dependency_checks=1
enable_predictive_service_dependency_checks=1
event_broker_options=-1
event_handler_timeout=30
execute_host_checks=1
execute_service_checks=1
external_command_buffer_slots=4096
high_host_flap_threshold=20.0
high_service_flap_threshold=20.0
host_check_timeout=30
host_freshness_check_interval=60
host_inter_check_delay_method=s
illegal_macro_output_chars=`~$&|'"<>
illegal_object_name_chars=`~!$%^&*|'"<>?,()=
interval_length=60
lock_file=/usr/local/nagios/var/nagios.lock
log_archive_path=/usr/local/nagios/var/archives
log_external_commands=0
log_file=/usr/local/nagios/var/nagios.log
log_host_retries=1
log_initial_states=0
log_notifications=1
log_passive_checks=0
log_rotation_method=d
log_service_retries=1
low_host_flap_threshold=5.0
low_service_flap_threshold=5.0
max_check_result_file_age=3600
max_check_result_reaper_time=30
max_concurrent_checks=0
max_debug_file_size=1000000
max_host_check_spread=30
max_service_check_spread=30
nagios_group=nagios
nagios_user=nagios
notification_timeout=30
object_cache_file=/usr/local/nagios/var/objects.cache
obsess_over_hosts=0
obsess_over_services=0
ocsp_timeout=5
p1_file=/usr/local/nagios/bin/p1.pl
passive_host_checks_are_soft=0
perfdata_timeout=5
precached_object_file=/usr/local/nagios/var/objects.precache
resource_file=/usr/local/nagios/etc/resource.cfg
retained_contact_host_attribute_mask=0
retained_contact_service_attribute_mask=0
retained_host_attribute_mask=0
retained_process_host_attribute_mask=0
retained_process_service_attribute_mask=0
retained_service_attribute_mask=0
retain_state_information=1
retention_update_interval=60
service_check_timeout=60
service_freshness_check_interval=60
service_inter_check_delay_method=s
service_interleave_factor=s
sleep_time=0.25
soft_state_dependencies=0
state_retention_file=/usr/local/nagios/var/retention.dat
status_file=/usr/local/nagios/var/status.dat
status_update_interval=10
temp_file=/usr/local/nagios/var/nagios.tmp
temp_path=/tmp
use_aggressive_host_checking=0
use_embedded_perl_implicitly=1
use_regexp_matching=0
use_retained_program_state=1
use_retained_scheduling_info=1
use_syslog=1
broker_module=/usr/local/pnp4nagios/lib/npcdmod.o config_file=/usr/local/pnp4nagios/etc/npcd.cfg

[sreinhardt]

At the end of your config, you have:

Code: Select all

broker_module=/usr/local/pnp4nagios/lib/npcdmod.o config_file=/usr/local/pnp4nagios/etc/npcd.cfg

This is not standard on an XI system. Have you recompiled pnp4nagios at some point? Regardless I would highly suggest removing that and then post the output of a write and verify from the CCM as advised above.

[atuttle]

Config tools/Write/Verify
--------------------------------

Code: Select all

Logged in as: atuttle Logout
Write Database Configs To File

Use this tool to manually write Nagios object configurations to physical configuration files.
Write Configs To File

Verify Configuration

Restart Nagios


Nagios Core 3.5.0
Copyright (c) 2009-2011 Nagios Core Development Team and Community Contributors
Copyright (c) 1999-2009 Ethan Galstad
Last Modified: 03-15-2013
License: GPL

Website: http://www.nagios.org
Reading configuration data...
Read main config file okay...
Processing object config directory '/usr/local/nagios/etc/static'...
Processing object config file '/usr/local/nagios/etc/static/xitemplates.cfg'...
Processing object config file '/usr/local/nagios/etc/static/xitest.cfg'...
Processing object config file '/usr/local/nagios/etc/static/xiobjects.cfg'...
Processing object config file '/usr/local/nagios/etc/contacttemplates.cfg'...
Processing object config file '/usr/local/nagios/etc/contactgroups.cfg'...
Processing object config file '/usr/local/nagios/etc/contacts.cfg'...
Processing object config file '/usr/local/nagios/etc/timeperiods.cfg'...
Processing object config file '/usr/local/nagios/etc/commands.cfg'...
Processing object config file '/usr/local/nagios/etc/hostgroups.cfg'...
Processing object config file '/usr/local/nagios/etc/servicegroups.cfg'...
Processing object config file '/usr/local/nagios/etc/hosttemplates.cfg'...
Processing object config file '/usr/local/nagios/etc/servicetemplates.cfg'...
Processing object config file '/usr/local/nagios/etc/servicedependencies.cfg'...
Processing object config file '/usr/local/nagios/etc/serviceescalations.cfg'...
Processing object config file '/usr/local/nagios/etc/hostdependencies.cfg'...
Processing object config file '/usr/local/nagios/etc/hostescalations.cfg'...
Processing object config file '/usr/local/nagios/etc/hostextinfo.cfg'...
Processing object config file '/usr/local/nagios/etc/serviceextinfo.cfg'...
Processing object config directory '/usr/local/nagios/etc/hosts'...
Processing object config file '/usr/local/nagios/etc/hosts/xx.cfg'...
Processing object config file '/usr/local/nagios/etc/hosts/x.cfg'...
Processing object config file '/usr/local/nagios/etc/services/xxx.cfg'...
Processing object config file '/usr/local/nagios/etc/services/xxxx.cfg'...
.
^...Had to remove the host names, replaced with x's above and deleted most of them for brevity...^
.
Read object config files okay...

Running pre-flight check on configuration data...

Checking services...
Checked 444 services.
Checking hosts...
Checked 63 hosts.
Checking host groups...
Checked 14 host groups.
Checking service groups...
Checked 5 service groups.
Checking contacts...
Checked 12 contacts.
Checking contact groups...
Checked 2 contact groups.
Checking service escalations...
Checked 0 service escalations.
Checking service dependencies...
Checked 0 service dependencies.
Checking host escalations...
Checked 0 host escalations.
Checking host dependencies...
Checked 0 host dependencies.
Checking commands...
Checked 112 commands.
Checking time periods...
Checked 17 time periods.
Checking for circular paths between hosts...
Checking for circular host and service dependencies...
Checking global event handlers...
Checking obsessive compulsive processor commands...
Checking misc settings...

Total Warnings: 0
Total Errors: 0

Things look okay - No serious problems were detected during the pre-flight check

[sreinhardt]

Well from 3.5 that looks great. Unless you hit some other config error, you should be able to complete the upgrade now.

[atuttle]

Bingo.
Thank you for you persistence too.
Everything seems to be working, including acknowledge.
On my test system acknowledge stopped working after the upgrade but 'Mass Acknowledge' still works.

[tmcdonald]

If you want you can open another thread for the test server, but for now I will be closing this one.