FATAL: Could not load state!

This support forum board is for support questions relating to Nagios XI, our flagship commercial network monitoring solution.
Locked
RebeccaIlene
Posts: 164
Joined: Tue Apr 02, 2019 8:38 pm

FATAL: Could not load state!

Post by RebeccaIlene »

Hi Team,

We are receiving FATAL: Could not load state! error on all DB services.

This was previously discussed on case #770790 where the issue was likely recorded as related to the NDO3.

However, even after we have downgraded to NDO2 DB this has reoccurred.

Please suggest what we can do to fix this.
User avatar
tgriep
Madmin
Posts: 9190
Joined: Thu Oct 30, 2014 9:02 am

Re: FATAL: Could not load state!

Post by tgriep »

Open a root shell on the Nagios server and run the following commands. Get the /tmp/info.txt file and upload it here so we can view it.

Code: Select all

mysql -u root -pnagiosxi -e "show global status like '%used_connections%'; show variables like 'max_connections';" >/tmp/info.txt
echo "SELECT table_schema as 'Database', table_name AS 'Table', round(((data_length + index_length) / 1024 / 1024), 2) 'Size in MB' FROM information_schema.TABLES ORDER BY (data_length + index_length) DESC;" |mysql -t -u root -pnagiosxi >>/tmp/info.txt
 tail -200 /var/log/mariadb/mariadb.log  >>/tmp/info.txt
Be sure to check out our Knowledgebase for helpful articles and solutions!
tchandra
Posts: 38
Joined: Fri Oct 18, 2019 5:53 am

Re: FATAL: Could not load state!

Post by tchandra »

Hi Tgriep,

Thanks for your response. Please go through the below are the logs as you required.

Code: Select all

[root@*.*.*.*  tmp]# cat /tmp/info.txt
Variable_name   Value
Max_used_connections    152
Variable_name   Value
max_connections 151
+--------------------+----------------------------------------------+------------+
| Database           | Table                                        | Size in MB |
+--------------------+----------------------------------------------+------------+
| nagios             | nagios_statehistory                          |    1637.38 |
| nagios             | nagios_logentries                            |    1025.63 |
| nagios             | nagios_commenthistory                        |     503.88 |
| nagiosxi           | xi_auditlog                                  |     304.28 |
| nagios             | nagios_contactnotifications                  |      72.20 |
| nagios             | nagios_contactnotificationmethods            |      67.89 |
| nagios             | nagios_downtimehistory                       |      48.49 |
| nagios             | nagios_notifications                         |      43.04 |
| nagios             | nagios_flappinghistory                       |      31.17 |
| nagios             | nagios_objects                               |       8.34 |
| nagios             | nagios_servicestatus                         |       8.02 |
| nagiosxi           | xi_meta                                      |       6.28 |
| nagiosxi           | xi_cmp_trapdata_log                          |       5.69 |
| nagios             | nagios_acknowledgements                      |       4.55 |
| nagiosql           | tbl_service                                  |       3.52 |
| nagios             | nagios_services                              |       3.29 |
| nagiosxi           | xi_usermeta                                  |       1.67 |
| nagiosql           | tbl_lnkServiceToServicetemplate              |       1.52 |
| nagiosql           | tbl_lnkServiceToServicegroup                 |       1.52 |
| nagiosql           | tbl_lnkServiceToContactgroup                 |       1.52 |
| nagiosql           | tbl_permission                               |       1.52 |
| nagios             | nagios_externalcommands                      |       0.97 |
| nagios             | nagios_servicegroup_members                  |       0.71 |
| nagios             | nagios_hoststatus                            |       0.67 |
| nagios             | nagios_service_contactgroups                 |       0.67 |
| nagios             | nagios_processevents                         |       0.54 |
| nagiosql           | tbl_lnkServiceToHost                         |       0.50 |
| nagiosql           | tbl_host                                     |       0.47 |
| nagiosxi           | xi_events                                    |       0.45 |
| mysql              | help_topic                                   |       0.45 |
| nagios             | nagios_conninfo                              |       0.38 |
| nagios             | nagios_hosts                                 |       0.34 |
| nagiosql           | tbl_permission_inactive                      |       0.31 |
| nagios             | nagios_service_contacts                      |       0.23 |
| nagios             | nagios_comments                              |       0.23 |
| nagios             | nagios_hostgroup_members                     |       0.22 |
| nagiosql           | tbl_lnkServiceToContact                      |       0.22 |
| nagios             | nagios_contact_notificationcommands          |       0.22 |
| nagiosql           | tbl_info                                     |       0.17 |
| nagiosxi           | xi_auth_tokens                               |       0.17 |
| nagiosql           | tbl_contactgroup                             |       0.14 |
| nagiosql           | tbl_lnkHostToHostgroup                       |       0.13 |
| nagiosql           | tbl_command                                  |       0.13 |
| nagiosql           | tbl_serviceescalation                        |       0.13 |
| nagiosxi           | xi_cmp_trapdata                              |       0.13 |
| nagios             | nagios_eventhandlers                         |       0.11 |
| nagiosql           | tbl_contact                                  |       0.11 |
| mysql              | help_keyword                                 |       0.10 |
| nagiosql           | tbl_timedefinition                           |       0.09 |
| nagiosql           | tbl_lnkHostToContactgroup                    |       0.09 |
| nagiosql           | tbl_lnkHostgroupToHost                       |       0.09 |
| nagios             | nagios_contactgroup_members                  |       0.09 |
| nagios             | nagios_host_contactgroups                    |       0.08 |
| nagiosxi           | xi_options                                   |       0.08 |
| nagiosql           | tbl_lnkContactgroupToContact                 |       0.08 |
| nagiosql           | tbl_lnkHostToHosttemplate                    |       0.08 |
| nagiosql           | tbl_timeperiod                               |       0.06 |
| nagiosql           | tbl_servicegroup                             |       0.06 |
| nagios             | nagios_commands                              |       0.06 |
| nagios             | nagios_timeperiod_timeranges                 |       0.06 |
| nagios             | nagios_contacts                              |       0.05 |
| nagiosql           | tbl_lnkServicegroupToService                 |       0.05 |
| nagiosxi           | xi_mibs                                      |       0.05 |
| nagiosql           | tbl_lnkServiceescalationToContactgroup       |       0.05 |
| nagios             | nagios_systemcommands                        |       0.04 |
| nagios             | nagios_contactgroups                         |       0.04 |
| nagios             | nagios_contactstatus                         |       0.03 |
| nagiosql           | tbl_contacttemplate                          |       0.03 |
| nagiosql           | tbl_user                                     |       0.03 |
| nagiosql           | tbl_settings                                 |       0.03 |
| nagiosxi           | xi_eventqueue                                |       0.03 |
| nagiosql           | tbl_hosttemplate                             |       0.03 |
| nagiosql           | tbl_hostgroup                                |       0.03 |
| nagiosql           | tbl_hostextinfo                              |       0.03 |
| nagiosql           | tbl_servicetemplate                          |       0.03 |
| nagiosxi           | xi_users                                     |       0.03 |
| nagiosql           | tbl_serviceextinfo                           |       0.03 |
| nagiosxi           | xi_sysstat                                   |       0.03 |
| nagiosql           | tbl_servicedependency                        |       0.03 |
| nagiosxi           | xi_sessions                                  |       0.03 |
| nagiosxi           | xi_cmp_favorites                             |       0.03 |
| nagiosql           | tbl_hostescalation                           |       0.03 |
| nagiosql           | tbl_hostdependency                           |       0.03 |
| nagiosql           | tbl_domain                                   |       0.03 |
| mysql              | help_relation                                |       0.03 |
| nagios             | nagios_host_parenthosts                      |       0.02 |
| nagios             | nagios_host_contacts                         |       0.02 |
| nagios             | nagios_timeperiods                           |       0.02 |
| nagiosql           | tbl_lnkServicetemplateToVariabledefinition   |       0.02 |
| nagiosql           | tbl_lnkContactToContactgroup                 |       0.02 |
| nagiosql           | tbl_lnkHosttemplateToContactgroup            |       0.02 |
| nagiosql           | tbl_lnkServicedependencyToService_S          |       0.02 |
| nagiosql           | tbl_lnkHostToHost                            |       0.02 |
| nagiosql           | tbl_lnkServicetemplateToServicetemplate      |       0.02 |
| nagiosql           | tbl_lnkContactToCommandService               |       0.02 |
| nagiosql           | tbl_lnkHosttemplateToContact                 |       0.02 |
| nagiosql           | tbl_lnkServicedependencyToService_DS         |       0.02 |
| nagiosql           | tbl_lnkServicetemplateToServicegroup         |       0.02 |
| nagiosql           | tbl_lnkContactToCommandHost                  |       0.02 |
| nagiosql           | tbl_lnkHostgroupToHostgroup                  |       0.02 |
| nagiosql           | tbl_submenu                                  |       0.02 |
| nagiosql           | tbl_lnkServicedependencyToHostgroup_H        |       0.02 |
| nagiosql           | tbl_lnkServicedependencyToHostgroup_DH       |       0.02 |
| nagiosql           | tbl_lnkHostToContact                         |       0.02 |
| nagiosql           | tbl_lnkServicetemplateToHostgroup            |       0.02 |
| nagiosql           | tbl_session_locks                            |       0.02 |
| nagiosql           | tbl_lnkServicedependencyToHost_H             |       0.02 |
| nagiosql           | tbl_lnkContacttemplateToVariabledefinition   |       0.02 |
| nagiosql           | tbl_lnkServicetemplateToHost                 |       0.02 |
| nagiosql           | tbl_lnkHostescalationToHostgroup             |       0.02 |
| nagiosql           | tbl_session                                  |       0.02 |
| nagiosql           | tbl_lnkServicedependencyToHost_DH            |       0.02 |
| nagiosxi           | xi_deploy_jobs                               |       0.02 |
| nagiosql           | tbl_lnkContacttemplateToContacttemplate      |       0.02 |
| nagiosql           | tbl_lnkServicetemplateToContactgroup         |       0.02 |
| nagiosql           | tbl_lnkHostescalationToHost                  |       0.02 |
| nagiosql           | tbl_lnkServiceToVariabledefinition           |       0.02 |
| nagiosxi           | xi_deploy_agents                             |       0.02 |
| nagiosql           | tbl_lnkServicetemplateToContact              |       0.02 |
| nagiosxi           | xi_commands                                  |       0.02 |
| nagiosql           | tbl_lnkServicegroupToServicegroup            |       0.02 |
| nagiosql           | tbl_lnkHostescalationToContactgroup          |       0.02 |
| nagiosql           | tbl_lnkServiceToHostgroup                    |       0.02 |
| nagiosql           | tbl_lnkServiceescalationToServicegroup       |       0.02 |
| nagiosql           | tbl_lnkHostescalationToContact               |       0.02 |
| nagiosql           | tbl_lnkContacttemplateToContactgroup         |       0.02 |
| nagiosql           | tbl_lnkHostdependencyToHostgroup_H           |       0.02 |
| nagiosql           | tbl_lnkContacttemplateToCommandService       |       0.02 |
| nagiosxi           | xi_cmp_nagiosbpi_backups                     |       0.02 |
| nagiosql           | tbl_lnkServiceescalationToService            |       0.02 |
| nagiosql           | tbl_lnkHostdependencyToHostgroup_DH          |       0.02 |
| nagiosql           | tbl_lnkContacttemplateToCommandHost          |       0.02 |
| nagiosql           | tbl_lnkServiceescalationToHost               |       0.02 |
| nagiosql           | tbl_lnkServiceescalationToHostgroup          |       0.02 |
| nagiosql           | tbl_lnkContactgroupToContactgroup            |       0.02 |
| nagiosql           | tbl_lnkHosttemplateToVariabledefinition      |       0.02 |
| nagiosxi           | xi_cmp_ccm_backups                           |       0.02 |
| nagiosql           | tbl_lnkHostdependencyToHost_H                |       0.02 |
| nagiosql           | tbl_lnkServiceescalationToContact            |       0.02 |
| nagiosql           | tbl_lnkHostdependencyToHost_DH               |       0.02 |
| nagiosql           | tbl_lnkHosttemplateToHosttemplate            |       0.02 |
| nagiosql           | tbl_lnkServicedependencyToServicegroup_S     |       0.02 |
| nagiosql           | tbl_lnkHostToVariabledefinition              |       0.02 |
| nagiosql           | tbl_logbook                                  |       0.02 |
| nagiosql           | tbl_lnkContactToVariabledefinition           |       0.02 |
| nagiosql           | tbl_lnkHosttemplateToHostgroup               |       0.02 |
| nagiosql           | tbl_mainmenu                                 |       0.02 |
| nagiosql           | tbl_lnkServicedependencyToServicegroup_DS    |       0.02 |
| nagiosql           | tbl_variabledefinition                       |       0.02 |
| nagiosql           | tbl_lnkTimeperiodToTimeperiod                |       0.02 |
| nagiosql           | tbl_lnkContactToContacttemplate              |       0.02 |
| nagiosql           | tbl_lnkHosttemplateToHost                    |       0.02 |
| nagios             | nagios_customvariablestatus                  |       0.01 |
| nagios             | nagios_servicegroups                         |       0.01 |
| nagios             | nagios_hostgroups                            |       0.01 |
| nagios             | nagios_configfilevariables                   |       0.01 |
| nagios             | nagios_configfiles                           |       0.01 |
| information_schema | PLUGINS                                      |       0.01 |
| information_schema | PARTITIONS                                   |       0.01 |
| information_schema | PARAMETERS                                   |       0.01 |
| information_schema | EVENTS                                       |       0.01 |
| information_schema | COLUMNS                                      |       0.01 |
| information_schema | VIEWS                                        |       0.01 |
| information_schema | ROUTINES                                     |       0.01 |
| information_schema | TRIGGERS                                     |       0.01 |
| information_schema | PROCESSLIST                                  |       0.01 |
| mysql              | db                                           |       0.01 |
| nagios             | nagios_hostescalations                       |       0.01 |
| mysql              | proxies_priv                                 |       0.01 |
| nagios             | nagios_hostescalation_contactgroups          |       0.01 |
| nagios             | nagios_customvariables                       |       0.01 |
| mysql              | proc                                         |       0.00 |
| mysql              | help_category                                |       0.00 |
| nagios             | nagios_scheduleddowntime                     |       0.00 |
| mysql              | tables_priv                                  |       0.00 |
| mysql              | columns_priv                                 |       0.00 |
| mysql              | procs_priv                                   |       0.00 |
| nagios             | nagios_runtimevariables                      |       0.00 |
| nagios             | nagios_programstatus                         |       0.00 |
| mysql              | user                                         |       0.00 |
| nagios             | nagios_instances                             |       0.00 |
| mysql              | event                                        |       0.00 |
| mysql              | host                                         |       0.00 |
| nagios             | nagios_dbversion                             |       0.00 |
| nagios             | nagios_service_parentservices                |       0.00 |
| mysql              | time_zone_transition                         |       0.00 |
| nagios             | nagios_hostescalation_contacts               |       0.00 |
| mysql              | time_zone_transition_type                    |       0.00 |
| mysql              | time_zone_name                               |       0.00 |
| mysql              | func                                         |       0.00 |
| mysql              | time_zone_leap_second                        |       0.00 |
| mysql              | time_zone                                    |       0.00 |
| nagios             | nagios_hostdependencies                      |       0.00 |
| nagios             | nagios_timedevents                           |       0.00 |
| mysql              | servers                                      |       0.00 |
| nagios             | nagios_timedeventqueue                       |       0.00 |
| nagios             | nagios_contact_addresses                     |       0.00 |
| nagios             | nagios_hostchecks                            |       0.00 |
| mysql              | plugin                                       |       0.00 |
| mysql              | ndb_binlog_index                             |       0.00 |
| nagios             | nagios_serviceescalations                    |       0.00 |
| nagios             | nagios_serviceescalation_contacts            |       0.00 |
| nagios             | nagios_serviceescalation_contactgroups       |       0.00 |
| nagios             | nagios_servicedependencies                   |       0.00 |
| nagios             | nagios_servicechecks                         |       0.00 |
| performance_schema | file_instances                               |       0.00 |
| information_schema | TABLE_CONSTRAINTS                            |       0.00 |
| information_schema | KEY_CACHES                                   |       0.00 |
| information_schema | INNODB_CMP_RESET                             |       0.00 |
| performance_schema | events_waits_summary_global_by_event_name    |       0.00 |
| mysql              | general_log                                  |       0.00 |
| information_schema | INDEX_STATISTICS                             |       0.00 |
| information_schema | INNODB_CMP                                   |       0.00 |
| performance_schema | events_waits_summary_by_thread_by_event_name |       0.00 |
| information_schema | GLOBAL_VARIABLES                             |       0.00 |
| performance_schema | events_waits_summary_by_instance             |       0.00 |
| information_schema | GLOBAL_STATUS                                |       0.00 |
| information_schema | INNODB_INDEX_STATS                           |       0.00 |
| performance_schema | events_waits_history_long                    |       0.00 |
| information_schema | FILES                                        |       0.00 |
| information_schema | INNODB_LOCK_WAITS                            |       0.00 |
| performance_schema | events_waits_history                         |       0.00 |
| information_schema | INNODB_SYS_INDEXES                           |       0.00 |
| mysql              | slow_log                                     |       0.00 |
| information_schema | INNODB_SYS_TABLESTATS                        |       0.00 |
| performance_schema | events_waits_current                         |       0.00 |
| information_schema | TABLESPACES                                  |       0.00 |
| information_schema | INNODB_SYS_FOREIGN                           |       0.00 |
| information_schema | INNODB_CMPMEM                                |       0.00 |
| performance_schema | cond_instances                               |       0.00 |
| information_schema | TABLES                                       |       0.00 |
| information_schema | INNODB_SYS_STATS                             |       0.00 |
| information_schema | INNODB_BUFFER_PAGE                           |       0.00 |
| information_schema | ENGINES                                      |       0.00 |
| information_schema | STATISTICS                                   |       0.00 |
| information_schema | INNODB_SYS_COLUMNS                           |       0.00 |
| information_schema | INNODB_BUFFER_POOL_STATS                     |       0.00 |
| performance_schema | threads                                      |       0.00 |
| information_schema | COLUMN_PRIVILEGES                            |       0.00 |
| information_schema | INNODB_UNDO_LOGS                             |       0.00 |
| information_schema | INNODB_BUFFER_PAGE_LRU                       |       0.00 |
| performance_schema | setup_timers                                 |       0.00 |
| information_schema | INNODB_RSEG                                  |       0.00 |
| information_schema | SESSION_VARIABLES                            |       0.00 |
| information_schema | INNODB_SYS_FIELDS                            |       0.00 |
| information_schema | INNODB_SYS_FOREIGN_COLS                      |       0.00 |
| performance_schema | setup_instruments                            |       0.00 |
| information_schema | COLLATION_CHARACTER_SET_APPLICABILITY        |       0.00 |
| information_schema | INNODB_CMPMEM_RESET                          |       0.00 |
| information_schema | SESSION_STATUS                               |       0.00 |
| information_schema | INNODB_SYS_TABLES                            |       0.00 |
| information_schema | INNODB_TABLE_STATS                           |       0.00 |
| performance_schema | setup_consumers                              |       0.00 |
| information_schema | COLLATIONS                                   |       0.00 |
| information_schema | SCHEMA_PRIVILEGES                            |       0.00 |
| information_schema | INNODB_BUFFER_POOL_PAGES_BLOB                |       0.00 |
| information_schema | CLIENT_STATISTICS                            |       0.00 |
| information_schema | USER_STATISTICS                              |       0.00 |
| information_schema | SCHEMATA                                     |       0.00 |
| information_schema | INNODB_LOCKS                                 |       0.00 |
| information_schema | XTRADB_ADMIN_COMMAND                         |       0.00 |
| performance_schema | rwlock_instances                             |       0.00 |
| information_schema | CHARACTER_SETS                               |       0.00 |
| information_schema | USER_PRIVILEGES                              |       0.00 |
| information_schema | INNODB_BUFFER_POOL_PAGES_INDEX               |       0.00 |
| performance_schema | performance_timers                           |       0.00 |
| information_schema | REFERENTIAL_CONSTRAINTS                      |       0.00 |
| information_schema | INNODB_TRX                                   |       0.00 |
| performance_schema | mutex_instances                              |       0.00 |
| information_schema | PROFILING                                    |       0.00 |
| information_schema | INNODB_BUFFER_POOL_PAGES                     |       0.00 |
| performance_schema | file_summary_by_instance                     |       0.00 |
| information_schema | TABLE_STATISTICS                             |       0.00 |
| performance_schema | file_summary_by_event_name                   |       0.00 |
| information_schema | TABLE_PRIVILEGES                             |       0.00 |
| information_schema | KEY_COLUMN_USAGE                             |       0.00 |
| information_schema | INNODB_CHANGED_PAGES                         |       0.00 |
+--------------------+----------------------------------------------+------------+
200916  2:34:41 InnoDB: Completed initialization of buffer pool
200916  2:34:41 InnoDB: highest supported file format is Barracuda.
200916  2:34:41  InnoDB: Waiting for the background threads to start
200916  2:34:42 Percona XtraDB (http://www.percona.com) 5.5.61-MariaDB-38.13 started; log sequence number 1989275376071
200916  2:34:42 [Note] Plugin 'FEEDBACK' is disabled.
200916  2:34:42 [Note] Server socket created on IP: '0.0.0.0'.
200916  2:34:42 [Note] Event Scheduler: Loaded 0 events
200916  2:34:42 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.65-MariaDB'  socket: '/var/lib/mysql/mysql.sock'  port: 3306  MariaDB Server
200916  2:36:20 [Note] /usr/libexec/mysqld: Normal shutdown
200916  2:36:20 [Note] Event Scheduler: Purging the queue. 0 events
200916  2:36:20  InnoDB: Starting shutdown...
200916  2:36:21  InnoDB: Waiting for 11 pages to be flushed
200916  2:36:22  InnoDB: Shutdown completed; log sequence number 1989276082739
200916  2:36:22 [Note] /usr/libexec/mysqld: Shutdown complete

200916 02:36:22 mysqld_safe mysqld from pid file /var/run/mariadb/mariadb.pid ended
200916 02:36:22 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
200916  2:36:22 [Note] /usr/libexec/mysqld (mysqld 5.5.65-MariaDB) starting as process 109259 ...
200916  2:36:22 InnoDB: The InnoDB memory heap is disabled
200916  2:36:22 InnoDB: Mutexes and rw_locks use GCC atomic builtins
200916  2:36:22 InnoDB: Compressed tables use zlib 1.2.7
200916  2:36:22 InnoDB: Using Linux native AIO
200916  2:36:22 InnoDB: Initializing buffer pool, size = 128.0M
200916  2:36:22 InnoDB: Completed initialization of buffer pool
200916  2:36:22 InnoDB: highest supported file format is Barracuda.
200916  2:36:22  InnoDB: Waiting for the background threads to start
200916  2:36:23 Percona XtraDB (http://www.percona.com) 5.5.61-MariaDB-38.13 started; log sequence number 1989276082739
200916  2:36:23 [Note] Plugin 'FEEDBACK' is disabled.
200916  2:36:23 [Note] Server socket created on IP: '0.0.0.0'.
200916  2:36:23 [Note] Event Scheduler: Loaded 0 events
200916  2:36:23 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.65-MariaDB'  socket: '/var/lib/mysql/mysql.sock'  port: 3306  MariaDB Server
201122 20:44:51 [Note] /usr/libexec/mysqld: Normal shutdown
201122 20:44:51 [Note] Event Scheduler: Purging the queue. 0 events
201122 20:44:51  InnoDB: Starting shutdown...
201122 20:44:52  InnoDB: Waiting for 24 pages to be flushed
201122 20:44:54  InnoDB: Shutdown completed; log sequence number 2077022081353
201122 20:44:54 [Note] /usr/libexec/mysqld: Shutdown complete

201122 20:44:54 mysqld_safe mysqld from pid file /var/run/mariadb/mariadb.pid ended
201122 20:44:54 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
201122 20:44:54 [Note] /usr/libexec/mysqld (mysqld 5.5.68-MariaDB) starting as process 81583 ...
201122 20:44:54 InnoDB: The InnoDB memory heap is disabled
201122 20:44:54 InnoDB: Mutexes and rw_locks use GCC atomic builtins
201122 20:44:54 InnoDB: Compressed tables use zlib 1.2.7
201122 20:44:54 InnoDB: Using Linux native AIO
201122 20:44:54 InnoDB: Initializing buffer pool, size = 128.0M
201122 20:44:54 InnoDB: Completed initialization of buffer pool
201122 20:44:54 InnoDB: highest supported file format is Barracuda.
201122 20:44:55  InnoDB: Waiting for the background threads to start
201122 20:44:56 Percona XtraDB (http://www.percona.com) 5.5.61-MariaDB-38.13 started; log sequence number 2077022081353
201122 20:44:56 [Note] Plugin 'FEEDBACK' is disabled.
201122 20:44:56 [Note] Server socket created on IP: '0.0.0.0'.
201122 20:44:56 [Note] Event Scheduler: Loaded 0 events
201122 20:44:56 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.68-MariaDB'  socket: '/var/lib/mysql/mysql.sock'  port: 3306  MariaDB Server
201122 20:53:45 [Note] /usr/libexec/mysqld: Normal shutdown
201122 20:53:45 [Note] Event Scheduler: Purging the queue. 0 events
201122 20:53:45  InnoDB: Starting shutdown...
201122 20:53:45  InnoDB: Waiting for 65 pages to be flushed
201122 20:53:50  InnoDB: Shutdown completed; log sequence number 2077023168131
201122 20:53:50 [Note] /usr/libexec/mysqld: Shutdown complete

201122 20:53:50 mysqld_safe mysqld from pid file /var/run/mariadb/mariadb.pid ended
201122 20:55:58 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
201122 20:55:58 [Note] /usr/libexec/mysqld (mysqld 5.5.68-MariaDB) starting as process 2522 ...
201122 20:55:58 InnoDB: The InnoDB memory heap is disabled
201122 20:55:58 InnoDB: Mutexes and rw_locks use GCC atomic builtins
201122 20:55:58 InnoDB: Compressed tables use zlib 1.2.7
201122 20:55:58 InnoDB: Using Linux native AIO
201122 20:55:58 InnoDB: Initializing buffer pool, size = 128.0M
201122 20:55:58 InnoDB: Completed initialization of buffer pool
201122 20:55:58 InnoDB: highest supported file format is Barracuda.
201122 20:55:58  InnoDB: Waiting for the background threads to start
201122 20:55:59 Percona XtraDB (http://www.percona.com) 5.5.61-MariaDB-38.13 started; log sequence number 2077023168131
201122 20:55:59 [Note] Plugin 'FEEDBACK' is disabled.
201122 20:55:59 [Note] Server socket created on IP: '0.0.0.0'.
201122 20:55:59 [Note] Event Scheduler: Loaded 0 events
201122 20:55:59 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.68-MariaDB'  socket: '/var/lib/mysql/mysql.sock'  port: 3306  MariaDB Server
201122 21:19:50 [Note] /usr/libexec/mysqld: Normal shutdown
201122 21:19:50 [Note] Event Scheduler: Purging the queue. 0 events
201122 21:19:50  InnoDB: Starting shutdown...
201122 21:19:51  InnoDB: Waiting for 70 pages to be flushed
201122 21:19:53  InnoDB: Shutdown completed; log sequence number 2077058416114
201122 21:19:53 [Note] /usr/libexec/mysqld: Shutdown complete

201122 21:19:54 mysqld_safe mysqld from pid file /var/run/mariadb/mariadb.pid ended
201122 21:19:54 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
201122 21:19:54 [Note] /usr/libexec/mysqld (mysqld 5.5.68-MariaDB) starting as process 55469 ...
201122 21:19:54 InnoDB: The InnoDB memory heap is disabled
201122 21:19:54 InnoDB: Mutexes and rw_locks use GCC atomic builtins
201122 21:19:54 InnoDB: Compressed tables use zlib 1.2.7
201122 21:19:54 InnoDB: Using Linux native AIO
201122 21:19:54 InnoDB: Initializing buffer pool, size = 128.0M
201122 21:19:54 InnoDB: Completed initialization of buffer pool
201122 21:19:54 InnoDB: highest supported file format is Barracuda.
201122 21:19:54  InnoDB: Waiting for the background threads to start
201122 21:19:55 Percona XtraDB (http://www.percona.com) 5.5.61-MariaDB-38.13 started; log sequence number 2077058416114
201122 21:19:55 [Note] Plugin 'FEEDBACK' is disabled.
201122 21:19:55 [Note] Server socket created on IP: '0.0.0.0'.
201122 21:19:55 [Note] Event Scheduler: Loaded 0 events
201122 21:19:55 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.68-MariaDB'  socket: '/var/lib/mysql/mysql.sock'  port: 3306  MariaDB Server
201216 13:17:38 [Note] /usr/libexec/mysqld: Normal shutdown
201216 13:17:38 [Note] Event Scheduler: Purging the queue. 0 events
201216 13:17:38  InnoDB: Starting shutdown...
201216 13:17:39  InnoDB: Waiting for 4 pages to be flushed
201216 13:17:42  InnoDB: Shutdown completed; log sequence number 2107455353601
201216 13:17:42 [Note] /usr/libexec/mysqld: Shutdown complete

201216 13:17:42 mysqld_safe mysqld from pid file /var/run/mariadb/mariadb.pid ended
201216 13:17:42 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
201216 13:17:42 [Note] /usr/libexec/mysqld (mysqld 5.5.68-MariaDB) starting as process 99139 ...
201216 13:17:42 InnoDB: The InnoDB memory heap is disabled
201216 13:17:42 InnoDB: Mutexes and rw_locks use GCC atomic builtins
201216 13:17:42 InnoDB: Compressed tables use zlib 1.2.7
201216 13:17:42 InnoDB: Using Linux native AIO
201216 13:17:42 InnoDB: Initializing buffer pool, size = 128.0M
201216 13:17:42 InnoDB: Completed initialization of buffer pool
201216 13:17:42 InnoDB: highest supported file format is Barracuda.
201216 13:17:42  InnoDB: Waiting for the background threads to start
201216 13:17:43 Percona XtraDB (http://www.percona.com) 5.5.61-MariaDB-38.13 started; log sequence number 2107455353601
201216 13:17:43 [Note] Plugin 'FEEDBACK' is disabled.
201216 13:17:44 [Note] Server socket created on IP: '0.0.0.0'.
201216 13:17:44 [Note] Event Scheduler: Loaded 0 events
201216 13:17:44 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.68-MariaDB'  socket: '/var/lib/mysql/mysql.sock'  port: 3306  MariaDB Server
201216 13:44:46 [Note] /usr/libexec/mysqld: Normal shutdown
201216 13:44:46 [Note] Event Scheduler: Purging the queue. 0 events
201216 13:44:47  InnoDB: Starting shutdown...
201216 13:44:47  InnoDB: Waiting for 16 pages to be flushed
201216 13:44:48  InnoDB: Shutdown completed; log sequence number 2107458898151
201216 13:44:48 [Note] /usr/libexec/mysqld: Shutdown complete

201216 13:44:48 mysqld_safe mysqld from pid file /var/run/mariadb/mariadb.pid ended
201216 13:49:49 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
201216 13:49:49 [Note] /usr/libexec/mysqld (mysqld 5.5.68-MariaDB) starting as process 25549 ...
201216 13:49:49 InnoDB: The InnoDB memory heap is disabled
201216 13:49:49 InnoDB: Mutexes and rw_locks use GCC atomic builtins
201216 13:49:49 InnoDB: Compressed tables use zlib 1.2.7
201216 13:49:49 InnoDB: Using Linux native AIO
201216 13:49:49 InnoDB: Initializing buffer pool, size = 128.0M
201216 13:49:49 InnoDB: Completed initialization of buffer pool
201216 13:49:49 InnoDB: highest supported file format is Barracuda.
201216 13:49:49  InnoDB: Waiting for the background threads to start
201216 13:49:50 Percona XtraDB (http://www.percona.com) 5.5.61-MariaDB-38.13 started; log sequence number 2107458898151
201216 13:49:50 [Note] Plugin 'FEEDBACK' is disabled.
201216 13:49:50 [Note] Server socket created on IP: '0.0.0.0'.
201216 13:49:50 [Note] Event Scheduler: Loaded 0 events
201216 13:49:50 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.68-MariaDB'  socket: '/var/lib/mysql/mysql.sock'  port: 3306  MariaDB Server
201216 14:59:53 [Note] /usr/libexec/mysqld: Normal shutdown
201216 14:59:53 [Note] Event Scheduler: Purging the queue. 0 events
201216 14:59:53  InnoDB: Starting shutdown...
201216 14:59:55  InnoDB: Shutdown completed; log sequence number 2107468452597
201216 14:59:55 [Note] /usr/libexec/mysqld: Shutdown complete

201216 14:59:55 mysqld_safe mysqld from pid file /var/run/mariadb/mariadb.pid ended
201216 15:02:14 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
201216 15:02:14 [Note] /usr/libexec/mysqld (mysqld 5.5.68-MariaDB) starting as process 28705 ...
201216 15:02:14 InnoDB: The InnoDB memory heap is disabled
201216 15:02:14 InnoDB: Mutexes and rw_locks use GCC atomic builtins
201216 15:02:14 InnoDB: Compressed tables use zlib 1.2.7
201216 15:02:14 InnoDB: Using Linux native AIO
201216 15:02:14 InnoDB: Initializing buffer pool, size = 128.0M
201216 15:02:14 InnoDB: Completed initialization of buffer pool
201216 15:02:14 InnoDB: highest supported file format is Barracuda.
201216 15:02:14  InnoDB: Waiting for the background threads to start
201216 15:02:15 Percona XtraDB (http://www.percona.com) 5.5.61-MariaDB-38.13 started; log sequence number 2107468452597
201216 15:02:15 [Note] Plugin 'FEEDBACK' is disabled.
201216 15:02:15 [Note] Server socket created on IP: '0.0.0.0'.
201216 15:02:15 [Note] Event Scheduler: Loaded 0 events
201216 15:02:15 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.68-MariaDB'  socket: '/var/lib/mysql/mysql.sock'  port: 3306  MariaDB Server
210106  4:17:10 [Note] /usr/libexec/mysqld: Normal shutdown
210106  4:17:10 [Note] Event Scheduler: Purging the queue. 0 events
210106  4:17:10  InnoDB: Starting shutdown...
210106  4:17:11  InnoDB: Waiting for 21 pages to be flushed
210106  4:17:15  InnoDB: Shutdown completed; log sequence number 2133839261248
210106  4:17:15 [Note] /usr/libexec/mysqld: Shutdown complete

210106 04:17:16 mysqld_safe mysqld from pid file /var/run/mariadb/mariadb.pid ended
210106 04:17:16 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
210106  4:17:16 [Note] /usr/libexec/mysqld (mysqld 5.5.68-MariaDB) starting as process 48646 ...
210106  4:17:16 InnoDB: The InnoDB memory heap is disabled
210106  4:17:16 InnoDB: Mutexes and rw_locks use GCC atomic builtins
210106  4:17:16 InnoDB: Compressed tables use zlib 1.2.7
210106  4:17:16 InnoDB: Using Linux native AIO
210106  4:17:16 InnoDB: Initializing buffer pool, size = 128.0M
210106  4:17:16 InnoDB: Completed initialization of buffer pool
210106  4:17:16 InnoDB: highest supported file format is Barracuda.
210106  4:17:16  InnoDB: Waiting for the background threads to start
210106  4:17:17 Percona XtraDB (http://www.percona.com) 5.5.61-MariaDB-38.13 started; log sequence number 2133839261248
210106  4:17:17 [Note] Plugin 'FEEDBACK' is disabled.
210106  4:17:17 [Note] Server socket created on IP: '0.0.0.0'.
210106  4:17:17 [Note] Event Scheduler: Loaded 0 events
210106  4:17:17 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.68-MariaDB'  socket: '/var/lib/mysql/mysql.sock'  port: 3306  MariaDB Server
Thanks & Regards,
Chandra
Last edited by tgriep on Wed Jan 06, 2021 10:03 am, edited 1 time in total.
Reason: Added Code wraps around large output.
User avatar
tgriep
Madmin
Posts: 9190
Joined: Thu Oct 30, 2014 9:02 am

Re: FATAL: Could not load state!

Post by tgriep »

The max connections to the MYSQL database has been exceeded and is causing issues with the database connections.
Follow this article to increase the Max Connections to the MYSQL database.
https://support.nagios.com/kb/article/n ... s-513.html

Run these commands to stop the processes, clean and repair the SQL database and to restart the processes. Run them all as root.

Code: Select all

service npcd stop
service nagios stop
service ndo2db stop
service crond stop
pkill -9 -u nagios
echo "truncate table xi_events; truncate table xi_meta; truncate table xi_eventqueue;" | mysql -u root -pnagiosxi nagiosxi
mysqlcheck -f -r -u root -pnagiosxi --all-databases --use-frm
service mysqld restart
rm -f /usr/local/nagios/var/rw/nagios.cmd
rm -f /usr/local/nagios/var/nagios.lock
rm -f /var/run/nagios.lock
rm -f /usr/local/nagios/var/ndo.sock
rm -f /usr/local/nagios/var/ndo2db.lock
rm -f /var/lib/mrtg/mrtg_l
rm -f /usr/local/nagiosxi/var/*.lock
rm -f /usr/local/nagiosxi/tmp/*.lock
for i in `ipcs -q | grep nagios |awk '{print $2}'`; do ipcrm -q $i; done
pkill python
service httpd restart
service ndo2db start
service nagios start
service npcd start
service crond start
This should fix the database issues the server is experiencing.
Be sure to check out our Knowledgebase for helpful articles and solutions!
Locked