We do have a document that goes over a number of performance optimization options that can be implemented.
https://assets.nagios.com/downloads/nag ... ios-XI.pdf
The first thing I will say is with 30k service checks, that is the high end of what a typical Nagios XI system can handle. The first thing I would check is your monitoring intervals. If it's all default a 5 minutes for each service check, you're looking at the XI system launching about 100 service checks every second.
When people get up to high number of service checks like this, I always recommend taking stock of the check interval, the retry interval, and the max check attempts.
The check interval is how often Nagios XI will query the service under normal circumstances. Typically 5 minutes.
The retry interval is how often Nagios XI will query the service after the initial query returned a bad state (Warning, Critical, or Unknown) Typically 1 minute.
The max check attempts is how many total queries Nagios XI will perform against that service before cementing that service as being in a bad state. This is inclusive of the initial query. Typically 5 queries.
Check intervals should be expanded out to the longest that they can be. For example, if you are checking the SSL/TLS certificates on websites, you probably don't need to check every 5 minutes. Those can likely be checked once or maybe even twice a day. Increasing the check interval decreases the number of service checks Nagios XI needs to schedule every second.
Passive host and service checks can also be a
huge help here. They are more work to set up, but they literally help spread the workload out across your entire environment, and in some cases, can give you better insight to the status of your systems. Like using passive checks as a host check. In some situations, a host can be completely locked up, but it will still respond to pings, so Nagios will think it's up, and all of the service checks are failing.
https://assets.nagios.com/downloads/nag ... hecks.html
https://assets.nagios.com/downloads/ncp ... Checks.pdf
https://assets.nagios.com/downloads/nag ... ios-XI.pdf