Service Watchdog

dweb

Hi there!

I don't if anyone is also having this type of issue, I'm kind new to Enhance.
One of my webapps server have 4GB of RAM, and a single website could make MariaDB get killed for OOM.
And I noticed that after 1 hour of all domains getting error in DB, there's no Watchdog to restart the mariadb service and I had to manually restart the maria db service (although one can use enhance ui, it's still bothersome that you have to manually do this).

I think watchdogs is a must in any server, if possible with mail notification or a specific log showing the super administrator why the service exited.

Also, if a specific website is causing the issue, it would be cool that after a couple restarts in a few minutes, this website gets locked out from the database service, until the administrator gets notifed, to avoid the service to be abused by a single domain.

I've just imposed some limits in the packages to avoid OOM in the mariadb, but yet, watchdog is a must in an web hosting panel.

What do you guys think?

Kosta

xyzulu

This has been discussed EXTENSIVELY on these forums since v12. To restore the v11 behaviour, see https://github.com/xyzulu/enhance-related/wiki/v12-mariadb-mysql-tweaks

For context, do some searching of these forums.

cPFence has also come up with a service monitor to provide exactly what you have requested here. See https://community.enhance.com/d/2404-cpfence-ui-is-here-security-management-now-with-a-mouse/40

Kosta

xyzulu however, it should be part of the enhance system not third party system.

dweb

xyzulu This has been discussed EXTENSIVELY on these forums since v12. To restore the v11 behaviour, see https://github.com/xyzulu/enhance-related/wiki/v12-mariadb-mysql-tweaks

I did that with both mysql.service mariadb.service but I got no "override.conf" file in /etc/systemd/system/mysql.service.d/ nor /etc/systemd/system/mariadb.service.d/

xyzulu cPFence has also come up with a service monitor to provide exactly what you have requested here. See https://community.enhance.com/d/2404-cpfence-ui-is-here-security-management-now-with-a-mouse/40

That's great. But again, it's a 3rd party system. No one knows if it will break one day after Enhance upgrades.

Kosta however, it should be part of the enhance system not third party system.
Exactly.

I don't mind installing 3rd party systems, but basic stuff like this should be built-in into the main software.
Just like log viewer and etc. Those are basics.

xyzulu

dweb but I got no "override.conf" file in /etc/systemd/system/mysql.service.d/ nor /etc/systemd/system/mariadb.service.d/

You can add a file to /etc/systemd/system/mariadb.service.d/ and after restarting mysql/mariadb it will be loaded.. you can check in the status of the service to be sure.

dweb but basic stuff like this should be built-in into the main software.

I sort of agree.. but there has to be a limit otherwise we'll see Enhance just being a copy of cPanel etc. In any case, the more concerning issue is that Enhance see largely AWOL from these forums (they rarely engage) and development has gone down a strange road. So, for now.. any issues like this are no likely to be implemented for a long time in my opinion.. we'll need to find ways to work around them ourselves.

slimx

I put this as a feature request in @cPFence - hopefully they implement it.
I myself had an issue where MariaDB died and I had no idea why.
Another where SSH died (very annoying)
Another where CRON died (cost me a customer)

xyzulu

slimx I put this as a feature request in @cPFence - hopefully they implement it.

They implemented this a while ago.. well.. service monitoring/restarting.

cPFence

slimx

Already added 13 days ago, cPFence Watchdog now supports:

SSH
CRON
Rspamd
Postfix
Dovecot
Pure-FTP
MySQL
Web Server
DNS
Main Control Panel
AppCD service

It’ll automatically restart any of these services if they go down and will notify you by email. It’s on by default.

For MySQL specifically, make sure cPFence AutoMySQL is enabled. It does two things:

Monitors and kills slow abusive MySQL queries.
If a PHP script generates multiple slow queries that get killed within a 5-minute window, AutoMySQL flags and terminates the php script as well to stop abuse.

Also, don’t forget to apply the recommended CPU and RAM limits in your Enhance packages.

slimx

xyzulu Nah only does it in sql apparently.

twest

The systemd overrides work pretty much the exact same way and dead simple to setup and very reliable.

That being said, a simple UI for managing services/monitoring in the panel would be cool. I got $50 that says this gets implemented in 2-3 years 👍

xyzulu

slimx Nah only does it in sql apparently.

You are mistaken. sudo tail -f /opt/cpfence/app/owl/tmp/logs/main_log will show you what is being monitored. Anyway.. we're off topic now I think.

Edit: See the post above this one for the facts.

slimx

Yes sorry for the total hi-jack

cPFence Already added 13 days ago, cPFence Watchdog now supports:

Legend! You guys are amazing