Enhance v12.0.0 Released 🎉: Page 24 - Enhance Control Panel

Enhance v12.0.0 Released 🎉

AdamM

Kosta you want only delete old btrfs snapshots?

for all websites
btrfs subvolume delete /backups/*

only specific website
btrfs subvolume delete /backups/3f4dd773-133b-44bd-b2fb-d1d7efb4f03d/*

Kosta

AdamM thank you I will try to identify first old ones in the weekend and give it a try

pratik_asabe

Kosta so the new feature expansion (ext4 support) in backup system works well, but btrfs has still ongoing issues? Can you please confirm by testing more?

Kosta

pratik_asabe can you not spend 30$ for 3-4 VPS at hetzner to create new cluster and experience it yourself? I don’t have much time to change filesystems currently… it’s very easy to create new cluster with enhance won’t take you long.
Hint: attach automatically ext4 volume to your VPs and use the name of this volume /mnt/VCD-xxxxx name when u mount the backup role or mounted it manually with btrfs if you wish. But as far I know btrfs ain’t good for security compliance

I don’t have issues with my old cluster which is on btrfs!

gozen

Anyone tried to restore backups from old version to new?

Kosta

gozen I will try in the weekend but I found it bit risky especially old to new system

bluelinq-computers

gozen not yet without Adam's assistance

wpflys

So I decided to switch my backups to ext4 by creating a new server and migrating.

Created a new VPS server
Attached ext block storage to it mounted it as /backups
Installed in enhance, with DNS, and backup roles.
Started server move process.

Most sites failed do to permission "Data migration failure: internal: Backup rsync transfer failed: rsync: [sender] opendir "/backups/2c3d6a7b-b7c2-4605-9015-67f1318229ac/snapshot-1739695037490/email" failed: Permission denied (13)"

Before migrate I did run update && apt install ecp-core and v12-upgrade fix-backup-permissions /backups

I did notice that owner permissions on sub folders fluctuate between 2063 and 2c3d6a7bb7c24605901567f1318229ac. So maybe the v12-upgrade fix-backup-permissions /backups is not updating all snapshots.

I did remove the snapshots with the wrong file permission and it let me migrate to the new backup sever.

Adam

v12-upgrade fix-backup-permissions gives you the commands to run, it doesn't run them. If you run those commands, it will solve your permission problem.

wpflys

Adam I ran v12-upgrade fix-backup-permissions /backups many times.

bluelinq-computers

Adam I've run the suggested commands to run and I'm still experiencing permission issues.

wpflys

LOL I read that wrong LOL and now know what to do

DracoBlue

12.0.18
20th February 2025

Fixed

Backup de-duplication was not efficient for websites assigned to separate application and email servers.
Important please apply this update to all of your servers at the same time.

rdbf

I'm pleased to report something has changed on the backup situation. Using separate web/mail servers, and a backup server with separate block device formatted as btrfs.

Until now, all backups looked like this:
.......
19M /backups/8f32337b-7947-4ade-a50f-6d793462ec3b/snapshot-1740073637825
6.2G /backups/8f32337b-7947-4ade-a50f-6d793462ec3b/snapshot-1740085509859
19M /backups/8f32337b-7947-4ade-a50f-6d793462ec3b/snapshot-1740095359330
6.2G /backups/8f32337b-7947-4ade-a50f-6d793462ec3b/snapshot-1740096348260
137G /backups/8f32337b-7947-4ade-a50f-6d793462ec3b

After 12.0.18 update and running a manual backup it looks like this:
.......
19M /backups/8f32337b-7947-4ade-a50f-6d793462ec3b/snapshot-1740073637825
6.2G /backups/8f32337b-7947-4ade-a50f-6d793462ec3b/snapshot-1740085509859
19M /backups/8f32337b-7947-4ade-a50f-6d793462ec3b/snapshot-1740095359330
6.2G /backups/8f32337b-7947-4ade-a50f-6d793462ec3b/snapshot-1740096348260
22M /backups/8f32337b-7947-4ade-a50f-6d793462ec3b/snapshot-1740096827361
19M /backups/8f32337b-7947-4ade-a50f-6d793462ec3b/snapshot-1740096837628
137G /backups/8f32337b-7947-4ade-a50f-6d793462ec3b

The Control Panel interface is showing the full backup size for the manual one, so it seems de-duplication is now working for this setup. Now let's see if the total disk usage goes down today as large backups exceeding the retention period drop off.

xyzulu

I'm seeing some mariadb restarts are failing (crashing) after Enhance updates now.. it's a strange one.. mariadb just needs to be restarted. This isn't happening on all servers, but always the same servers that it happened on previously.

On restart of mariadb I see this in the status:

mariadbd[1093265]: 2025-02-21 12:43:09 0 [Note] Recovering after a crash using tc.log

I will open a ticket about this as well.

xyzulu

xyzulu some mariadb restarts are failing (crashing) after Enhance updates now

In my case mariadb was OOM killed.. so, I can't blame Enhance for this.. still.. mariadb didn't restart itself like it used to on docker

DracoBlue

xyzulu MariaDB should automatically recover if there are no corrupted tables.
Check the logs /var/log/mariadb/mariadb.log for more details.

Vendoz

How is going backup issue after 12.0.18 🙂 ?

Helix

Vendoz Backups seems to be solved for me now, working as expected (using btrfs).

Vendoz

Helix thank you for the feedback! I didn't specify it, but I assumed it: also the restore?

Thomas_W

xyzulu sounds like not enough memory available.
A solution could be to allow swap or innodb_flush_method=fsync or change the settings of mariadb to use less memory.

But it would be a good idea when Enhance checks automatically if MariaDB is alive and if not restart it if possible. I am still with Version 11 and had with Docker sometimes the issue that the MariaDB container not started, mostly after a update of docker. All another containers are fine.

« Previous Page Next Page »