Enhance v12.0.0 Released 🎉: Page 22 - Enhance Control Panel

Enhance v12.0.0 Released 🎉

xyzulu

cPFence Yeah, we’ll probably write a new script for backing up the backups and share it with the community since the old BTRFS script we shared earlier is no longer useful for v12 users.

I think you will want to use rsync.. we have the working now on v12 backups. It's a little messy (--include, --exclude etc) but it's working for us now.

cPFence

xyzulu

Yes, rsync fits this, but you’ll probably want to use -H instead of -L to preserve hard links. I haven’t fully dug into the structure yet, but it’ll likely be something like:
rsync -aHAX --numeric-ids
That should handle hard links, permissions, and everything else properly.

xyzulu

cPFence I've not used -H before.. will need to compare the differences with what I currently see.

cPFence

xyzulu

It’s a must if you want to handle the hard links properly. Also, no need to bother with excludes, just mirror the full backups folder using the command above, and you’re good to go.

At least there’s a positive side to moving away from Btrfs, backing up the backups is now much easier and more straightforward.

xyzulu

v12 upgrade note (I have opened a ticket): There are a number of logs/large files in /var/local/enhance that should be removed (in my opinion) after the upgrade. Perhaps this was already planned? In any case, until we can move the control panel role (waiting for documentation) keep an eye on your control server disk space.

Edit: I've had a reply to my ticket.. not as much of a concern as I thought.. but still, there is still logs files in there that are not needed (if space is an issue for you).

xyzulu

cPFence it’s still a bit of a mess (disk usage, leftovers from btrfs etc).. but perhaps once the backup bugs are sorted it will be a little more straightforward.

PS our backup of the backups might be different to your use case. We’re seeing only copying the ‘current’ folder using -L as being suitable to our needs. But, we will continue to explore our options.

cPFence

xyzulu

We’re planning to start fresh on ext4, it’s not worth the hassle. We’ll keep the old Btrfs backup server running alongside the new one until the backups build up, then retire Btrfs for good.

And yes, if your goal is just to backup the current files, that’s a different story.

xyzulu

Screenshots working for others? They are not working for me. I have reported it as a bug.

anturk

xyzulu

Some sites it works and on some it doesn't but the ones that do are maybe because these came from with v11 to v12 upgrade.

Kosta

xyzulu on old upgraded cluster my screenshots working but on my new cluster where I installed v12 they doesn’t seems to work yet.

xyzulu

cPFence We’re planning to start fresh on ext4, it’s not worth the hassle.

I still think btrfs offers some benefits for this kind of file storage (with some limitations as well). We will stick with btrfs for now, but if we run into any issues, we will switch to ext4 (reformat the attached hard disk) for our /backups partition (now you only need to specify a mount point, not a device).

Thinking out loud: I wonder how Enhance would cope if you deleted the current /backup partition and reformatted? Really, the correct ownership and users etc should be set with the first backup sync.. I'd probably check with Enhance first if we did try this in the future.

xyzulu

anturk pressing the refresh screenshot works for you?

anturk

xyzulu

Nope i only see hourglass on the ones that don't have a screenshots and the ones that have screenshot don't update to a new screenshot of the site when i press refresh

Kosta

xyzulu its keep spinning to update on upgraded cluster

mbe81

xyzulu

Yes, I have it working. It was a problem with ownership. I used the following command to fix it:

chown orchd:orchd-redis /var/www/control-panel/screenshots/*

anturk

xyzulu

Do you use rsync to just make another copy for "just in case" scenario?
Didn't think about using rsync since there is already S3 integration and the backup server is on a separate server.

xyzulu

anturk Do you use rsync to just make another copy for "just in case" scenario?
Didn't think about using rsync since there is already S3 integration and the backup server is on a separate server.

We use rsync to push a snapshot of the Enhance backups to another server in our local datacenter.. and then we back that server up each night to a remote location. So, we have backups and a copy of the backups stored elsewhere. rsync works well for this purpose and it's fast since the data is all local.

AdamR

Screenshots are not working for us either, I don't think anything has changed there. Same with things like the purple setup list for new users, that still pops up multiple times a day.

The backups are my big concern, are they not using hard links and incremental any more ..? Our backup server disk usage has more than tripled the disk usage in just a few days and it is still climbing rapidly, even after the 12.0.16 fix and backups supposedly being back on their normal schedule. At this rate we will have the server filled up in no time.

rdbf

AdamR The backups are my big concern, are they not using hard links and incremental any more ..? Our backup server disk usage has more than tripled the disk usage in just a few days and it is still climbing rapidly, even after the 12.0.16 fix and backups supposedly being back on their normal schedule. At this rate we will have the server filled up in no time.

Correct, de-duplication is broken in many setups. There's something on the hard-link implementation not playing nice, whether that's based on filesystem, the 'remote' triggering of backups, split email/web setups or anything else. The team has been aware for a couple of days, and probably know what it is, but implementing a fix is proving challenging.

Only end-user fixes available now for V12 are temporarily decreasing backup frequency and/or minimizing retention.

Kosta

I was waiting to see how backups will perform as it was set for 02:34 local time. So from a server with 10-15 websites doing backups (some 30GB some 1GB ) on my backup role server yesterday I had 123.15GB used backup space and today after the backups taken place I went up to 123.39GB. I don’t think website files was changed but I think the uplift of 0.24GB is due to the new DB shots taken.
Is this seems like correctly working backups ?

xyzulu

Kosta Is this seems like correctly working backups ?

That does seem about right to me.

cPFence

Kosta

Interesting. To verify, try this:

cd /backups/<any-wp-based-website-id>/

ls -li ./snapshot-*/home/public_html/wp-config.php

Then share the results here.

Kosta

xyzulu right thank you, by the way if that helps I didn’t input any terminal commands to the backup server for permission or something else I was just doing apt upgrade update when newer version was coming up… (use to be like 60GB total backup space on v11 but I had setup with 4h backups policy and I changed few days ago to 1day policy to cope with the uplift)
I will deploy today on my new cluster backup role to see how it performs there the system…

« Previous Page Next Page »