Enhance Disk Usage

Zoinkies

standtech would be good if we could set these via UI

blackpoint

Hello,
yes, I have also raised this issue with Adam from time to time and really hope that there are optimisations at this point. We also have a server with a VSite with not even 200 MB and I admit 10 GB of mailboxes. But all in all 34 GB are used on the server and I have already manually deleted a couple of php directories in /var/enhance_container_images/.
I also find that the overhead per server is relatively large and would very much appreciate if there were ways to limit this. Also, the amount of log files under /var/local/enhance/email/data/logs/postfix/, /var/local/enhance/email/data/logs/dovecot/, /var/local/enhance/email/data/logs/rspamd/ is a bit high in my opinion.
best regards,
Dirk

Adam

blackpoint manually deleted a couple of php directories in /var/enhance_container_images/

This is risky because they will be re-created when appcd updates and if you're relying on this to maintain free space on your server it could mean that the disk suddenly fills up next time you apply an update.

There will soon be an official way to disable unused PHP versions.

Email log retention will be configurable in future too. You are free to delete log files if they're not needed. You could potentially do this with a cron job.

Dan

Adam There will soon be an official way to disable unused PHP versions.

Hopefully this isn't limited to the application servers as they're also consuming almost all of the disk space on our nameservers.

Adam

Dan

On a DNS server you can disable every PHP version since it's not required. On a mail server you need to retain PHP 8.1 for RoundCube but all other versions can be disabled. On an app server it's at your discretion - the customer will only be offered the versions which are supported on the server their website is assigned to. This can be further limited on a per-package basis.

Dan

Adam I assume by "you can" you mean "you will be able to"? As currently we only have the DNS role on our nameservers but the images are still downloaded with apparently no way to stop them.

briansmith84

Yeah this is crazy. I installed 4 WP's and did nothing to them, and it's been about a month, and 48gb is used.....

standtech

briansmith84 We have been running single wp for testing for more than a month with no drastic log accumulation without even tweaking rotation. There must be something wrong with the system for such a large log size. check the logs , tune it.

MediaLabz

When I first installed, about 5% of available space was already used on all my servers but I was told this was normal. Its quite crazy because I have about 200GB being used on a server with 4TB of space that is 'unaccounted' for.

Adam

MediaLabz

Does 200GB actually show as being used in the output of df -h? If so this is definitely not normal.

If anyone has disk usage they can't explain, please run:

du --max-depth=3 --exclude=/var/lib/docker/overlay2 --exclude=/var/local/enhance/containers --exclude=/proc --exclude=/sys -h /

and

du --max-depth=2 --exclude=/var/local/enhance/containers /var/local/enhance -h

Then either post the results here or send a support ticket.

Be aware this will consume a lot of disk i/o. If your server has slow disk i/o or is heavily loaded, maybe run it at an off-peak time.

ordinary

Dan @Adam Has there been any update on this? Looking for a way to disable PHP versions on a Backup only server. The "enhance_container_images" dir is currently consuming 6.1GB.

xyzulu

ordinary I can't see anything on the Roadmap, but the last reference I saw from @Adam was this one: https://community.enhance.com/d/104-cleanup-docker-to-save-disk-space/7

Adam

ordinary

There is another appcd update coming which removes the need for the separate chroot.

ordinary

Adam Thanks Adam! Is this it the one due this week?

Will the option to remove the unused containers be available through the UI?

Adam

Yes it should be this week or early next. Once you update and once all containers have been restarted you will be able to remove /var/enhance_container_images entirely. You'll need to do it through the terminal, it won't be added to the UI.

ordinary

Adam Just double checking on this:

I'm now running 11.0.4 on my estate. Is it now safe to run "rm -rf /var/enhance_container_images/" on all my servers?

Should I reboot all the servers beforehand or is there anything I need to check first?

Adam

ordinary I'm now running 11.0.4 on my estate. Is it now safe to run "rm -rf /var/enhance_container_images/" on all my servers?

The most important thing is that you're running appcd >= 4.0.0. Run:

apt update
apt install appcd

Then it should be safe to remove that directory. No reboot is required.

Oldschool

Just to verify, if we've upgraded the estate and the backup server to the latest and greatest, it's safe to "rm -rf /var/enhance_container_images/" ?

Similar position, my backup server is only running backup role, assuming it doesn't need the 5.4GB of php versions in there?

If I rm -rf this bad boy is it going to recreate later on updates?

Thanks!