Reducing size of control panel server - urgent help required: Page 3 - Enhance Control Panel

Reducing size of control panel server - urgent help required

cPFence

Welcome. You can also try this:

sudo journalctl --vacuum-time=10d

This will keep only the last 10 days of logs in the journal. We've seen this free up as much as 10GB! of space on some busy servers, so we include it in our daily cron jobs as a standard practice.

meditatingsurgeon

cPFence - I've actually had to reduce it to 1 day. It's my fault for being so short-sighted when choosing the server (35GB) for the control panel. I had around 22GB remaining after the panel was installed.
I did have a look at the files listed with the scripts you mentioned. Unfortunately, it doesn't look like any of the larger files can be deleted.
I'm really not sure what is taking up so much space, as I don't host any sites on this server.
Thanks again for your help though.

cPFence

meditatingsurgeon

Yes, 35 GB can be quite restrictive. However, you should be able to free up a few GB if you're not hosting any sites on this server.

Try running the following command and share the output so we can get a better idea of what's taking up the space:

du --exclude='/var/container_tmp/*' --exclude='/var/lib/docker/*' --exclude='/var/local/enhance/*' --exclude='/proc' --exclude='/sys' -h / 2>/dev/null | awk '$1 ~ /[0-9]G/'

meditatingsurgeon

cPFence I got this output:
1.2G /var/log
1.4G /var/enhance_container_images/jammy/usr
1.8G /var/enhance_container_images/jammy
1.3G /var/enhance_container_images/focal/usr
1.7G /var/enhance_container_images/focal
5.5G /var/enhance_container_images
7.2G /var
2.6G /opt
1.1G /usr/lib/firmware
2.7G /usr/lib
3.9G /usr
14G /

cPFence

meditatingsurgeon 5.5G /var/enhance_container_images

I see, just make sure you are running the latest version of appcd by executing the following commands:

apt update
apt install appcd

After updating, you can safely remove the old images directory by running:

rm -rf /var/enhance_container_images/

Please ensure that you are running the latest Enhance version before doing so.

meditatingsurgeon

I would presume that
1.3G /var/enhance_container_images/focal/usr
1.7G /var/enhance_container_images/focal
would be okay to remove as I am running 22.04 but I am hesitant to do anything with the control panel.

meditatingsurgeon

Unfortunately, I can't log into the panel as the memory is full; I doubt that I would have been able to update without freeing up memory first. I know I am at least one version behind.
From what you have written, to clarify it would not be okay to run: rm -rf /var/enhance_container_images/ before updating Enhance.

as it stands I can't run apt upgrade - not enough memory!
I may be brave and delete:
1.3G /var/enhance_container_images/focal/usr
1.7G /var/enhance_container_images/focal
and then try updating unless any other suggestions.
Thank you for your advice cPFence 🙏

cPFence

meditatingsurgeon

I would recommend trying to free up a bit of space to regain access. You can safely clear some log files. Try these commands:

sudo truncate -s 0 /var/log/syslog /var/log/auth.log /var/log/kern.log 
sudo truncate -s 0 /var/log/rspamd/rspamd.log
sudo rm -f /var/log/rspamd/rspamd.log.* 
sudo rm -f /var/log/*.gz /var/log/*.1 /var/log/*.2
sudo journalctl --vacuum-size=5M
sudo apt-get clean
sudo rm -rf /tmp/* /var/tmp/*

This should give you enough breathing room to log in and run updates without removing any core files.

meditatingsurgeon

cPFence - thanks I got 790MB back, but not enough to do apt upgrade and I still can't get into the panel.
I think I will wait till the morning then send in a ticket to Enhance re: core files. Thanks again

cPFence

meditatingsurgeon

Since you don't have any sites installed, you can safely remove old PHP versions to free up additional space, this should give you around a gigabyte or so.

sudo rm -rf /opt/ecp-php56
sudo rm -rf /opt/ecp-php70
sudo rm -rf /opt/ecp-php71
sudo rm -rf /opt/ecp-php72
sudo rm -rf /opt/ecp-php73
sudo rm -rf /opt/ecp-php74

This should help create enough room to run apt upgrade and regain access to the panel.

If you need them back later, you can reinstall all PHP versions with:

sudo apt install --reinstall appcd ecp-php{56,70,71,72,73,74,80,81,82,83}

meditatingsurgeon

cPFence - thanks, I was thinking about this but recall @Adam advising against this

Adam Please don't try to remove these manually - it could easily break your system and they will be replaced whenever appcd updates which would lead to your server being out of disk.

but it would allow me to upgrade Enhance then allow me to run: rm -rf /var/enhance_container_images/

cPFence

meditatingsurgeon thanks, I was thinking about this but recall @Adam advising against this

We’ve done this before in a similar situation without any issues, even after a restart. After fixing the issue, we reinstalled all PHP versions running:

sudo apt install --reinstall appcd ecp-php{56,70,71,72,73,74,80,81,82,83}

That said, since this isn’t an emergency, it might be best to wait for Adam to help resolve it for you.

DracoBlue

Check:
docker image prune -a
And
docker system prune -a

meditatingsurgeon

@cPFence DracoBlue
The office I got from @Adam today was:
You should not remove /opt/ecp-XX but you can delete /var/enhance_container_images completely if you have a recent version of Enhance/appcd.

What he suggested and what worked was:
rm -rf /var/enhance_container_images
apt update
apt install appcd

Hope this is of use to someone 🙂

meditatingsurgeon

Adam Agreed. Run docker image prune -a instead.

Hi @DracoBlue docker system prune -a is not advised. Thanks for looking in.

SolidNetwork

This is a really useful post for newcomers, I was probably about to make the same mistake and rent a 40GB or 64GB vps for the enhance panel role thinking I would be safe with 2 or 3 times the recommended size.

I currently host around 50 websites (including some small eshops) for my clients that are spread accross 1 CPanel and 3 CyberPanel servers and want to slowly migrate them to a clustered environment with Enhance.

So, I am leaning towards the following configuration:

Server 1: Control Panel Role + DNS Role
Server 2: Email Role + DNS Role
Server 3: Backup Role
Server 4: Application Role + Database Role

Then expand to more App + DB role servers as we go..

How much storage would you recommend for the Control Panel server to have so that I don't run into space problems like meditatingsurgeon in this thread anytime soon?

Also I wonder if it would be beneficial to add a 3rd DNS role to the backup server too, but maybe that's for another thread..

cPFence

SolidNetwork How much storage would you recommend for the Control Panel server to have so that I don't run into space problems like meditatingsurgeon in this thread anytime soon?

If you’re only using the main Control Panel server to manage sites rather than host them directly, a 60GB VPS should be sufficient to avoid running into space issues. However, I’d recommend choosing a provider that offers the flexibility to scale up your resources if your needs change over time. Hetzner Cloud, for instance, is a solid choice for easy and cost-effective scaling.

SolidNetwork Also I wonder if it would be beneficial to add a 3rd DNS role to the backup server too, but maybe that's for another thread..

You can technically add the 3rd DNS role to any VPS, but it’s usually best to keep your backup VPS dedicated solely to backups for optimal reliability. You might want to look into getting an affordable VPS for the backup role instead. For setting up your backup server, you may find this guide helpful. Good luck!

grradmin

cPFence
Do you perhaps know the steps to increase the disk size after scaling up on Hetzner cloud?

Most VPS solutions will run a script after scaling up to resize the disk etc. just a stop/start is normally the only thing required by the customer but for some reason Hetzner cloud doesn't automatically resize the disk.

I'm pretty sure I know the correct procedure but any confirmation would be greatly appreciated and will assist in me being able to do it without putting my nappy on 🙂

SolidNetwork

cPFence Thank you for the advice! I'm just waiting for any potential Black Friday offers now before launching my Enhance project.

I'm leaning towards Hetzner Cloud (CX32) for the Control Panel + DNS1 Role (4C/8GB RAM/80GB Storage).

Then a root server (RS 2000 G11) on Netcup for the App+DB role (8C/16GB RAM/512GB Storage).

Also read thoroughly and loved your guide on the Backup Role setup too, so I will most likely use your recommended AlphaVPS (2C/2GB RAM/1TB Storage) package for it and I'll probably also get cPFence for some extra peace of mind.

Now I'm just wondering regarding the Email Role + DNS2 Role server.. I mainly set up my clients to use POP3 without leaving copies of emails on the server, so it should just handle the service - it's not inteded to grow large on email storage.

Would the CX22 option on Hetzner 2Cores/4GB RAM/40GB Storage be sufficient for it?
In other words will the Mail Role server also grow large, just like the Control Panel Role in Enhance?

meditatingsurgeon After clearing up the enhance_container_images and updating appcd how much is your total used/free space on the Control Panel server now?

cPFence

grradmin Do you perhaps know the steps to increase the disk size after scaling up on Hetzner cloud?

Most VPS solutions will run a script after scaling up to resize the disk etc. just a stop/start is normally the only thing required by the customer but for some reason Hetzner cloud doesn't automatically resize the disk.

I'm pretty sure I know the correct procedure but any confirmation would be greatly appreciated and will assist in me being able to do it without putting my nappy on

Yeah, Hetzner should handle this automatically, but sometimes they skip it for some odd reason.

First, activate backups and take a recent one manually, just in case something blows up!

Then, check your setup with lsblk. After that, run something like this (assuming /dev/sda1 is your path):

parted /dev/sda
resizepart 1 100%
quit
# then resize the file system
resize2fs /dev/sda1  # assuming you’re on ext4; if it’s xfs, use xfs_growfs /

cPFence

meditatingsurgeon You should not remove /opt/ecp-XX but you can delete /var/enhance_container_images completely if you have a recent version of Enhance/appcd.

Thanks for the update. We were on an old version, so we had no choice but to remove the old PHP folders to free up some space. As soon as you update appcd, they will get back anyway.

« Previous Page Next Page »