NPROC limit on every account?

PradeepC

We too have faced the same issue sometime back. We also have NPROC set to around 50 and a random client uses up all the 50 processes and the CPU load goes over 60-70. I think there is a glitch in Enhance Hard Resource limits and CPU is not assigned properly to the customers.

Adam

The system resource limits are hard limits and cannot be exceeded. They are applied per website not per subscription. The nproc limit will stop processes being spawned, the memory limit will stop processes from allocating additional memory however the CPU limit simply slows down the process. Therefore you should set an appropriate nproc limit alongside the CPU limit.

My recommendation for nproc would be 10 for low end shared hosting and 20 for high end shared hosting. This allows some headroom for cron and customer ssh processes which also count towards the limit.

PradeepC

Adam One more important thing, why is the hard resource limit per website and not per subscription? I firmly believe that it should be per subscription model.

PradeepC

@Adam, We allocate only 1 website/account and then rest are add-on domains. If we set it to 10 even a single website/account using WordPress will start showing 503 errors with a few visitors and some updates going on in the backend. Never happened with cPanel and Cloudlinux when we were using it previously.

Adam

PradeepC We allocate only 1 website/account and then rest are add-on domains. If we set it to 10 even a single website/account using WordPress will start showing 503 errors with a few visitors and some updates going on in the backend. Never happened with cPanel and Cloudlinux when we were using it previously.

If you use addon domains then they will share a unix user and php-fpm/lsphp instance (like with other control panels) and will be subject to the same limit. Nproc between 10 and 20 in my experience is enough for shared hosting with moderate traffic but this will be affected by the virtual cpu limit as well as the CPU speed.

prasad0889

@Adam if the hard resource limits cannot be exceeded why does the server load increase so much and then the server becomes unresponsive? @badboybackagain is also facing the same issue.
@badboybackagain do you use Apache or LiteSpeed or OpenLiteSpeed?

Adam

PradeepC Adam One more important thing, why is the hard resource limit per website and not per subscription? I firmly believe that it should be per subscription model.

On Enhance the websites for a subscription can be placed on different servers. In future we may be able to offer a setting to apply an optional per-subscription limit by restricting website placement for a subscription to a single server. However you would probably want to use this in conjunction with the per-website limit if your goal is to manage server resources and mitigate high load since the per-subscription limit would need to be much higher.

Darren

What is your CPU limit set to for the account when you see the high CPU usage?

You also have to factor in that MySQL can be incredibly intensive if a site is inefficient, and there is no way (yet) for Enhance to monitor/police MySQL usage.

PradeepC

@Darren We have seen it happening for users from 1 CPU Core 4 CPU Cores.

AdamM

This is the PHP issue I mentioned in another thread. There are too many php processes being created. By default in litespeed it is 100...

Adam

AdamM This is the PHP issue I mentioned in another thread. There are too many php processes being created. By default in litespeed it is 100...

The LSAPI worker limit is set to 100 and currently can't be overridden in Enhance - this functionality is coming soon. However it will only spawn workers as required (it will start with 1) and is subject to the nproc limit. If the nproc limit is set, lsphp will not be able to fork processes above that limit.

PradeepC

You are right @AdamM, it happens the same here, too many PHP processes are being created and that creates an issue.
@AdamM how did you mitigate this issue?

AdamM

I set the nproc limit, it helps protect the server from huge resource consumption but it's not a good solution because it returns http errors.
This happens when wordpress doesn't use cache. I make sure that the client's websites always have the litespeed cache plugin active.
This can be prevented by setting admin > virtual hosts > external app > max connections in litespeed setting a number less than 100.
But... These settings currently do not work and are not saved...

I have discussed this issue with Adam many times. We need the ability to edit these settings and a permanent saving. It's also best to have your own default settings, set by us in the enhance Control panel. I believe litespeed needs v3 and improvements. Many things are not working properly yet.

PradeepC

Thanks @AdamM for your answer. We have also used the nproc limits, but it creates a lot of 503 errors and the clients become disappointed with the performance. We host multitude of clients with lots of different systems other than WordPress so can't activate caching for their apps.

So as per your saying, we can mitigate it if the settings are saved correctly?
This needs to be done on priority then as it will cause us more harm in terms of client dissatisfaction than benefit.

AdamM

PradeepC
https://community.enhance.com/d/269-stress-test

If the enhance team releases a fix for proper setting and saving it should help. You will be able to set, for example, 1 php process that will not return errors anymore and will simply handle less requests but will not crash the server.

In OpenLiteSpeed this setting works. It means a only change untill next ols reboot because it is not saved permanently. You can test it, setting example . max connections to 1

PradeepC

AdamM The max connections set to 1 meaning this will be per user or for the overall system?

AdamM

PradeepC No. For virtual host - domain

Zoinkies

I’m using LSE on cPanel and a lot of my configuration isn’t working on Enhance yet. I believe LS spawns a lot of processes, I have a test server running Apache and weirdly enough seeing less CPU utilisation.

PradeepC

@Adam and @Darren this seems to be a problem that is being faced by mostly everyone.
It would be great if you could help fix the issues soon!

Zoinkies

Adam What settings would you need for a website to access full CPU speed, but only 2 core?

Adam

Zoinkies

vCPU of 2 will allow CPU usage up to the equivalent of 2 cores - that could be a single process at 200% CPU or 4 processes at 50%. The more processes the website has, the less CPU each process will have available. This is why, if you are limiting CPU, you should also limit nproc to prevent processes from building up.