Enhance panel not working and websites stopped being served

jacobtalbot

I've been looking into an issue and for the life of me cannot figure it out. The control panel for Enhance is not accessible and all websites are not being served. I have lodged a request with support but they're not likely to get to it for 7-8 hours because of the timezone difference.

xyzulu

Can you login via ssh?

jacobtalbot

xyzulu I can login via SSH

JohnB I can ping the server and get a response. I can confirm it's not the internet connection itself. It's not timing out, it's just presenting "Unable to Connect" straight away.

No services appear to be presenting on port 80 or 443. Web server was set to run using litespeed. Further debugging showing that lsws.service is not found

JohnB

all websites are not being served

Details? Timeout or server error? Assuming timeout.... Can you ping the server and get a response? DNS correct? Have you tried testing from another connection or use something like gtmetrix to rule out it not being your internet?

xyzulu

Assuming you have restarted the server already... what happened before this? Was the Enhance control panel also on this same server?

docker ps shows?

jacobtalbot

xyzulu Server was working fine up until about 24-36 hours ago. I didn't see the alert that a website went offline.

docker ps shows:

CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 343e38a5cb62 litespeedtech/litespeed:latest "/entrypoint.sh" 4 weeks ago Restarting (0) Less than a second ago litespeed b05045737220 mariadb:lts "docker-entrypoint.s…" 4 weeks ago Up 42 minutes 0.0.0.0:3306->3306/tcp, :::3306->3306/tcp mariadb 218599ee90a6 docker.enhance.com/ftpcd:1.2.2 "/bin/sh -c ./start-…" 4 weeks ago Up 42 minutes 0.0.0.0:21->21/tcp, :::21->21/tcp, 0.0.0.0:46881->46881/tcp, :::46881->46881/tcp ftpcd bd07e2b47663 docker.enhance.com/filerd:3.0.6 "./filerd" 4 weeks ago Up 42 minutes 0.0.0.0:10061->10061/tcp, :::10061->10061/tcp, 0.0.0.0:39223->39223/tcp, :::39223->39223/tcp filerd 447d1ccab72f docker.enhance.com/orchd:11.0.2 "/bin/sh -c ./orchd" 4 weeks ago Up 42 minutes 0.0.0.0:45983->45983/tcp, :::45983->45983/tcp orchd 8a3c4a6c985a docker.enhance.com/redis:6 "redis-server /usr/l…" 4 weeks ago Up 42 minutes 6379/tcp orchd-redis 14005814a5bf docker.enhance.com/postgres:11 "docker-entrypoint.s…" 4 weeks ago Up 42 minutes 5432/tcp orchd-postgres 2e0063e332ad docker.enhance.com/sged:3.2.2 "/bin/sh -c /usr/bin…" 4 weeks ago Up 42 minutes 0.0.0.0:33797->33797/tcp, :::33797->33797/tcp sged 3f119167d01f docker.enhance.com/authd:2.1.2 "./authd" 4 weeks ago Up 42 minutes 0.0.0.0:39527->39527/tcp, :::39527->39527/tcp authd bb74917e3277 docker.enhance.com/postgres:11 "docker-entrypoint.s…" 4 weeks ago Up 42 minutes 5432/tcp authd-postgres

Looks like the litespeedtech/litespeed is in a constant restart state.

xyzulu

Have you restarted the server? I can see you have your enhance dashboard on the same server.
There are some commands you can run to re-install the website or switch it.. ie to Apache. You might be able to find them here on these forums..

See, for example: https://community.enhance.com/d/1622-enhance-doesnt-work-anymore

jacobtalbot

xyzulu Have restarted a couple of times, yes.

It looks like the litespeed container restarts every 60 seconds or so. Appears to work for 2 - 4 seconds and then dies.

twest

Have you checked to make sure your Litespeed license is active? Try changing webserver to Apache:

appcd-cli 127.0.0.1 change-webserver apache

jacobtalbot

twest That's brought me back online. Thank you.

Will check what's going on with Litespeed now.

twest

jacobtalbot let us know if you discover anything, this kind of issue is unsettling to hear about lol

Do you happen to be running a antivirus program on your servers? I saw some old threads a while back where some firewall/av program people were using was conflicting with enhance and causing this same kind of erratic restarting behavior.

jacobtalbot

twest I am running BitNinja AV.

Looks like the issue was to do with the Litespeed license. If Litespeed license expires, the whole instance of Litespeed goes into a reboot loop - but it also takes out the Enhance control panel as well. There's no obvious notifications that this is the case either.

xyzulu

jacobtalbot usually you would have your Enhance dashboard on a separate server to your other sites.

jacobtalbot

xyzulu And yesterday was a good point for that, ha!

twest

jacobtalbot like xyzulu mentioned, it's a good idea to keep your control panel server separate from the hosting servers, but also Enhance recommends running plain Apache on the control panel server as well - safest option there all around.

I had a feeling it would be either the AV program or license, which is good because those aren't Enhance issues lol... Easy path to fixing for you going forward at least 🙂

josedieguez

it may be an idea, to auto-revert back to apache/ols if LS license fails?

i think that's the behaviour with cp.

vsmbg

This is how LiteSpeed works, sadly. Not only on Enhance but everywhere.
Auto-renewal for such critical services is a MUST. Otherwise, you saw what can happen 😃