Website Transfer Bug

twest

This is a funny one... So the last transfer I did errored because Redis turns itself off, this was known and expected, but now there's another bug:

The database lost its connection.

I figured, eh maybe it just needs the password reset, so I download the wp-config.php and copy/paste the old password into the Enhance panel to reset the db user pass, except it errors that I need a special character in the password... The old db user pass didn't have a special char, so I guess it didn't take during the transfer?

I just added a special char to the db user pass reset, and added the special char to the wp-config file so they'd sinc, and it worked.

I really hope that doesn't happen during a server disaster recovery, that would be horrendous @_@

Adam

Were you going to/from the same version of MySQL? Were there any errors in the transfer log related to the password hash?

twest

Adam Yes same version MySQL, same webserver, all same.

Yes I found two errors from the control panel orchd log:

2024-01-20T06:18:25.586389Z ERROR ThreadId(47) orchd::website_migrator::role_mig ration: Unable to retain MySQL user password for redacted1_Pxs0 using hash Statu s { code: InvalidArgument, message: "Hashed password $A$005$\u{10}FI7;\u{14}JW]\ u{1d}ZL^Y\u{13}\u{12}\u{1}\u{e}}VCV/LQY.b9nfdk01jD3vuwwMVPVFhcQ4TN4u4cfSjms1 con tains disallowed characters", metadata: MetadataMap { headers: {"content-type": "application/grpc", "date": "Sat, 20 Jan 2024 06:18:25 GMT", "content-length": " 0"} }, source: None }
2024-01-20T06:18:26.015102Z ERROR ThreadId(47) orchd::website_migrator::role_mig ration: Unable to retain MySQL user password for redacted1_phpma using hash Stat us { code: InvalidArgument, message: "Hash cannot be empty", metadata: MetadataM ap { headers: {"content-type": "application/grpc", "date": "Sat, 20 Jan 2024 06: 18:25 GMT", "content-length": "0"} }, source: None }

Note I've never set a custom pass, nor changed the pass, and this website was moved between servers before when I was doing testing - so the password thing seems to be an issue with a recent update.

Adam

xyzulu I noticed the root mysql password listed in /root/.my.cnf doesn't appear to be the one that mysql cli is using if you connect directly to mysql. I didn't have spare cycles to investigate more.. as I still need to get my familiar with Enhance first.

If you run it as root then that is the password it is using. If you use the MySQL CLI as a website user, it will use a user which only has permissions on the databases belonging to that website.

twest 2024-01-20T06:18:25.586389Z ERROR ThreadId(47) orchd::website_migrator::role_mig ration: Unable to retain MySQL user password for redacted1_Pxs0 using hash Statu s { code: InvalidArgument, message: "Hashed password $A$005$\u{10}FI7;\u{14}JW]\ u{1d}ZLY\u{13}\u{12}\u{1}\u{e}}VCV/LQY.b9nfdk01jD3vuwwMVPVFhcQ4TN4u4cfSjms1 con tains disallowed characters", metadata: MetadataMap { headers: {"content-type": "application/grpc", "date": "Sat, 20 Jan 2024 06:18:25 GMT", "content-length": " 0"} }, source: None }
2024-01-20T06:18:26.015102Z ERROR ThreadId(47) orchd::website_migrator::role_mig ration: Unable to retain MySQL user password for redacted1_phpma using hash Stat us { code: InvalidArgument, message: "Hash cannot be empty", metadata: MetadataM ap { headers: {"content-type": "application/grpc", "date": "Sat, 20 Jan 2024 06: 18:25 GMT", "content-length": "0"} }, source: None }

I think we have found the cause for this one, it relates to mysql users which were created prior to version 10.0.0 with caching_sha2_password as their authentication plugin. We will release a fix.

Adam

Thanks for this. We are attempting to reproduce.

xyzulu

@Adam I wonder if this is related to the issue in the ticket I raised yesterday.

prismweb

We have had lots of issues especially around mysql and transferring of sites between servers. Looking forward to when that is resolved. Also the need to reset mysql and email passwords is absurd, but thats another topic.

xyzulu

I'm having many issues with this now .. all related to mysql moves (specifically the export of the db is seems). Quite frustrating.

The dashboard log error is always:

[11:14:55 01/22/2024] Data migration failure: internal: Command /usr/bin/mysqldump failed with non-zero error: 2

twest

xyzulu I think it's probably related to the last update that updated MySQL. Not sure what exactly is different now though! I do like that they updated the site transfers so the files transfer before the database because that helps reduce the downtime... But of course need the DB to keep working lol

Hope it's not a difficult fix, because I get sweaty palms thinking how this will affect disaster recovery.

xyzulu

twest Hope it's not a difficult fix, because I get sweaty palms thinking how this will affect disaster recovery.

Me too 😉

xyzulu

I noticed the root mysql password listed in /root/.my.cnf doesn't appear to be the one that mysql cli is using if you connect directly to mysql. I didn't have spare cycles to investigate more.. as I still need to get my familiar with Enhance first.

xyzulu

Adam We will release a fix.

Thanks Adam.. approx timeframe?

xyzulu

Adam it relates to mysql users which were created prior to version 10.0.0 with caching_sha2_password

Just to be sure.. I had issues with websites (Wordpress - database and users created by enhance app installer) I had created in Enhance on 10.2.0 and then moving them. Perhaps it's an issue that will also be resolved.. but I am just making sure.

Adam

It will be in 10.3.0, should be out by the end of the month.

Adam

xyzulu

That should not be happening. Please send a support ticket and we can investigate.

DracoBlue

xyzulu 10.1.0, 10.2.0 not released yet.

twest

Adam I'm getting this warning show up in container logs too, is it related to this issue? Just thought I would post it because I was debugging a different issue and grabbed 30 seconds of live logs and this showed up almost 500 times in that time span:

{"log":"2024-01-26T17:24:20.389374Z 518846 [Warning] [MY-013360] [Server] Plugin mysql_native_password reported: ''mysql_native_password' is deprecated and will be removed in a future release. Please use caching_sha2_password instead'\n","stream":"stderr","time":"2024-01-26T17:24:20.38960526Z"}

xyzulu

My ticket is TICKETWCJ-109-34967

xyzulu

Full disclose: My issue was that port 3306 was closed on the destination server. Turns out Enhance uses this port for db transfers. Sorry for the extra work @Adam and thanks for helping.