Hmm, guess I'll have to try again. When I tried last time, a year ago or so now, the speed was comparable to VNC. The machine I tried accessing then was a i5 NUC which when used locally with KDE Neon is rather spiffy.

Resuming locally is also a must-have feature, so yeah that eliminates a lot of contenders on Linux.