Sage 300 2022 (PU1) Workstation clients - Random Database connection errors and terrible performance

We have Sage 2022.1 on our server which is performing perfectly (on the server or through RDP with our VPN firewall). We've installed the Sage Workstation (WSSETUP), ran the Database Setup which created the ODBC and the test connection is fine. Hours later or randomly we either get database connection error or just terrible performance where it's unusable.

Ping to the server through the VPN\Firewall is 17ms.