Same for me, automatic connection doesn’t work.
For manual connection inside gaming mode I use this decky plugin: https://github.com/steve228uk/TunnelDeck
Saves me from having to go into desktop mode, connect, then back. I’m never sure if it the connection stays alive.
Can’t you install Retroarch with emudeck and use that frontend to play GBA instead?