I’m trying to follow your description and no longer sure if it’s a single issue or a combination of different ones, but you can try to disable power saving to better isolate the root cause:
How to keep internet connection connected without interruption - #4 by vgaetera