I just swapped from NVidia to AMD, since Proton was not working under NVidia for Starfield at launch (and I’ve generally been unhappy using NVidia for a while).
I can finally also use things like Wayland where NVidia just doesn’t support it well enough to be a good option (e.g., weird issues with full disk encryption unlock screen, no night light support)
I know CUDA and productivity apps might push you in the other direction, but if your main priority is gaming, I suspect AMD will be nicer. My first impressions is that it plays way better with Linux and reduces headaches that shouldn’t exist but you’ll deal with under Nvidia.