Im having the exact same issue.
I have a 3080
I7 8700k
Windows 11
I made sure nvidia drivers are up to date. I tried both borderless and full screen setting.
Heres a video:
The video doesnt capture it, but the way to temporarily fix it is to alt tab or press the windows key but the issue will just start again as soon as you try moving the camera around.