Turns out it kinda does fix me to swap my office around. (Still evaluating the window behind me + glare on the monitor potential issue.)

  1. Before
  2. After same direction
  3. After looking other way.

Office with desk on right under windows. Office with desk on left and chairs under the window. Office with desk on left and chairs under window.