To be honest I'm surprised you didn't run into more issues with a setup like that. Ideally, you need to use a separate camera for your UI, and this camera must be stationary. You can have it match the field of settings of your game camera, but it should still stay in one place. You'll get better performance, and issues like the one you mentioned, and the UI being delayed by one frame will disappear.