Problems with contrast after unlocking screen

I've had Z3 since january and never had any problems with it. Yesterday I installed 5.1.1 Nordic build and while all went smoothly I have this problem with contrast or gamma right after unlocking screen. It goes all the way up, stays crazy for a few seconds and than goes normal. It is incredibly annoying. It is not brightness which goes way up, but contrast or gamma as it washes out the colors and looks horrible.

It happens only if Adaptive brightness is turned on, and no matter if it is dark or light outside. Tried playing with X-reality but no change.

I really have no idea what is going on, so any ideas are welcome.
Thank you for your time!