OMG I totally understand this. It's normal. I've honestly never found a good psychological way to deal with it. The best way I've found is to just stay as completely clear as possible.

If it's super bugging you, you can always look into CBT psychological therapy.