I do struggle with this when it's a full on conversation, it is annoying when people think I'm intimidated when really I'm thinking "Where are my eyes supposed to be!!
"
My last therapist said that when I find myself over thinking it and looking away, I should try to do the opposite of what I'm doing, or something like that. I don't know how helpful that is because I haven't really tried it