Why do I feel like an idiot when I don't have a helmet on in a bike trail?

I know I am not going to crash in a straight line with hardly any cyclists around, but why do I feel stupid and amateurish when I don't have one? I know that I won't fall or anything or get hit by a car.