Ideas: Why auditory voices is scary

Who: Auditory voices seem coming from nowhere.
It is unlike real person who I can see and hear.

What: Auditory voices often say words which are hurtful.
When: Auditory voices seem talking for long hours.
It is unlike real conversation which I can avoid or pause.

Conclusion-- It is scary probably because I could not identify the source of the auditory voices and avoid or pause them. No controls over the auditory voices.

Personally I feel it is good to know why.