15 years ago I tried amisulpride and that killed my libido, but it recovered when I was off the aps for awhile. Risperidone, paliperidone and quitiapine didn't affect my libido too much. It's the older aps that do for me. Try changing your med if the doc allows it.
I'd say it was very important since I can't do recreational drugs anymore, all that is left are orgasms and to be without even that would make my life very miserable indeed. Reason enough to switch ap if you ask me.