I have similar things happen if I stop certain supplements. I think Niacin and vitamin-D are the most important to stop positive symptoms.
Actually I think the olanzapine is giving me positive symptoms somehow, because I never heard all my thoughts getting spelled like sentences in my head before I started with it. And the short while I switched to Latuda my mind went completely quiet.
I hope you find something that works for you. Did you ever try to drink green tea? I think that is pretty low price, although you get the caffeine from it as well. But it’s much milder caffeine than from coffee.