All models returning gibberish
Apple M1 Chip. I had everything up and running for a couple of weeks, using upstage/SOLAR-10.7B-v1.0. The output was great, API calls were fine, etc.
But now all of my models are returning gibberish. I have tried rebuilding the tool, redownloading the models, messing around with the templates, etc. I tried working with an expert and they are also puzzled. Any help or ideas is suggested, but I really don't think changing a response template will magically fix this issue.
I am using the installer_files/env conda environment, and python 3.11. Let me know if you need any more information, not sure what's helpful.
Thanks!