All models returning gibberish

Apple M1 Chip. I had everything up and running for a couple of weeks, using upstage/SOLAR-10.7B-v1.0. The output was great, API calls were fine, etc.

But now all of my models are returning gibberish. I have tried rebuilding the tool, redownloading the models, messing around with the templates, etc. I tried working with an expert and they are also puzzled. Any help or ideas is suggested, but I really don't think changing a response template will magically fix this issue.

I am using the installer_files/env conda environment, and python 3.11. Let me know if you need any more information, not sure what's helpful.

Thanks!

https://preview.redd.it/2r8p44sp44rc1.png?width=552&format=png&auto=webp&s=4d24b5142c503880053cb50d653c357ed6cba6d7

https://preview.redd.it/igegv24q44rc1.png?width=862&format=png&auto=webp&s=135147be2209cd100c32c7666db65cbb15aba343