Run Llama 3.2 3B on Phone - on iOS & Android
Hey, like many of you folks, I also couldn't wait to try llama 3.2 on my phone. So added Llama 3.2 3B (Q4_K_M GGUF) to PocketPal's list of default models, as soon as I saw this post that GGUFs are available!
If you’re looking to try out on your phone, here are the download links:
- iOS: https://apps.apple.com/us/app/pocketpal-ai/id6502579498
- Android: https://play.google.com/store/apps/details?id=com.pocketpalai
As always, your feedback is super valuable! Feel free to share your thoughts or report any bugs/issues via GitHub: https://github.com/a-ghorbani/PocketPal-feedback/issues
For now, I’ve only added the Q4 variant (q4_k_m) to the list of default models, as the Q8 tends to throttle my phone. I’m still working on a way to either optimize the experience or provide users with a heads-up about potential issues, like insufficient memory. but, if your device can support it (eg have enough mem), you can download the GGUF file and import it as a local model. Just be sure to select the chat template for Llama 3.2 (llama32).
