koboldcpp + gemma

 AI

https://github.com/LostRuins/koboldcpp/releases/tag/v1.86.2

https://github.com/LostRuins/koboldcpp/wiki

https://huggingface.co/bartowski/google_gemma-3-4b-it-GGUF/tree/main