80 articles · 27 error fixes
llama.cpp
Fix the error in front of you, then understand the runtime underneath it.
- llama.cpp 'failed to allocate buffer for rs cache': Fix Recurrent-State OOM
- Constrained Decoding: How an LLM Can Follow a JSON Schema
- llama.cpp v0.6.0 Extended Batch API: A Migration Checklist