ggml-org/llama.cpp

LLM inference in C/C++

View on GitHub
C++
Stars 121.3k
Forks 20.9k
License MIT
Open Issues 1916
Updated 2h ago