lightseekorg/tokenspeed

TokenSpeed is a speed-of-light LLM inference engine.

View on GitHub
Python
Stars 2.9k
Forks 418
License MIT
Open Issues 85
Updated 10h ago