Lightning-AI/LitServe

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

View on GitHub
Python
Stars 4.0k
Forks 333
License Apache-2.0
Open Issues 81
Updated 20h ago