Ecosystem & Stack: bentocloud
LLM Serving Framework
Docker
12.3k
bentoml/OpenLLM
Self-host and serve any open-source LLM as an OpenAI-compatible API endpoint with ease.
Replaces:
Details Self-host and serve any open-source LLM as an OpenAI-compatible API endpoint with ease.