michabbb · @michabbb
23 followers · 598 posts · Server social.vivaldi.net

With , you can run an inference with any and build powerful apps.

🔥 Flexible APIs: serve LLMs over or with one command, query via WebUI, CLI, our Python/Javascript client, or any client.

github.com/bentoml/OpenLLM

#openllm #opensource #llm #ai #restful #api #grpc #http

Last updated 1 year ago