xorbitsai/inference

Xinference Enterprise · Self-hosting · Documentation [](https://pypi.org/project/xinference/) [](https://github.com/xorbitsai/inference/blob/main/LICENSE) [](https://actions-badge.atrox.dev/xorbitsai/inference/goto?ref=main) [](https://hub.docker.com/r/xprobe/xinference) [](https://discord.gg/Xw9tszSkr5) [](https://t.me/+nCNpwmySwk9iYmI1) [](https://twitter.com/xorbitsio) Xorbits Inference(Xinference) is a powerful and versatile library designed to serve language, speech recognition, and multimodal models. With Xorbits Inference, you can effortlessly deploy and serve your or state-of-the-art built-in models using just a single command. Whether you are a researcher, developer, or data scientist, Xorbits Inference empowers you to unleash the full potential of cutting-edge AI models. 👉 Join our Discord community! · Join our Telegram group! 🌟 Model Serving Made Easy: Simplify the process of serving large language, speech recognition, and multimodal models. You can set up and deploy your models for experimentation and production with a single command. ⚡️ State-of-the-Art Models: Experiment with cutting-edge built-in models using a single command. Inference provides access to state-of-the-art open-source models! 🖥 Heterogeneous Hardware Utilization: Make the most of your hardware resources with ggml. Xorbits Inference intelligently utilizes…