DeepSparse Server
DeepSparse is an inference runtime taking advantage of sparsity with neural networks offering GPU-class performance on CPUs.
Open WebUI
Open WebUI is an extensible, feature-rich and user-friendly WebUI for LLMs.
- CategoryAI
- AuthorKoyeb
- Websiteopenwebui.com
- Repositorygithub.com/open-webui/open-webui
- TechnologiesOpen WebUI, Ollama, Docker
GPUs are available on Koyeb! Get ready to deploy serverless AI apps on high-performance infrastructure. Deploy today!
Best GPUs
Want to make your private ChatGPT blazing fast? Deploy AI workloads on the best GPU Instances today!
Overview
Open WebUI is a ChatGPT-like web UI for various LLM runners, including Ollama and other OpenAI-compatible APIs.
It's hard to name all of the features supported by Open WebUI, but to name a few:
- 📚 RAG integration: Interact with your internal knowledge base by importing documents directly into the chat.
- 🌐 Web Browsing Capability: Integrate websites into your experience.
- 🗣️ Voice Input Support: Engage with your model through voice interactions and enjoy the convenience of talking to your model directly.
- 🎨🤖 Image Generation Integration: Seamlessly incorporate image generation capabilities using options such as AUTOMATIC1111 API, OpenAI DALL·E and others.
- 👍👎 RLHF Annotation: Empower your messages by rating them with thumbs up and thumbs down, followed by the option to provide textual feedback, facilitating the creation of datasets for Reinforcement Learning from Human Feedback (RLHF).
Open WebUI also offers great flexibility and configurability, so in practice, you can have your own private ChatGPT suited to your needs.
Try it out
This example app deploys Open WebUI together with Ollama, which simplifies running the latest state-of-the-art models.
Once the Open WebUI server is deployed, you can start interacting with it via your Koyeb App URL similar to: https://<YOUR_APP_NAME>-<YOUR_KOYEB_ORG>.koyeb.app.
Pull the model you want from Ollama and start using your private ChatGPT lookalike!
