Hi Weaviate & Verba team,
I’ve opened a PR adding OrcaRouter as a native LLM provider in Verba: https://github.com/weaviate/Verba/pull/470
About OrcaRouter
OrcaRouter is an OpenAI-compatible API gateway that fronts 160+ upstream models (OpenAI, Anthropic, DeepSeek, Gemini, etc.) at upstream cost — no markup. It also offers an adaptive router (orcarouter/auto) that picks a cost-efficient upstream model per request based on prompt characteristics.
What the PR adds
-
A native OrcaRouter provider option in Verba’s standard LLM selection UI
-
Single API key access to 160+ models, so Verba users can experiment with different LLMs across their RAG pipeline (generation, reranking, etc.) without juggling multiple provider configs
-
Implementation is complete and verified via local end-to-end testing against a running Verba instance
Current status
This is my first PR to the Verba repo, so the GitHub Actions workflows are currently waiting on maintainer approval to run. If someone from the team has a moment to kick those off, that’d be much appreciated ![]()
No rush on the review itself — happy to iterate based on any feedback. Thanks!