#opensourcemodels

waynerad@diasp.org

"Introducing Rubra: Develop your AI assistants locally."

"Rubra is a full-stack OpenAI implementation, designed for local development. Built for developers, Rubra is an open-source project that delivers the same simplicity and intelligence as working with ChatGPT, but with a unique focus on building AI assistants powered by a locally running open-source LLM."

"Rubra serves as a drop-in replacement for OpenAI that can be deployed locally, for private, hassle-free AI development and testing."

"Rubra includes a highly tuned local model based on Mistral, that is ideal for local development. You can also add API keys for Open AI and Anthropic to compare how your agents perform. As models improve, we'll continue to upgrade the local model to provide the best experience."

If my attempt to build a PC with a powerful GPU capable of running these models hadn't failed, I'd be trying this. If you have a chance to try it, let us know how it goes.

Introducing Rubra: Develop your AI assistants locally

#solidstatelife #ai #genai #llms #openai #opensourcemodels