Llamanet claims to be "an open source, drop-in library/tool that lets you instantly turn any OpenAI-powered apps into llama.cpp apps, with just one line."

"It works with zero setup and zero 3rd party dependency so you don't need to know anything, and just treat it like OpenAI."

"Llamanet is an embeddable llama.cpp management system that 'just works', automagically. It lets you instantly replace OpenAI with one line of code in your app. Because the engine is embedded in your app, you don't need to tell your users to install a 3rd party LLM app or server just to use your app."

Hmm. Wonder if the results quality is as good, though? Might be worth trying.

pinokiocomputer / llamanet

#solidstatelife #ai #genai #llms #llama #llama.cpp