AnythingLLM con Claude, GPT y Gemini

Elige Generic OpenAI como proveedor de LLM en AnythingLLM, rellena la base URL de avots, la clave, el modelo y el contexto, y chatea con tus documentos sobre avots.

Obtener clave API ✦ Ver precios Docs on GitHub

Connect in three fields

AnythingLLM tiene un proveedor Generic OpenAI para cualquier endpoint compatible con OpenAI. Apúntalo a avots.

FieldValue
Base URLhttps://api.avots.ai/openai/v1
API keyav_mcp_… · get your key
Modelanthropic/claude-sonnet-4.6 or any id from the table below

Setup

1. Abre los ajustes de LLM

Ve a Settings → AI Providers → LLM y elige Generic OpenAI como proveedor.

2. Rellena los campos

Establece Base URL en https://api.avots.ai/openai/v1, API Key en tu clave av_mcp_, y Chat Model Name en anthropic/claude-sonnet-4.6.

3. Configura contexto y tokens

Introduce la Token context window de tu modelo y un valor de Max Tokens, luego guarda.

AnythingLLM · Generic OpenAI
LLM Provider:         Generic OpenAI
Base URL:             https://api.avots.ai/openai/v1
API Key:              av_mcp_YOUR_KEY
Chat Model Name:      anthropic/claude-sonnet-4.6
Token context window: 200000
Max Tokens:           4096

Generic OpenAI no tiene descubrimiento automático de modelos, escribe el Chat Model Name exacto a mano. Configura correctamente la Token context window y Max Tokens, los valores erróneos truncan en silencio o dan error. Esto configura solo el LLM de chat, los embeddings son un proveedor aparte.

Example request

curl
curl https://api.avots.ai/openai/v1/chat/completions \
  -H "Authorization: Bearer av_mcp_YOUR_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "anthropic/claude-sonnet-4.6",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

The same key also unlocks MCP tools

Your av_mcp_ key is not only for chat. avots also runs as an MCP server, so AnythingLLM can call avots creative tools, image, video, music, talking avatars, on the same key and the same balance.

FieldValue
MCP serverhttps://mcp.avots.ai/
API keyav_mcp_… · same key as above

MCP setup guide →

Models and prices

Set the model field to any id below, or a lazy name like claude / gpt / gemini that maps to a sensible default.

ModelBest for⚡ / 1M tokens (in / out)
openai/gpt-5.5-proMax intelligence, hardest tasks60 000 / 360 000
anthropic/claude-opus-5Top Claude, long reasoning10 000 / 50 000
anthropic/claude-sonnet-4.6Balanced (default)6 000 / 30 000
google/gemini-3.1-pro-previewFresh Gemini Pro4 000 / 24 000
google/gemini-2.5-proStable Gemini Pro2 500 / 20 000
anthropic/claude-haiku-4.5Fast Claude2 000 / 10 000
deepseek/deepseek-r1Cheap reasoning1 400 / 5 000
google/gemini-2.5-flashFast and cheap600 / 5 000
openai/gpt-5-miniCheap OpenAI500 / 4 000
openai/gpt-oss-120b:freeFree (OpenAI open model, needs a positive balance)Free

* Price in ⚡ per 1,000,000 tokens, input / output (1000⚡ ≈ $1). Free models need a positive balance. Full list via GET /openai/v1/models.

AnythingLLM con Claude, GPT y Gemini

Generate an av_mcp_ key in Settings, paste three fields, and reach 40+ models on one balance. The same key works for MCP.

Obtener clave API ✦
FAQ

Preguntas

¿Qué proveedor elijo?
Generic OpenAI. Expone Base URL, API Key, Chat Model Name, ventana de contexto y tokens máximos.
¿Por qué configurar contexto y tokens máximos?
Generic OpenAI no los lee desde el endpoint. Los valores erróneos truncan el contexto o causan errores, así que ajústalos al modelo.
¿Esto configura también los embeddings?
No. El LLM y el generador de embeddings son proveedores separados en AnythingLLM. Esto es solo el LLM de chat.
¿Cómo se factura?
Por solicitud desde tu saldo de avots.
Does it support function calling and tools?
Yes. The endpoint forwards the standard OpenAI tools, tool_choice and parallel_tool_calls fields (and the legacy functions/function_call), in both streaming and non-streaming mode, so agent frameworks like LangChain, LlamaIndex, Langflow and n8n get real tool_calls back. Whether a given request uses tools depends on the model you pick: Claude, GPT and Gemini all support function calling.

Otros clientes

OpenAI-compatible API

avots speaks the OpenAI API. Any app that talks to ChatGPT through base URL, key and model…

Open WebUI with Claude, GPT and Gemini

Add avots under Connections as an OpenAI API provider, and every avots model shows up in y…

LibreChat with Claude, GPT and Gemini

Add one custom endpoint block to librechat.yaml and avots appears as a provider with every…

Cursor with Claude, GPT and Gemini

Override the OpenAI base URL in Cursor Settings, Models, paste your av_mcp_ key, add a mod…

Python openai SDK with avots

Pass base_url and your av_mcp_ key to the official openai Python client, then call any mod…

openclaw with Claude, GPT and Gemini

Add an OpenAI-compatible provider to openclaw.json pointing at avots, and openclaw runs an…

Hermes with Claude, GPT and Gemini

Set the OpenAI base URL and your av_mcp_ key in Hermes, pick a model, and it runs on avots…

Cline with Claude, GPT and Gemini

Pick OpenAI Compatible in Cline settings, paste the avots base URL and your av_mcp_ key, t…

Continue.dev with Claude, GPT and Gemini

Add one models entry to Continue config.yaml with provider openai and the avots base URL, …

Aider with Claude, GPT and Gemini

Export two environment variables and launch Aider with an openai/ model prefix, and the CL…

SillyTavern with Claude, GPT and Gemini

Choose Custom (OpenAI-compatible) as the Chat Completion source in SillyTavern, paste the …

Node.js openai SDK with avots

Pass baseURL and your av_mcp_ key to the official openai client, then call any model by id…

Chatbox with Claude, GPT and Gemini

Add a custom OpenAI API compatible provider in Chatbox, paste the avots host and your av_m…

Obtener clave