LLM Proxy
LLM Proxy API docs
Test Authentication
Paste a valid LLM Proxy API key to run endpoint tests.

Completions

Legacy text completion endpoint for clients that use prompt-based completions.

POST/v1/completions

cURL example

bash
curl -s http://localhost:3000/v1/completions \
  -H "Authorization: Bearer $LLM_PROXY_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "gpt-4.1-mini",
    "prompt": "Summarize this API in one line."
  }'

Request body example

json
{
  "model": "gpt-4.1-mini",
  "prompt": "Write a one-line release note for an API gateway.",
  "max_tokens": 60,
  "temperature": 0.5
}

Response example

json
{
  "id": "cmpl_123",
  "object": "text_completion",
  "created": 1735678910,
  "model": "gpt-4.1-mini",
  "choices": [
    {
      "text": "New: route one OpenAI-compatible request across multiple providers.",
      "index": 0,
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "prompt_tokens": 12,
    "completion_tokens": 14,
    "total_tokens": 26
  }
}
Try It
POST
/v1/completions
Run a live request using a pasted API key.

Select an account key or paste a manual key first to test endpoints.