Docs
Get an API key

Vultron Retriever Flash 0.8B vultron-retriever-flash-qwen3.5-0.8b

Vultr's lightweight reranker for low-latency, high-volume relevance scoring in retrieval and RAG. Input longer than the context length is rejected with a 400 (context_length_exceeded).

From the live catalog
View .md
Tokens
$0.05 / 1M tokens
Context
256K tokens

Inputs

InputAccepts
text
context 256K tokens

Parameters

ParameterTypeValuesDefault
top_ninteger1–100
return_documentsboolean

Endpoints

A request

curl https://api.vultrinference.com/v1/rerank \
  -H "Authorization: Bearer $VULTR_INFERENCE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "vultron-retriever-flash-qwen3.5-0.8b",
    "query": "What is the capital of France?",
    "documents": [
      "Berlin is the capital of Germany.",
      "Paris is the capital of France."
    ],
    "top_n": 1
  }'