Nemotron 3 Nano Omni nemotron-3-nano-omni-30b-a3b-reasoning

Unified video, audio, image, and text understanding for enterprise Q&A, summarization, and document intelligence.

From the live catalog

View .md

Input

$0.10 / 1M tokens

Output

$0.25 / 1M tokens

Context

256K tokens

Max output

256K tokens

region ATL quantization bf16 reasoning Hugging Face nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16

Limits

What one subscription may send this model. Limits says what happens past them.

Requests a minute	At once
120	16

Inputs

Input	Accepts
`text`	context 256K tokens
`image`	sources url, base64 formats png, jpeg, webp, gif references type: integer, min: 1, max: 1 max size 20 MB
`file`	sources url, base64 formats application/pdf, text/plain, text/markdown, text/html, text/csv, application/json max size 100 MB
`audio`	sources url, base64 formats wav, mpeg max size 50 MB
`video`	sources url, base64 formats mp4, webm max size 50 MB

Parameters

Streams with stream: true.

Parameter	Type	Values
`temperature`	number	0–2
`top_p`	number	0–1
`frequency_penalty`	number	-2–2
`presence_penalty`	number	-2–2
`max_tokens`	integer	1–262144 tokens
`stop`	array	up to 4 items
`seed`	integer
`continue_final_message`	boolean
`top_k`	integer	at least 0
`repetition_penalty`	number	0.01–2
`n`	integer	at least 1
`logprobs`	boolean
`top_logprobs`	integer	0–20
`response_format`	object	type: text, json_object, json_schema
`structured_outputs`	boolean
`reasoning_effort`	string	max, xhigh, high, medium, low, minimal
`reasoning`	object
`tools`	boolean

Endpoints

POST/v1/chat/completions Create Chat Completion POST/v1/responses Create Response POST/v1/messages Create Message POST/v1/chat/completions/RAG RAG Chat Completion

A request

curl https://api.vultrinference.com/v1/chat/completions \
  -H "Authorization: Bearer $VULTR_INFERENCE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "nemotron-3-nano-omni-30b-a3b-reasoning",
    "messages": [
      {
        "role": "system",
        "content": "Answer in one sentence."
      },
      {
        "role": "user",
        "content": "Why is the sky blue?"
      }
    ],
    "max_completion_tokens": 512
  }'

import os
import requests

response = requests.post(
    "https://api.vultrinference.com/v1/chat/completions",
    headers={"Authorization": f"Bearer {os.environ['VULTR_INFERENCE_API_KEY']}"},
    json={
        "model": "nemotron-3-nano-omni-30b-a3b-reasoning",
        "messages": [
            {
                "role": "system",
                "content": "Answer in one sentence.",
            },
            {
                "role": "user",
                "content": "Why is the sky blue?",
            },
        ],
        "max_completion_tokens": 512,
    },
)
print(response.json())

const response = await fetch("https://api.vultrinference.com/v1/chat/completions", {
  method: "POST",
  headers: {
    Authorization: `Bearer ${process.env.VULTR_INFERENCE_API_KEY}`,
    "Content-Type": "application/json",
  },
  body: JSON.stringify({
    "model": "nemotron-3-nano-omni-30b-a3b-reasoning",
    "messages": [
      {
        "role": "system",
        "content": "Answer in one sentence."
      },
      {
        "role": "user",
        "content": "Why is the sky blue?"
      }
    ],
    "max_completion_tokens": 512
  }),
});
console.log(await response.json());