NVIDIA: Llama 3.1 Nemotron 70B Instruct✓ Catalog verified
NVIDIA's Llama 3.1 Nemotron 70B is a language model designed for generating precise and useful responses. Leveraging Llama 3.1 70B architecture and Reinforcement Learning from Human Feedback (RLHF), it excels in automatic alignment benchmarks. This model is tailored for applications requiring high accuracy in helpfulness and response generation, suitable for diverse user queries across multiple domains. Usage of this model is subject to Meta's Acceptable Use Policy.
Overview
NVIDIA's Llama 3.1 Nemotron 70B is a language model designed for generating precise and useful responses. Leveraging Llama 3.1 70B architecture and Reinforcement Learning from Human Feedback (RLHF), it excels in automatic alignment benchmarks. This model is tailored for applications requiring high accuracy in helpfulness and response generation, suitable for diverse user queries across multiple domains. Usage of this model is subject to Meta's Acceptable Use Policy.
Access: available through the official Nvidia API. Context window: 131K.
Specifications
| API identifier | nvidia/llama-3.1-nemotron-70b-instruct |
| Provider | Nvidia |
| Model type | Text LLM |
| Context window | 131K catalog |
| Input modalities | text |
| Output modalities | text |
| Released | Oct 15, 2024 |
| Tokenizer | Llama3 |
| Instruction format | llama3 |
| Moderated | No |
| Architecture modality | text->text |
Pricing
Live pricing components for nvidia/llama-3.1-nemotron-70b-instruct as published in the catalog.
| Pricing component | Raw unit price | Normalized | Unit |
|---|---|---|---|
| Prompt tokens | $0.0000012 | $1.20 / 1M | Per input token |
| Completion tokens | $0.0000012 | $1.20 / 1M | Per output token |
| Request fee | N/A | N/A | Per request |
| Image fee | N/A | N/A | Per image unit |
| Web search fee | N/A | N/A | Per search request |
Cost calculator
Estimate monthly spend from your own token volumes.
Estimated Total Cost
$0.84Calculated from current list pricing in the ModelsAtlas catalog.Capabilities
| Capability | Status | What it means |
|---|---|---|
| Visual Understanding | Not advertised | Image and document analysis support |
| Audio Processing | Not advertised | Speech and voice aligned flows |
| Tool Calling | ✓ Supported | Supports tools / function calling |
| Self-Hosting | Not advertised | Deploy outside managed APIs |
Capability signals
Directional signals derived from model metadata and capability tags — not official benchmark submissions.
Quick start
Call NVIDIA: Llama 3.1 Nemotron 70B Instruct through an OpenAI-compatible client.
from openai import OpenAI
client = OpenAI(
base_url="https://openrouter.ai/api/v1",
api_key="YOUR_API_KEY"
)
response = client.chat.completions.create(
model="nvidia/llama-3.1-nemotron-70b-instruct",
messages=[{"role": "user", "content": "Explain quantum physics."}]
)
print(response.choices[0].message.content)Alternatives
Closest models by context window from a different provider.
| Model | Provider | Context | Input /1M | Actions |
|---|---|---|---|---|
| AionLabs: Aion-1.0 | Aion Labs | 131K | $4.00 | View → |
| AionLabs: Aion-1.0-Mini | Aion Labs | 131K | $0.70 | View → |
Sources & attribution
Pricing and metadata are maintained in the ModelsAtlas catalog.
Frequently asked questions
How much does NVIDIA: Llama 3.1 Nemotron 70B Instruct cost?
$1.20 per 1M input tokens and $1.20 per 1M output tokens on the official Nvidia API.
What is the context window of NVIDIA: Llama 3.1 Nemotron 70B Instruct?
NVIDIA: Llama 3.1 Nemotron 70B Instruct supports up to 131K tokens of context.
Does NVIDIA: Llama 3.1 Nemotron 70B Instruct support tool / function calling?
Yes, NVIDIA: Llama 3.1 Nemotron 70B Instruct supports tool / function calling — you can register tools and the model will emit structured tool calls.
How do I access NVIDIA: Llama 3.1 Nemotron 70B Instruct?
Use the official Nvidia API with the model id `nvidia/llama-3.1-nemotron-70b-instruct`. See the Quick start section above for code examples.