← All models
Meta · Language model
Llama 3.1 70B Instruct
meta-llama/llama-3.1-70b-instruct- Language
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...
Specifications
- Context window
- 131,072 tokens
- Max output
- 16,384 tokens
- Input
- text
- Output
- text
- Tokenizer
- Llama3
- Knowledge cutoff
- 2023-12-31
Supported parameters
Accepted by the model and forwarded as-is by the gateway.
- frequency_penalty
- logit_bias
- max_tokens
- min_p
- presence_penalty
- repetition_penalty
- response_format
- seed
- stop
- structured_outputs
- temperature
- tool_choice
- tools
- top_k
- top_p
Use it
POST /api/v1/chat/completions · MCP chat · full reference
curl https://omnirail.org/api/v1/chat/completions \
-H "Authorization: Bearer $OMNIRAIL_KEY" -H "Content-Type: application/json" \
-d '{"model":"meta-llama/llama-3.1-70b-instruct","messages":[{"role":"user","content":"Hello"}],"max_tokens":300}'