
Llama 3.1 8B
Llama 3.1 8B is a language model with 8B parameters from Meta. It is currently free at 2 providers with up to 32K tokens of context. Its weights are open, so it can also run locally.
- Developer
- Meta
- Parameters
- 8B
- Context
- 32K tokens
- Type
- Text
- License
- Open weights
- Free since
- September 19, 2026
Where to use Llama 3.1 8B for free
Each row is a separate free endpoint with its own limits.
| Provider | Context | Limit | Card | |
|---|---|---|---|---|
Together AI nim/meta/llama-3.1-8b-instruct |
16K | Fair use (depends on server load) | — | Open |
Cloudflare Workers AI @cf/meta/llama-3.1-8b-instruct-fp8 |
32K | Workers Free: 10,000 Neurons/day shared across eligible models | — | Open |
Quick start
curl https://api.together.xyz/v1/chat/completions \
-H "Authorization: Bearer $TOGETHER_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "nim/meta/llama-3.1-8b-instruct",
"messages": [{"role": "user", "content": "Hello!"}]
}'from openai import OpenAI
client = OpenAI(
base_url="https://api.together.xyz/v1",
api_key="YOUR_TOGETHER_API_KEY",
)
reply = client.chat.completions.create(
model="nim/meta/llama-3.1-8b-instruct",
messages=[{"role": "user", "content": "Hello!"}],
)
print(reply.choices[0].message.content)import OpenAI from "openai";
const client = new OpenAI({
baseURL: "https://api.together.xyz/v1",
apiKey: process.env.TOGETHER_API_KEY,
});
const reply = await client.chat.completions.create({
model: "nim/meta/llama-3.1-8b-instruct",
messages: [{ role: "user", content: "Hello!" }],
});
console.log(reply.choices[0].message.content);Example for Together AI. Any OpenAI-compatible client works: Cursor, Cline, OpenCode, Open WebUI.
Benchmarks
This model is not on the Artificial Analysis leaderboard yet. We do not publish our own estimates.
Similar free models
FAQ
Is Llama 3.1 8B free?
Yes. As of October 25, 2026, Llama 3.1 8B is free at Together AI, Cloudflare Workers AI. Each provider has its own limits — see the table above.
What is the context window of Llama 3.1 8B?
The largest context among free routes is 32,000 tokens. Some providers cap it lower.
How do I call Llama 3.1 8B via API?
Use any OpenAI-compatible client with base URL https://api.together.xyz/v1, model ID nim/meta/llama-3.1-8b-instruct, and a Together AI key.
Is Llama 3.1 8B open-weight?
Yes, the weights are published — you can download and run it locally, for example with Ollama or LM Studio.