Llemma 7B is a language model for mathematics. It was initialized with Code Llama 7B weights, and trained on the Proof-Pile-2 for 200B tokens. Llemma models are particularly strong at chain-of-thought mathematical reasoning and using comput…
Model details →EleutherAI: Llemma 7b vs OpenAI: GPT-3.5 Turbo Instruct
EleutherAI: Llemma 7b wins on 3 of 6 axes — pricing and capability skew in its favour for most workloads.
This model is a variant of GPT-3.5 Turbo tuned for instructional prompts and omitting chat-related optimizations. Training data: up to Sep 2021.
Model details →Side-by-side comparison
| Capability | EleutherAI: Llemma 7b | OpenAI: GPT-3.5 Turbo Instruct | Winner |
|---|---|---|---|
| Context window Maximum number of input tokens the model can attend to in a single request. | 4K | 4K | 🏆 EleutherAI: Llemma 7b |
| Input price (per 1M) Cost per million input tokens billed by the provider. | $0.80 | $1.50 | 🏆 EleutherAI: Llemma 7b |
| Output price (per 1M) Cost per million output tokens billed by the provider. | $1.20 | $2.00 | 🏆 EleutherAI: Llemma 7b |
| Tool / function calling First-class support for emitting structured tool calls. | — | — | Tie |
| Vision input Accepts image inputs alongside text. | — | — | Tie |
| Reasoning mode Internal chain-of-thought / extended-thinking support. | — | — | Tie |
Frequently asked questions
Is EleutherAI: Llemma 7b better than OpenAI: GPT-3.5 Turbo Instruct?
EleutherAI: Llemma 7b wins on 3 of 6 axes — pricing and capability skew in its favour for most workloads.
What's the price difference between EleutherAI: Llemma 7b and OpenAI: GPT-3.5 Turbo Instruct?
Input: $0.80 vs $1.50 per 1M tokens. Output: $1.20 vs $2.00 per 1M tokens.
What context windows do EleutherAI: Llemma 7b and OpenAI: GPT-3.5 Turbo Instruct support?
EleutherAI: Llemma 7b supports up to 4K tokens. OpenAI: GPT-3.5 Turbo Instruct supports up to 4K tokens.
Do both EleutherAI: Llemma 7b and OpenAI: GPT-3.5 Turbo Instruct support tool calling?
EleutherAI: Llemma 7b: not advertised. OpenAI: GPT-3.5 Turbo Instruct: not advertised.