A large LLM created by combining two fine-tuned Llama 70B models into one 120B model. Combines Xwin and Euryale. Credits to - [@chargoddard](https://huggingface.co/chargoddard) for developing the framework used to merge the model - [mergek…
Model details →Goliath 120B vs EleutherAI: Llemma 7b
EleutherAI: Llemma 7b wins on 2 of 6 axes — pricing and capability skew in its favour for most workloads.
Llemma 7B is a language model for mathematics. It was initialized with Code Llama 7B weights, and trained on the Proof-Pile-2 for 200B tokens. Llemma models are particularly strong at chain-of-thought mathematical reasoning and using comput…
Model details →Side-by-side comparison
| Capability | Goliath 120B | EleutherAI: Llemma 7b | Winner |
|---|---|---|---|
| Context window Maximum number of input tokens the model can attend to in a single request. | 6K | 4K | 🏆 Goliath 120B |
| Input price (per 1M) Cost per million input tokens billed by the provider. | $3.75 | $0.80 | 🏆 EleutherAI: Llemma 7b |
| Output price (per 1M) Cost per million output tokens billed by the provider. | $7.50 | $1.20 | 🏆 EleutherAI: Llemma 7b |
| Tool / function calling First-class support for emitting structured tool calls. | — | — | Tie |
| Vision input Accepts image inputs alongside text. | — | — | Tie |
| Reasoning mode Internal chain-of-thought / extended-thinking support. | — | — | Tie |
Frequently asked questions
Is Goliath 120B better than EleutherAI: Llemma 7b?
EleutherAI: Llemma 7b wins on 2 of 6 axes — pricing and capability skew in its favour for most workloads.
What's the price difference between Goliath 120B and EleutherAI: Llemma 7b?
Input: $3.75 vs $0.80 per 1M tokens. Output: $7.50 vs $1.20 per 1M tokens.
What context windows do Goliath 120B and EleutherAI: Llemma 7b support?
Goliath 120B supports up to 6K tokens. EleutherAI: Llemma 7b supports up to 4K tokens.
Do both Goliath 120B and EleutherAI: Llemma 7b support tool calling?
Goliath 120B: not advertised. EleutherAI: Llemma 7b: not advertised.