A large LLM created by combining two fine-tuned Llama 70B models into one 120B model. Combines Xwin and Euryale. Credits to - [@chargoddard](https://huggingface.co/chargoddard) for developing the framework used to merge the model - [mergek…
Model details →Goliath 120B vs OpenAI: GPT-3.5 Turbo 16k
OpenAI: GPT-3.5 Turbo 16k wins on 4 of 6 axes — pricing and capability skew in its favour for most workloads.
This model offers four times the context length of gpt-3.5-turbo, allowing it to support approximately 20 pages of text in a single request at a higher cost. Training data: up to Sep 2021.
Model details →Side-by-side comparison
| Capability | Goliath 120B | OpenAI: GPT-3.5 Turbo 16k | Winner |
|---|---|---|---|
| Context window Maximum number of input tokens the model can attend to in a single request. | 6K | 16K | 🏆 OpenAI: GPT-3.5 Turbo 16k |
| Input price (per 1M) Cost per million input tokens billed by the provider. | $3.75 | $3.00 | 🏆 OpenAI: GPT-3.5 Turbo 16k |
| Output price (per 1M) Cost per million output tokens billed by the provider. | $7.50 | $4.00 | 🏆 OpenAI: GPT-3.5 Turbo 16k |
| Tool / function calling First-class support for emitting structured tool calls. | — | Yes | 🏆 OpenAI: GPT-3.5 Turbo 16k |
| Vision input Accepts image inputs alongside text. | — | — | Tie |
| Reasoning mode Internal chain-of-thought / extended-thinking support. | — | — | Tie |
Frequently asked questions
Is Goliath 120B better than OpenAI: GPT-3.5 Turbo 16k?
OpenAI: GPT-3.5 Turbo 16k wins on 4 of 6 axes — pricing and capability skew in its favour for most workloads.
What's the price difference between Goliath 120B and OpenAI: GPT-3.5 Turbo 16k?
Input: $3.75 vs $3.00 per 1M tokens. Output: $7.50 vs $4.00 per 1M tokens.
What context windows do Goliath 120B and OpenAI: GPT-3.5 Turbo 16k support?
Goliath 120B supports up to 6K tokens. OpenAI: GPT-3.5 Turbo 16k supports up to 16K tokens.
Do both Goliath 120B and OpenAI: GPT-3.5 Turbo 16k support tool calling?
Goliath 120B: not advertised. OpenAI: GPT-3.5 Turbo 16k: yes.