mistralai-Mixtral-8x22B-v0-1
Mistral AIVersion: 7
The Mixtral-8x22B Large Language Model (LLM) is a pretrained generative Sparse Mixture of Experts.
Mixtral-8x22B-v0.1 is a pretrained base model and therefore does not have any moderation mechanisms.
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 74.46 |
| AI2 Reasoning Challenge (25-Shot) | 70.48 |
| HellaSwag (10-Shot) | 88.73 |
| MMLU (5-Shot) | 77.81 |
| TruthfulQA (0-shot) | 51.08 |
| Winogrande (5-shot) | 84.53 |
| GSM8k (5-shot) | 74.15 |
| Inference type | Python sample (Notebook) | CLI with YAML |
|---|---|---|
| Real time | text-generation-online-endpoint.ipynb | text-generation-online-endpoint.sh |
| Batch | text-generation-batch-endpoint.ipynb | coming soon |