Mistral AI release Mixtral 8x22B: 141B-parameter sparse MoE with 39B active, 64k context and strong math/coding 17. April 2024
Mistral AI release Mixtral 8x7B: Sparse mixture-of-experts model outperforms Llama 2 70B and GPT-3.5 11. Dezember 2023