Model release · 2023-12-11
Text / LLM · Mistral AI
Mixtral 8×7B
An open mixture-of-experts model activated only part of its parameters per token, reducing inference cost.
Sources
Mistral AI · releaseOpen primary source Text / LLM · Mistral AI
An open mixture-of-experts model activated only part of its parameters per token, reducing inference cost.