Event · 2023-12-11
Open models
Mixtral 8×7B
An open-weight sparse mixture of experts in which only part of the parameters runs for each token.
Sources
Mistral AI · техническое описаниеOpen primary source Open models
An open-weight sparse mixture of experts in which only part of the parameters runs for each token.