|
|
|
<br>DeepSeek-R1 is based on DeepSeek-V3, a mix of specialists (MoE) design just recently open-sourced by DeepSeek. This base model is fine-tuned using Group [Relative Policy](https://twoplustwoequal.com) Optimization (GRPO), a [reasoning-oriented variation](https://cello.cnu.ac.kr) of RL. The research study team also [performed](http://archmageriseswiki.com) understanding distillation from DeepSeek-R1 to open-source Qwen and Llama designs and released a number of variations of each |