0xSero

Gemma 4 21B REAP

Gemma 4 21B REAP: 20% expert-pruned Gemma 4 26B MoE

Community researcher 0xSero released Gemma 4 21B-A4B REAP, a 20% expert-pruned version of the Gemma 4 26B MoE created using Cerebras' REAP pruning technique. It shrinks the model for cheaper local inference while preserving most of its quality.