#moe

BAGEL 复现

ByteDance's BAGEL model uses a Mixture-of-Transformer-Experts architecture for unified image understanding, generation, and editing, requiring Ampere GPUs for full bfloat16 support.