The architecture of open-weight LLMs: MoE, hybrid layers, ternary weights www.silasdata.com 2 points by silasyl 2 hours ago