https://kevinchen1994.github.io/tags/moe/ Recent content in MoE on 厨师海森堡的厨房 https://kevinchen1994.github.io/images/profile.jpg https://kevinchen1994.github.io/images/profile.jpg Hugo -- 0.161.1 zh-cn Fri, 05 Jan 2024 00:00:00 +0000 https://kevinchen1994.github.io/posts/mixtral-8x7b-moe%E6%A8%A1%E5%9E%8B%E7%AC%94%E8%AE%B0/ Fri, 05 Jan 2024 00:00:00 +0000 https://kevinchen1994.github.io/posts/mixtral-8x7b-moe%E6%A8%A1%E5%9E%8B%E7%AC%94%E8%AE%B0/ 随着 Mixtral 8x7B 的推出，一种称为混合专家模型 (Mixed Expert Models，简称 MoEs) 的 Transformer 模型在开源人工智能社区引起了广泛关注。