T
traeai
Sign in

模型

什么是 Kimi K2

也叫:kimi-k2

由Kimi开发的模型,采用first_k_dense策略。

📰 Kimi K2 最新动态

已收录 2 篇与「Kimi K2」相关的 AI 资讯和分析。

DeepSeek V4的tid2eid是怎么来的?

How is the tid2eid in DeepSeek V4 Generated?

科学空间3057 字 (约 13 分钟)
75

The article explores the generation mechanism of the tid2eid mapping table in the DeepSeek V4 model.

入选理由:DeepSeek V4采用hash routing替代first_k_dense策略

FeaturedArticle#Deep Learning#Model Architecture#MoE中文
Training Kimi K2 and Qwen3 30B-scale models efficiently requires more than standard data-parallel tr...

NVIDIA Megatron Core now offers end-to-end support for advanced optimizers like Muon, MOP, and REKLS, overcoming limitations of standard data parallelism to significantly accelerate training of 30B-scale models such as Kimi K2 and Qwen3 on GB300 and NVL72 systems.

入选理由:传统数据并行已不足以高效训练30B+大模型,需引入高阶优化器。

FeaturedTweet#NVIDIA Megatron Core#Muon#Qwen3#Kimi K2#LLM Training Optimization英文

与「Kimi K2」经常一起出现的 AI 术语。

💡 想追踪「Kimi K2」的长期趋势?去 实体雷达 · Kimi K2 查看详细分析和跨材料问答。

AI may generate inaccurate information. Please verify important content.