阿斯塔纳时间
AI QAZAQSTANKZ · AI测试版

哈萨克斯坦人工智能与高科技领域的智能门户

ResearchEducation1 分钟阅读

内容来自原始来源:

arXiv — cs.AI

在 arXiv — cs.AI 阅读全文

标题为英语Which Tokens Should SFT Actually Learn? A Token-Trimming Perspective on Mathematical Reasoning

arXiv:2609.09707v1 Announce Type: new Abstract: Supervised fine-tuning (SFT) applies a uniform cross-entropy loss to all target tokens, even though different tokens provide unequal learning signals for mathematical reasoning. This uniform treatment can over-sharpen already…

arXiv — cs.AI作者: Yaning Jia, Chunhui Zhang, Wenxuan Xu, Xingjian Diao, Xiaoyuan Wang, Soroush Vosoughi2026年9月10日 (9月10日)
提供 3 种语言版本

AI 摘要:要点

  • arXiv:2609.09707v1 Announce Type: new Abstract: Supervised fine-tuning (SFT) applies a uniform cross-entropy loss to all target tokens, even though different tokens provide unequal learning signals for mathematical reasoning
  • This uniform treatment can over-sharpen already…
Research
KZ·AI 72AC
Инсайт дня

Which Tokens Should SFT Actually Learn? A Token-Trimming Perspective on Mathematical Reasoning

Поделиться:

相关文章

Paragon 已联系 - 总结当天的成果!

Paragon 已联系 - 总结当天的成果!今天的主要事情🟠25.10 🟠Rippling - 因为价格而离开 Claude 去 OpenAI 🟠Uber - ChatGPT 为 3 万名员工工作🟠Claude 和 Theorem - 123 个库经过证明验证🟠NVIDIA OpenShell - 代理将在几毫秒内停止......

Telegram — Paragon | Нейросети и ИИ
Research1 分钟

科学文章太长,所以我只想请AI转述一下。但又担心他会错过……

科学文章太长,所以我只想请AI转述一下。 But there is a fear that he will miss important mathematical calculations and conditions. And if you need to return to the original, you will have to look for the desired section again. TextFold 的开发人员已经创建了相当......

GitHub Разработчика

返回列表