All published intelligence, sovereign stack research, ecosystem news, and AI foundation model reviews.
arXiv:2610.32096v1 Announce Type: new Abstract: Diffusion language models (DLMs) support bidirectional denoising and iterative refinement, but generation remains largely controlled by token-level masking schedules. This leaves draft-level refinement implicit and limits explicit…
arXiv:2610.32057v1 Announce Type: new Abstract: We present HyScale, a long-context training system for learned sparse attention. Learned sparse attention is a promising architecture for million-token contexts, widely adopted in production since DeepSeek-V3.2. Selection, however,…
arXiv:2610.31918v1 Announce Type: new Abstract: Distilling interactive LLM agents requires choosing between teacher-generated demonstrations and student-generated experience, corresponding broadly to off-policy and on-policy distillation. While both have proven effective, we…
arXiv:2610.30611v1 公告类型：新 摘要：扩展大型语言模型大大提高了语言流畅性，但可靠的自主代理需要的不仅仅是流畅的生成。在多轮推理中，当前的代理系统通常会产生语义上合理的结果……
arXiv:2610.30450v1 通告类型：新 摘要：推理型LLM在得到正确答案后往往继续推理，浪费算力且有时用错误答案替代正确答案。决定何时停止是一个元推理问题：模型必须权衡进一步...
arXiv:2610.30205v1 宣布类型：新 摘要：当LLM代理的移动失败时，系统将移动和失败消息写入记录并再次询问。在工具调用中，此记录使小模型更有可能重复失败的动作。我们测试是否...
arXiv:2610.30151v1 公告类型：新 摘要：AI 代理之间的每次交互都以握手开始：发起代理必须找到其对应方，了解它可以做什么，并在发送第一个有用消息之前建立会话。代理调查...
arXiv:2610.26995v1 公告类型：新 摘要：基于 LLM 的代理越来越依赖可重用的技能。然而，扩展技能库使得高效、准确的技能使用变得困难。完整技能加载会产生高令牌和运行时开销。相比之下，扁平语义……
arXiv:2610.27220v1 公告类型：new 摘要：近期工作探索了在思维链推理过程中用连续表示代替离散token，通常称为软CoT。这源于这样一个想法：token嵌入的混合可以表示...
arXiv:2610.12879v1 公告类型: 新 摘要: 扩散语言模型并行生成token，但仍需多次采样步骤才能生成高质量文本。本文探讨模型是否能在单步中学习生成整个序列……
At the start of every session, LLM agents load a fixed context file, such as $\texttt{AGENTS.md}$. Each loaded token in the file is charged again in every later round of the session, and these files can degrade performance as they grow in size. However, in practice, human or…
Looped LMs are parameter efficient and promise dynamic computation (saving memory and FLOPs on easy tokens). However, state-of-the-art open Looped LMs trained with this dynamic computation capability (Ouro models) do not realize it in practice as each loop iteration (depth)…
A deployed LLM agent emits tool calls, queries, and code that can be silently wrong -- by the time the error surfaces, the action has run. Frontier chat APIs hide the model's token probabilities; the agent's stated confidence barely beats chance on the mistakes that matter; and…
Large language models spend the same amount of computation on every token they generate, regardless of how difficult each token is to produce. Methods such as speculative decoding and model routing are built on the premise that much of this computation is unnecessary, yet the…
LLM agents generate intermediate reasoning and actions token by token, making extended interactions slow and computationally expensive. Jev-style models offer fast probabilistic predictions over finite fields, but require those fields to be specified in advance. This requirement…
Long-horizon language agents increasingly rely on external memory as a frozen world model, yet current memory systems are usually judged only by task success or token cost. We argue that the missing object is the shape of memory use: under finite context and repeated retrieval,…
Detailed profession-specific system prompts raise token use and estimated cost per response without a consistent accuracy gain. We evaluate Scientific Agents, an open-source corpus of 503 profession-specific AGENTS.md profiles, with Gemini 3.8 Flash via OpenRouter in the Pi…
arXiv:2609.35869v1 Announce Type: new Abstract: Pre-tokenisation restricts which text fragments can become prediction units, but its compression cost is obscured when tokenisers are compared only under the same boundaries. We measure this cost by bounding the minimum token count…
arXiv:2609.35924v1 Announce Type: new Abstract: Discrete diffusion models generate sequences by iteratively resolving multiple tokens in parallel, offering a flexible alternative to left-to-right generation. However, guiding this process with a sequence-level objective is…
arXiv:2609.36062v1 Announce Type: new Abstract: Long-context sequence models face a fundamental tradeoff: softmax attention uses flexible token-level interactions at quadratic cost, whereas linear attention obtains linear-time training and constant-time decoding by compressing…
任务规划在长视野操作中将高级指令和可执行行为联系起来，但现代视觉-语言-动作（VLA）系统通常会隐含这种中间结构。现有的思想链 (CoT) 规划器也倾向于依赖粗略的任务级别……
In Mixture-of-Experts language models, the router typically selects and weights experts based on the token's hidden state, utilizing limited contextual information. We propose Attention-Aware Routing (AAR), which augments the router with temporal and spectral features extracted…
Long-context large language model inference is increasingly limited by prefill, where dense self-attention processes the entire prompt before generation begins. Sparse block selection can reduce this cost, but a block centroid may hide a highly relevant token among many…
Wearable assistants require episodic memory over egocentric video, yet current vision-language models face bounded frame budgets, growing visual-token costs, and long-context retrieval failures. Under these practical constraints, we study whether textual captions can serve as…
人工智能代理在各种令人印象深刻的任务中的强大性能正在推动对代理基础设施的前所未有的投资，但处理代币的成本正在快速增加。 Web 代理自动执行自然描述的 Web 应用程序任务......
arXiv:2609.05441v1 Announce Type: new Abstract: Long-term memory for LLM agents is evaluated today by conversational recall benchmarks (LoCoMo, LongMemEval), which measure question answering over dialogue history, not whether remembered facts change what a tool-using agent does.…