Arbitrage: Efficient Reasoning via Advantage-Aware Speculation
Apple Machine Learning Research493 字 (约 2 分钟)
85
ARBITRAGE通过动态路由机制提升推理效率，在保持精度前提下减少推理延迟达2倍。
入选理由：ARBITRAGE框架使推理延迟降低约2倍，精度保持不变
FeaturedArticle#Large Language Models#Speculative Decoding#Efficient Reasoning#Machine Learning Research#Apple英文