SaaS-Bench

Claude 通过率不到4%，SaaS-Bench撕碎了Computer-Use的「全自动办公」幻想

量子位 · 9.2 分

SaaS-Bench评测显示主流大模型在真实办公任务中完全通过率不足4%，揭示AI全自动办公仍面临巨大挑战。

AI: "done!" me: *goes and checks* …half of it isn't even there bro and the reason is kind of funny. AI still uses a computer the same way you do. it takes a picture of the screen, guesses where to click, then takes another picture to see if it worked. one real task can be hundreds of those guesses @PineAIAssistant just built a computer made for AI instead. it reads the actual page to see what's clickable instead of guessing. builders can put it right inside their own apps too plus you can take over anyt

Kloss(@kloss_xyz) · 8.5 分

Pine Computer通过直接解析页面内容而非猜测点击，显著提升AI任务完成效率，解决当前AI交互的瓶颈。

RT @StanleyWei4748: AI is already smart enough. Real-world tasks are still slow, expensive and unreliable, because we hand AI a computer b…

EP(@eptwts) · 6.5 分

AI硬件设计与实际需求存在根本性矛盾，Pine Computer试图通过专用硬件解决效率问题，但尚未公开验证。