When you're running GenAI on the edge, you don't get to blame the network. Alan Zhu from @Qualcomm is coming to Vector Space Day to talk about what it means to build for on-device inference, where latency isn't a tradeoff to manage but the thing users feel with every interaction.
Qdrant(@qdrant_engine)217 字 (约 1 分钟)
75
When you're running GenAI on the edge, you don't get to blame the network. Alan Zhu from @Qualcomm is coming to Vector Space Day to talk about what it means to build for on-device inference, where latency isn't a tradeoff to manage but the thing users feel with every interaction.
入选理由：在边缘设备上运行GenAI时，不能怪罪网络。
FeaturedTweet#GenAI#Edge Computing#Vector Space Day中文