v5-text uses decoder-only backbones with last-token pooling instead of mean pooling. Four lightweigh...

- v5-text 使用 decoder-only 主干网络和 last-token pooling 替代传统 mean pooling
- 每个 Transformer 层注入四个轻量 LoRA 适配器,分别处理检索、匹配、分类和聚类
- 支持 32K 上下文长度,是 v3 的 4 倍,并在推理时动态选择适配器
Jina AI on X: "v5-text uses decoder-only backbones with last-token pooling instead of mean pooling. Four lightweight LoRA adapters are injected at each transformer layer, handling retrieval, text-matching, classification, and clustering independently. Users select the appropriate adapter at https://t.co/j4RESCgE7S" / X
Don’t miss what’s happening
People on X are the first to know.
Post
See new posts
Conversation

v5-text uses decoder-only backbones with last-token pooling instead of mean pooling. Four lightweight LoRA adapters are injected at each transformer layer, handling retrieval, text-matching, classification, and clustering independently. Users select the appropriate adapter at inference time. For retrieval, queries get a "Query:" prefix and documents get "Document:". Context length is 32K tokens, a 4x increase over v3.

·
1
18
6
New to X?
Sign up now to get your own personalized timeline!
Sign up with Apple
By signing up, you agree to the Terms of Service and Privacy Policy, including Cookie Use.
Relevant people
-  Jina AI @JinaAI_ Follow Click to Follow JinaAI_ Your Search Foundation, Supercharged!
Trending now
What’s happening
Sports · Trending
Jose Ramirez
Sports · Trending
MJ Melendez
Sports · Trending
Sixers
Trending with Celtics, Jayson Tatum
Sports · Trending
#PHIvsBOS
|
|
|
|
|
More
© 2026 X Corp.