LMSYS 发布开源聊天模型 Vicuna-13B，用 ShareGPT 对话微调 LLaMA，训练成本约 $300

AI HOT 精选

AI HOT 精选2026年10月3日

LMSYS 发布开源聊天模型 Vicuna-13B，用 ShareGPT 对话微调 LLaMA，训练成本约 $300

6.9内容质量

TL;DR · AI 摘要

LMSYS åå¸å¼æºèå¤©æ¨¡å Vicuna-13Bï¼ç¨ ShareGPT å¯¹è¯å¾®è° LLaMAï¼è®ç»ææ¬çº¦ $300 Â· AIHOT LMSYSï¼Blog...

核心要点

主题聚焦：LMSYS 发布开源聊天模型 Vicuna-13B，用 ShareGPT 对话微调 LLaMA，
来源：AI HOT 精选，建议结合原文判断细节。
AI 分析暂不可用，本条为保底评分与摘要。

#AI#后端#安全#开源

打开原文

LMSYS åå¸å¼æºèå¤©æ¨¡å Vicuna-13Bï¼ç¨ ShareGPT å¯¹è¯å¾®è° LLaMAï¼è®ç»ææ¬çº¦ $300 Â· AIHOT

LMSYSï¼Blog

Â·

2026-10-03 23:50

1 å°æ¶å

ç²¾é

AI è¯å

79

LMSYS åå¸å¼æºèå¤©æ¨¡å Vicuna-13Bï¼ç¨ ShareGPT å¯¹è¯å¾®è° LLaMAï¼è®ç»ææ¬çº¦ $300

Blog Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90% ChatGPT Quality We introduce Vicuna-13B, an open-source chatbot trained by fine-tuning LLaMA on user-shared conversations collected from ShareGPT. Preliminary evaluation using GPT-4 as a judge shows Vicuna-13B achiev... The Vicuna Team March 30, 2023

AI å¯¼è¯»

LMSYS å¢éåå¸ Vicuna-13Bï¼éè¿çº¦ 70K ShareGPT ç¨æ·å ±äº«å¯¹è¯å¾®è° LLaMAï¼è®ç»ææ¬çº¦ $300ï¼ä»£ç ãæéåå¨çº¿ demo ä»¥éåä¸è®¸å¯å ¬å¼ãGPT-4 ä½ä¸ºè¯å®¡çåæ¥è¯ä¼°æ¾ç¤ºå ¶è¾¾å° ChatGPT/Bard 90% ä»¥ä¸è´¨éï¼å¨ 45% é®é¢ä¸ä¸éäº ChatGPTï¼å¢éåæ¶æåºåºäº GPT-4 çèªå¨è¯æµæ¡æ¶ï¼å¹¶è¯´æå ¶å°éä¸¥è°¨æ¹æ³ã

æ¨èçç±

æ£æ Â· AI ç¿»è¯

æä»¬æ¨åº Vicuna-13Bï¼ä¸ä¸ªå¼æºèå¤©æºå¨äººï¼éè¿å¨ ShareGPT æ¶éçç¨æ·å ±äº«å¯¹è¯ä¸å¾®è° LLaMA è®ç»èæãä½¿ç¨ GPT-4 ä½ä¸ºè¯å¤çåæ¥è¯ä¼°æ¾ç¤ºï¼Vicuna-13B è¾¾å°äº OpenAI ChatGPT å Google Bard è¶ è¿ 90%* çè´¨éï¼åæ¶å¨è¶ è¿ 90% * çæ åµä¸ä¼äº LLaMA å Stanford Alpaca çå ¶ä»æ¨¡åãè®ç» Vicuna-13B çææ¬çº¦ä¸º 300 ç¾å ã ä»£ç å æé ï¼ä»¥åå¨çº¿ æ¼ç¤º ï¼åå·²å ¬å¼ä¾éåä¸ä½¿ç¨ã

Vicunaï¼ç± stable diffusion 2.1 çæï¼

Vicuna æå¤å¥½ï¼

å¾ 1. ç± GPT-4* è¯ä¼°çç¸å¯¹ååºè´¨é

å¨çº¿æ¼ç¤º

å¨ è¿é è¯ç¨ Vicuna-13B æ¼ç¤ºï¼

æ¦è¿°

å¾ 2. å·¥ä½æµç¨æ¦è¿°

è¡¨ 1. å ä¸ªèåæ¨¡åä¹é´çæ¯è¾

æ¨¡ååç§°

LLaMA

Alpaca

Vicuna

Bard/ChatGPT

æ°æ®é

å ¬å¼å¯ç¨çæ°æ®é

(1T token)

æ¥èª davinci-003 API çèªæå¯¼

(52K æ ·æ¬)

ç¨æ·å ±äº«çå¯¹è¯

(70K æ ·æ¬)

ä¸éç¨

è®ç»ä»£ç

å¯ç¨

è¯ä¼°ææ

å¦æ¯åºå

ä½è è¯ä¼°

GPT-4 è¯ä¼°

æ··å

è®ç»ææ¬

(7B)

82K GPU å°æ¶

$500 (æ°æ®) + $100 (è®ç»)

$140 (è®ç»)

(13B)

135K GPU å°æ¶

$300 (è®ç»)

è®ç»

å¤è½®å¯¹è¯ï¼ æä»¬è°æ´è®ç»æå¤±ä»¥èèå¤è½®å¯¹è¯ï¼å¹¶ä» æ ¹æ®èå¤©æºå¨äººçè¾åºè®¡ç®å¾®è°æå¤±ã

å åä¼åï¼ ä¸ºäºä½¿ Vicuna è½å¤çè§£é¿ä¸ä¸æï¼æä»¬å°æå¤§ä¸ä¸æé¿åº¦ä» alpaca ä¸ç 512 æ©å±å° 2048ï¼è¿å¤§å¤§å¢å äº GPU å åéæ±ãæä»¬éè¿å©ç¨ æ¢¯åº¦æ£æ¥ç¹ å éªåæ³¨æå æ¥åºå¯¹å åååã

éè¿ç«ä»·å®ä¾éä½ææ¬ï¼ è®ç»æ°æ®éå¤§ 40 åä¸åºåé¿åº¦é¿ 4 åï¼è¿å¯¹è®ç»è´¹ç¨ææäºç¸å½å¤§çææãæä»¬éç¨ SkyPilot æç®¡ç«ä»·å®ä¾ ï¼éè¿å©ç¨æ´ä¾¿å®çç«ä»·å®ä¾ä»¥åéå¯¹æ¢å çèªå¨æ¢å¤åèªå¨åºååæ¢æ¥éä½ææ¬ãè¯¥è§£å³æ¹æ¡å°è®ç» 7B æ¨¡åçææ¬ä» $500 éä½å°çº¦ $140 ï¼å° 13B æ¨¡åçææ¬ä»çº¦ $1K éä½å° $300 ã

æå¡

å¦ä½è¯ä¼°èå¤©æºå¨äººï¼

å¾ 3. GPT-4 è¯ä¼°çååºæ¯è¾

è¡¨ 2. GPT-4 è¯ä¼°çæ»åã

åºçº¿

åºçº¿åæ°

Vicuna åæ°

LLaMA-13B

513.0

694.0

Alpaca-13B

583.0

704.0

Bard

664.0

655.5

ChatGPT

693.0

638.0

å±éæ§

åå¸

å¨æä»¬çé¦æ¬¡åå¸ä¸ï¼æä»¬å°å¨ GitHub ä»åºåäº«è®ç»ãæå¡åè¯ä¼°ä»£ç ï¼ https://github.com/lm-sys/FastChat ã æä»¬è¿åå¸äº Vicuna-13B æ¨¡å æé ã æ²¡æè®¡ååå¸æ°æ®éãå å ¥æä»¬ç Discord æå¡å¨å¹¶å ³æ³¨æä»¬ç Twitter ä»¥è·åææ°æ´æ°ã

è®¸å¯

å¨çº¿æ¼ç¤ºæ¯ä» ééåä¸ç¨éçç ç©¶é¢è§ï¼å LLaMA çæ¨¡å è®¸å¯ ãOpenAI çææ°æ®ç ä½¿ç¨æ¡æ¬¾ ä»¥å ShareGPT ç éç§å®è·µ çº¦æãå¦ææ¨åç°ä»»ä½æ½å¨è¿è§ï¼è¯·èç³»æä»¬ã ä»£ç å¨ Apache License 2.0 ä¸åå¸ã

è´è°¢

æä»¬è¦æè°¢ BAIR ç Xinyang GengãHao Liu å Eric Wallaceï¼æ¯å¦ç¦ Alpaca å¢éç Xuecheng Li å Tianyi Zhang çæ·±å ¥è®¨è®ºååé¦ï¼MBZUAI ç Qirong Ho å¨æå¡éç¾¤ä¸æä¾çæ¯æãè¯·æ¥ç BAIR å ³äºä»ä»¬èå¤©æºå¨äºº Koala å¹¶è¡å·¥ä½çåå®¢æç« ã

å¢é

è¿æ¯ä¸æ¥èªå¤ä¸ªæºæçåä½è çèååªåï¼å æ¬ UC BerkeleyãCMUãæ¯å¦ç¦ãUC San Diego å MBZUAIã

å¦çï¼æåæ¯é¡ºåºï¼ï¼ Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang (â), Lianmin Zheng (â), Siyuan Zhuang, Yonghao Zhuang

é¡¾é®ï¼æåæ¯é¡ºåºï¼ï¼ Joseph E. Gonzalez, Ion Stoica, Eric P. Xing

â éè®¯ä½è ï¼ Lianmin Zheng ( [email protected] ), Hao Zhang ( [email protected] ), æ LMSYS ( [email protected] )ã

å¼ç¨

code

@misc{vicuna2023,
    title = {Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90\%* ChatGPT Quality},
    url = {https://lmsys.org/blog/2023-03-30-vicuna/},
    author = {Chiang, Wei-Lin and Li, Zhuohan and Lin, Zi and Sheng, Ying and Wu, Zhanghao and Zhang, Hao and Zheng, Lianmin and Zhuang, Siyuan and Zhuang, Yonghao and Gonzalez, Joseph E. and Stoica, Ion and Xing, Eric P.},
    month = {March},
    year = {2023}
}

å¨è¿ç¯åå®¢æç« ä¹åï¼æä»¬æ©å±äºåºäº GPT-4 çè¯ä¼°æ³æ³ï¼å¹¶æ°åäºä¸ç¯æ´æ£å¼çè®ºæï¼ç³»ç»å°ç ç©¶äºè¿ç§âLLM-as-a-judgeâæ¹æ³ã æ¬¢è¿é è¯»å¹¶å¼ç¨è¿ç¯è®ºæï¼ Judging LLM-as-a-judge with MT-Bench and Chatbot Arena ã

æ¥æºï¼ LMSYSï¼Blog Â· lmsys.org

å¼æºçæ

æ¨¡ååå¸

è¯æµåºå

#

è¯æµ/åºå

LMSYS 发布开源聊天模型 Vicuna-13B，用 ShareGPT 对话微调 LLaMA，训练成本约 $300

TL;DR · AI 摘要

核心要点

LMSYS åå¸å¼æºèå¤©æ¨¡å Vicuna-13Bï¼ç¨ ShareGPT å¯¹è¯å¾®è° LLaMAï¼è®­ç»ææ¬çº¦ $300 Â· AIHOT

LMSYS åå¸å¼æºèå¤©æ¨¡å Vicuna-13Bï¼ç¨ ShareGPT å¯¹è¯å¾®è° LLaMAï¼è®­ç»ææ¬çº¦ $300

Vicuna æå¤å¥½ï¼

å¨çº¿æ¼ç¤º

æ¦è¿°

è®­ç»

æå¡

å¦ä½è¯ä¼°èå¤©æºå¨äººï¼

å±éæ§

åå¸

è®¸å¯

è´è°¢

å¢é

å¼ç¨

LMSYS åå¸å¼æºèå¤©æ¨¡å Vicuna-13Bï¼ç¨ ShareGPT å¯¹è¯å¾®è° LLaMAï¼è®ç»ææ¬çº¦ $300 Â· AIHOT

LMSYS åå¸å¼æºèå¤©æ¨¡å Vicuna-13Bï¼ç¨ ShareGPT å¯¹è¯å¾®è° LLaMAï¼è®ç»ææ¬çº¦ $300

Vicuna æå¤å¥½ï¼

å¨çº¿æ¼ç¤º

æ¦è¿°

è®ç»

æå¡

å¦ä½è¯ä¼°èå¤©æºå¨äººï¼

å±éæ§

åå¸

è®¸å¯

è´è°¢

å¢é

å¼ç¨