T
traeai
Sign in

概念

Brier score

别名:Brier

衡量概率预测准确度的二次误差指标。

已跟踪 2 条高相关材料

TraeAI 观察

相关材料

已收录 2 条与 Brier score 相关的内容,按评分排序。

A Deep Dive into Calibration of Language Models: Platt Scaling, Isotonic Regression, Temperature Scaling

LLMs commonly suffer from overconfidence, which can be significantly mitigated by post-hoc calibration methods such as temperature scaling, Platt scaling, and isotonic regression, with temperature scaling being the preferred choice due to its simplicity and effectiveness.

入选理由:2024 NAACL调查显示,LLM在事实问答、代码生成和推理任务中的置信度与实际准确率差距可达30%+。

FeaturedArticle#LLM#Calibration#Temperature Scaling#Platt Scaling#Isotonic Regression中文
KDnuggets 图标

How to Calibrate Your Classifier’s Probabilities in Scikit-learn

KDnuggets2941 字 (约 12 分钟)
85

本文详解scikit-learn中分类器概率校准方法,通过Platt scaling和isotonic regression修复模型置信度偏差,提供可靠性图和Brier分数评估方案。

入选理由:使用Platt scaling可修正SVM等模型的sigmoid型概率偏差

FeaturedArticle#scikit-learn#机器学习#概率校准#模型评估英文

跨材料问答 · Brier score

回答基于:Brier score 相关 2 条材料
    0 / 500

    AI may generate inaccurate information. Please verify important content.