T
traeai
Sign in

模型

什么是 MLLM

也叫:Multimodal Large Language Model

多模态大语言模型,能够理解文本、图像和视频等多种输入形式。

为什么现在值得关注?

最近变化

2026-06-02 · Bernini采用MLLM-based planner + DiT-based renderer双阶段架构,实现语义理解与视觉生成的解耦。

MLLM 被反复提及时,通常意味着它正在影响产品路线、开发者工作流或 AI 产业判断。这个页面把分散材料合并成一个可持续更新的观察入口。

📰 MLLM 最新动态

已收录 2 篇与「MLLM」相关的 AI 资讯和分析。

字节开源统一框架Bernini:给DiT配个“大模型军师”,AI视频编辑先理解再动手

ByteDance open-sources Bernini, a unified framework for video generation and editing that uses a multimodal large model (MLLM) to understand semantic instructions first, then delegates high-quality rendering to a DiT diffusion model, enabling a paradigm shift from 'listening to prompts' to 'understanding before acting' in AI video creation, supporting controllable editing and reference-based generation.

入选理由:Bernini采用MLLM-based planner + DiT-based renderer双阶段架构,实现语义理解与视觉生成的解耦。

FeaturedArticle#AI Video Generation#Video Editing#Bernini#DiT#Multimodal Large Model中文
Multimodal evaluators: MLLM-as-a-judge for image-to-text tasks in Strands Evals

Multimodal Evaluators: MLLM-as-a-Judge for Image-to-Text Tasks in Strands Evals

AWS Machine Learning Blog2366 字 (约 10 分钟)
85

AWS announced four new multimodal evaluators (Overall Quality, Correctness, Faithfulness, Instruction Following) using MLLM-as-a-Judge approach, evaluating whether model responses align with image content by providing source data directly to the model, effectively detecting visual hallucinations and factual errors.

入选理由:Gartner预测到2030年,80%的企业软件将采用多模态技术,比2024年不足10%大幅增长,凸显自动化多模态评估的重要性。

FeaturedArticle#AWS#Multimodal Evaluation#Strands Evals#MLLM-as-a-Judge#Image Understanding英文

与「MLLM」经常一起出现的 AI 术语。

💡 想追踪「MLLM」的长期趋势?去 实体雷达 · MLLM 查看详细分析和跨材料问答。

AI may generate inaccurate information. Please verify important content.