T
traeai
Sign in

模型

MLLM

别名:Multimodal Large Language Model

多模态大语言模型,能够理解文本、图像和视频等多种输入形式。

已跟踪 2 条高相关材料

TraeAI 观察

相关材料

已收录 2 条与 MLLM 相关的内容,按评分排序。

字节开源统一框架Bernini:给DiT配个“大模型军师”,AI视频编辑先理解再动手

ByteDance open-sources Bernini, a unified framework for video generation and editing that uses a multimodal large model (MLLM) to understand semantic instructions first, then delegates high-quality rendering to a DiT diffusion model, enabling a paradigm shift from 'listening to prompts' to 'understanding before acting' in AI video creation, supporting controllable editing and reference-based generation.

入选理由:Bernini采用MLLM-based planner + DiT-based renderer双阶段架构,实现语义理解与视觉生成的解耦。

FeaturedArticle#AI Video Generation#Video Editing#Bernini#DiT#Multimodal Large Model中文
Multimodal evaluators: MLLM-as-a-judge for image-to-text tasks in Strands Evals

Multimodal Evaluators: MLLM-as-a-Judge for Image-to-Text Tasks in Strands Evals

AWS Machine Learning Blog2366 字 (约 10 分钟)
85

AWS announced four new multimodal evaluators (Overall Quality, Correctness, Faithfulness, Instruction Following) using MLLM-as-a-Judge approach, evaluating whether model responses align with image content by providing source data directly to the model, effectively detecting visual hallucinations and factual errors.

入选理由:Gartner预测到2030年,80%的企业软件将采用多模态技术,比2024年不足10%大幅增长,凸显自动化多模态评估的重要性。

FeaturedArticle#AWS#Multimodal Evaluation#Strands Evals#MLLM-as-a-Judge#Image Understanding英文

跨材料问答 · MLLM

回答基于:MLLM 相关 2 条材料
    0 / 500

    AI may generate inaccurate information. Please verify important content.