MLLM

ByteDance open-sources Bernini, a unified framework for video generation and editing that uses a multimodal large model (MLLM) to understand semantic instructions first, then delegates high-quality rendering to a DiT diffusion model, enabling a paradigm shift from 'listening to prompts' to 'understanding before acting' in AI video creation, supporting controllable editing and reference-based generation.

AWS announced four new multimodal evaluators (Overall Quality, Correctness, Faithfulness, Instruction Following) using MLLM-as-a-Judge approach, evaluating whether model responses align with image content by providing source data directly to the model, effectively detecting visual hallucinations and factual errors.

VideoChat3是首个全开放的视频多模态大模型，支持高效通用视频理解，但技术细节披露有限。