LLM Gateway

Assembly AI shipped major advancements in May: LLM Gateway now supports reasoning via a single parameter (low/medium/high) and abstracts provider differences; streaming speaker diarization accuracy jumped with 66% fewer false alarms and 60% fewer phantom turns, per-word speaker labels, and continuous partials every ~3 seconds; Playground now previews 34 voices and allows public sharing; PII redaction is live for streaming, automatically removing names, phone numbers, credit card numbers in real

LangSmith LLM Gateway 提供成本控制功能，防止代理程序在一夜之间消耗大量资金。