Jeff Dean(@JeffDean)
It's been a delight to provide small amounts of advice and suggestions to people working on the Deco...
5.0内容质量
TL;DR · AI 摘要
核心要点
Thread ⬇️" / X
Jeff Dean on X: "It's been a delight to provide small amounts of advice and suggestions to people working on the Decoupled DiLoCo training system. This approach enables graceful handling of failures in large scale training jobs, by allowing (N-1) / N units to proceed when one fails. Thread ⬇️" / X
Don’t miss what’s happening
It's been a delight to provide small amounts of advice and suggestions to people working on the Decoupled DiLoCo training system. This approach enables graceful handling of failures in large scale training jobs, by allowing (N-1) / N units to proceed when one fails. Thread 
Quote
Arthur Douillard
@Ar_Douillard
·
2h
The DiLoCo team at Google DeepMind and Google Research is proud to release Decoupled DiLoCo, the next frontier for resilient AI pre-training. Decoupled DiLoCo enables training with datacenters across the world, using heterogeneous hardware, and never halting the system despite
The media could not be played.
Reload
·
8
23
236
76
Read 8 replies