It's been a delight to provide small amounts of advice and suggestions to people working on the Deco...
Thread ⬇️" / X
Jeff Dean on X: "It's been a delight to provide small amounts of advice and suggestions to people working on the Decoupled DiLoCo training system. This approach enables graceful handling of failures in large scale training jobs, by allowing (N-1) / N units to proceed when one fails. Thread ⬇️" / X
Don’t miss what’s happening
People on X are the first to know.
Post
See new posts
Conversation
It's been a delight to provide small amounts of advice and suggestions to people working on the Decoupled DiLoCo training system. This approach enables graceful handling of failures in large scale training jobs, by allowing (N-1) / N units to proceed when one fails. Thread !Image 3: ⬇️
Quote
Arthur Douillard
@Ar_Douillard
·
2h
The DiLoCo team at Google DeepMind and Google Research is proud to release Decoupled DiLoCo, the next frontier for resilient AI pre-training. Decoupled DiLoCo enables training with datacenters across the world, using heterogeneous hardware, and never halting the system despite
The media could not be played.
Reload
·
8
23
236
76
Read 8 replies
New to X?
Sign up now to get your own personalized timeline!
Sign up with Apple
By signing up, you agree to the Terms of Service and Privacy Policy, including Cookie Use.
Trending now
What’s happening
Politics · Trending
Neera
Trending in United States
James Wood
Sports · Trending
Caleb Downs
Sports · Trending
Carnell Tate
|
|
|
|
|
More
© 2026 X Corp.