---
title: "It's worth pointing out that we have been pushing on large-scale training and asynchronous technique..."
source_name: "Jeff Dean(@JeffDean)"
original_url: "https://x.com/JeffDean/status/2047408945950802186"
canonical_url: "https://www.traeai.com/articles/ce01cb9c-6470-461f-9188-d1773f13d589"
content_type: "tweet"
language: "中文"
score: 5
tags: []
published_at: "2026-04-23T20:15:06+00:00"
created_at: "2026-04-23T23:05:51.424305+00:00"
---

# It's worth pointing out that we have been pushing on large-scale training and asynchronous technique...

Canonical URL: https://www.traeai.com/articles/ce01cb9c-6470-461f-9188-d1773f13d589
Original source: https://x.com/JeffDean/status/2047408945950802186

## Summary

traeai 为开发者、研究员和内容团队筛选高质量 AI 技术内容，提供摘要、评分、趋势雷达与一键内容产出。

## Key Takeaways

- 
- 
- 

## Content

Title: Jeff Dean on X: "It's worth pointing out that we have been pushing on large-scale training and asynchronous techniques for the last ~14 years.  Here's our NeurIPS 2012 paper where we demonstrated that this approach could be used to train very large neural networks (for the time: 30X larger than" / X

URL Source: http://x.com/JeffDean/status/2047408945950802186

Markdown Content:
# Jeff Dean on X: "It's worth pointing out that we have been pushing on large-scale training and asynchronous techniques for the last ~14 years. Here's our NeurIPS 2012 paper where we demonstrated that this approach could be used to train very large neural networks (for the time: 30X larger than" / X

Don’t miss what’s happening

People on X are the first to know.

[Log in](http://x.com/login)

[Sign up](http://x.com/i/flow/signup)

# [](http://x.com/)

## Post

See new posts

# Conversation

[![Image 1](https://pbs.twimg.com/profile_images/935325968280907776/AcBo6zJc_normal.jpg)](http://x.com/JeffDean)

[Jeff Dean](http://x.com/JeffDean)

[@JeffDean](http://x.com/JeffDean)

It's worth pointing out that we have been pushing on large-scale training and asynchronous techniques for the last ~14 years. Here's our NeurIPS 2012 paper where we demonstrated that this approach could be used to train very large neural networks (for the time: 30X larger than any previous neural network), and to spread the training out across thousands of machines in a fault-tolerant manner. PDF: [https://static.googleusercontent.com/media/research.google.com/en//archive/large_deep_networks_nips2012.pdf…](https://t.co/UK1GlSt91h)[https://static.googleusercontent.com/media/research.google.com/en//archive/large_deep_networks_nips2012.pdf…](https://t.co/UK1GlSt91h) (This paper doesn't get as much attention because we neglected to put it on Arxiv at the time: oops!)

[8:15 PM · Apr 23, 2026](http://x.com/JeffDean/status/2047408945950802186)

·

[3,515 Views](http://x.com/JeffDean/status/2047408945950802186/analytics)

3

1

23

5

## New to X?

Sign up now to get your own personalized timeline!

Sign up with Apple

[Create account](http://x.com/i/flow/signup)

By signing up, you agree to the [Terms of Service](https://x.com/tos) and [Privacy Policy](https://x.com/privacy), including [Cookie Use.](https://help.x.com/rules-and-policies/twitter-cookies)

## Relevant people

*     [![Image 2](https://pbs.twimg.com/profile_images/935325968280907776/AcBo6zJc_normal.jpg)](http://x.com/JeffDean)       [Jeff Dean](http://x.com/JeffDean) [@JeffDean](http://x.com/JeffDean)    Follow   Click to Follow JeffDean  Chief Scientist, Google DeepMind & Google Research. Gemini Lead. Opinions stated here are my own, not those of Google. TensorFlow, MapReduce, Bigtable, ...   

# Trending now

## What’s happening

Trending in United States

Intel

Sports · Trending

Tanner Scott

Politics · Trending

Lisa Murkowski

Trending with [Thom Tillis](http://x.com/search?q=Thom%20Tillis&src=trend_click&vertical=trends)

Sports · Trending

#FlyTheW

[Show more](http://x.com/explore/tabs/for-you)

[Terms of Service](https://x.com/tos)

|

[Privacy Policy](https://x.com/privacy)

|

[Cookie Policy](https://support.x.com/articles/20170514)

|

[Accessibility](https://help.x.com/resources/accessibility)

|

[Ads info](https://business.x.com/en/help/troubleshooting/how-twitter-ads-work.html?ref=web-twc-ao-gbl-adsinfo&utm_source=twc&utm_medium=web&utm_campaign=ao&utm_content=adsinfo)

|

More

© 2026 X Corp.