Alec Radford

GPT-2 demonstrated that training a large language model solely on unsupervised next-word prediction enables emergent multitask capabilities, performing translation, QA, and summarization without task-specific fine-tuning.

GPT-1 introduced a two-stage approach combining unsupervised generative pre-training with task-specific fine-tuning, significantly advancing language understanding and laying the foundation for large language models.

该推文仅提及名为 'talkie' 的项目由三位开发者创建，无技术细节、功能说明或上下文，信息密度极低。