AI Paper Review: Improving Language Understanding by Generative Pre-Training (GPT-1)
GPT-1 introduced a two-stage approach combining unsupervised generative pre-training with task-specific fine-tuning, significantly advancing language understanding and laying the foundation for large language models.
入选理由:GPT-1 采用无监督预训练与有监督微调结合的两阶段范式,提升多任务NLP性能。
