AI Paper Review: Improving Language Understanding by Generative Pre-Training (GPT-1)
freeCodeCamp.org2226 字 (约 9 分钟)
87
GPT-1 introduced a two-stage approach combining unsupervised generative pre-training with task-specific fine-tuning, significantly advancing language understanding and laying the foundation for large language models.
入选理由:GPT-1 采用无监督预训练与有监督微调结合的两阶段范式,提升多任务NLP性能。
FeaturedArticle#GPT#Transformer#NLP#Pre-trained Models#OpenAI英文
