---
title: "Goblin and related magical mentions were overrewarded in training, and the behavior was reinforced o..."
source_name: "OpenAI(@OpenAI)"
original_url: "https://x.com/OpenAI/status/2049690541269688478"
canonical_url: "https://www.traeai.com/articles/e3e74194-0fc6-4df4-81a2-250590a89828"
content_type: "tweet"
language: "英文"
score: 6
tags: ["AI","机器学习","OpenAI"]
published_at: "2026-04-30T03:21:21+00:00"
created_at: "2026-04-30T04:05:44.308816+00:00"
---

# Goblin and related magical mentions were overrewarded in training, and the behavior was reinforced o...

Canonical URL: https://www.traeai.com/articles/e3e74194-0fc6-4df4-81a2-250590a89828
Original source: https://x.com/OpenAI/status/2049690541269688478

## Summary

OpenAI发现其模型在训练中对哥布林等魔法生物的提及过度奖励，并在后续模型中强化了这种行为。为解决此问题，他们移除了与哥布林相关的奖励信号，并过滤了不相关上下文中的生物数据。

## Key Takeaways

- 哥布林等魔法生物在训练中被过度奖励。
- OpenAI已移除与哥布林相关的奖励信号。
- 训练数据中不相关上下文中的生物已被过滤。

## Content

Title: OpenAI on X: "Goblin and related magical mentions were overrewarded in training, and the behavior was reinforced over successive models.

We removed the goblin-affine reward signal for future models, and filtered training data where creatures appeared in irrelevant contexts. https://t.co/25kv9ZXNPk" / X

URL Source: http://x.com/OpenAI/status/2049690541269688478

Markdown Content:
# OpenAI on X: "Goblin and related magical mentions were overrewarded in training, and the behavior was reinforced over successive models. We removed the goblin-affine reward signal for future models, and filtered training data where creatures appeared in irrelevant contexts. https://t.co/25kv9ZXNPk" / X

Don’t miss what’s happening

People on X are the first to know.

[Log in](http://x.com/login)

[Sign up](http://x.com/i/flow/signup)

# [](http://x.com/)

## Post

See new posts

# Conversation

[![Image 3: Square profile picture](https://pbs.twimg.com/profile_images/1885410181409820672/ztsaR0JW_normal.jpg)](http://x.com/OpenAI)

[OpenAI](http://x.com/OpenAI)

[@OpenAI](http://x.com/OpenAI)

Goblin and related magical mentions were overrewarded in training, and the behavior was reinforced over successive models. We removed the goblin-affine reward signal for future models, and filtered training data where creatures appeared in irrelevant contexts.

[![Image 4: Image](https://pbs.twimg.com/media/HHH2IKYbUAEgqdj?format=jpg&name=small)](http://x.com/OpenAI/status/2049690541269688478/photo/1)

[3:21 AM · Apr 30, 2026](http://x.com/OpenAI/status/2049690541269688478)

·

[23.9K Views](http://x.com/OpenAI/status/2049690541269688478/analytics)

18

15

123

7

Read 18 replies

## New to X?

Sign up now to get your own personalized timeline!

Sign up with Apple

[Create account](http://x.com/i/flow/signup)

By signing up, you agree to the [Terms of Service](https://x.com/tos) and [Privacy Policy](https://x.com/privacy), including [Cookie Use.](https://help.x.com/rules-and-policies/twitter-cookies)

## Relevant people

*     [![Image 5: Square profile picture](https://pbs.twimg.com/profile_images/1885410181409820672/ztsaR0JW_normal.jpg)](http://x.com/OpenAI)       [OpenAI](http://x.com/OpenAI) [@OpenAI](http://x.com/OpenAI)    Follow   Click to Follow OpenAI  OpenAI’s mission is to ensure that artificial general intelligence benefits all of humanity. We’re hiring: [http://openai.com/jobs](https://t.co/dJGr6LgzPA)   

# Trending now

## What’s happening

Trending in United States

#Survivor50

Trending with [Cirie](http://x.com/search?q=Cirie&src=trend_click&vertical=trends), [Devens](http://x.com/search?q=Devens&src=trend_click&vertical=trends)

Trending in United States

RIP DAC

Sports · Trending

#LAFC

Sports · Trending

Flyers

Trending with [#IgniteTheOrange![Image 6](https://abs.twimg.com/hashflags/PhiladelphiaFlyersNHLPlayoffs2026/PhiladelphiaFlyersNHLPlayoffs2026.png)](http://x.com/search?q=%23IgniteTheOrange&src=trend_click&vertical=trends), [Cam York](http://x.com/search?q=Cam%20York&src=trend_click&vertical=trends)

[Show more](http://x.com/explore/tabs/for-you)

[Terms of Service](https://x.com/tos)

|

[Privacy Policy](https://x.com/privacy)

|

[Cookie Policy](https://support.x.com/articles/20170514)

|

[Accessibility](https://help.x.com/resources/accessibility)

|

[Ads info](https://business.x.com/en/help/troubleshooting/how-twitter-ads-work.html?ref=web-twc-ao-gbl-adsinfo&utm_source=twc&utm_medium=web&utm_campaign=ao&utm_content=adsinfo)

|

More

© 2026 X Corp.