---
title: "如何讓 Transformer 知道輸入 Token 的順序？Absolute、Relative、RoPE、到沒有 Positional Embedding"
source_name: "Hung-yi Lee"
original_url: "https://www.youtube.com/watch?v=Ll-wk8x3G_g"
canonical_url: "https://www.traeai.com/articles/056f5b9a-38c5-4bff-b6d0-8777e8629e35"
content_type: "video"
language: "中文"
score: 5
tags: ["Transformer","位置编码","RoPE","深度学习"]
published_at: "2026-03-30T04:08:22+00:00"
created_at: "2026-04-18T13:47:49.956966+00:00"
---

# 如何讓 Transformer 知道輸入 Token 的順序？Absolute、Relative、RoPE、到沒有 Positional Embedding

Canonical URL: https://www.traeai.com/articles/056f5b9a-38c5-4bff-b6d0-8777e8629e35
Original source: https://www.youtube.com/watch?v=Ll-wk8x3G_g

## Summary

文章实际内容无法获取，仅显示 YouTube 的反爬虫验证页面，无有效技术信息。

## Key Takeaways

- 原始链接返回 429 错误，内容不可访问
- 页面仅为 Google 的机器人验证提示
- 无法提取关于 Transformer 位置编码的技术细节

## Content

Title: http://www.youtube.com/watch?v=Ll-wk8x3G_g

URL Source: http://www.youtube.com/watch?v=Ll-wk8x3G_g

Warning: Target URL returned error 429: Too Many Requests

Markdown Content:
# http://www.youtube.com/watch?v=Ll-wk8x3G_g

* * *

* * *

**About this page**

 Our systems have detected unusual traffic from your computer network. This page checks to see if it's really you sending the requests, and not a robot. [Why did this happen?](http://www.youtube.com/watch?v=Ll-wk8x3G_g#)

 This page appears when Google automatically detects requests coming from your computer network which appear to be in violation of the [Terms of Service](http://www.google.com/policies/terms/). The block will expire shortly after those requests stop. In the meantime, solving the above CAPTCHA will let you continue to use our services.

This traffic may have been sent by malicious software, a browser plug-in, or a script that sends automated requests. If you share your network connection, ask your administrator for help — a different computer using the same IP address may be responsible. [Learn more](http://support.google.com/websearch/answer/86640)

Sometimes you may be asked to solve the CAPTCHA if you are using advanced terms that robots are known to use, or sending requests very quickly. 

 IP address: 2600:1900:0:4005::1401

Time: 2026-04-18T13:47:43Z

URL: http://www.youtube.com/watch?v=Ll-wk8x3G_g