---
title: "Cloudflare Optimizes Edge Stack for High-Core CPUs Instead of Large Cache"
source_name: "InfoQ"
original_url: "https://www.infoq.com/news/2026/04/cache-parallelism-cloudflare/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=global"
canonical_url: "https://www.traeai.com/articles/78eb325e-5be2-4c62-af44-64aefd03e9c2"
content_type: "article"
language: "英文"
score: 7.5
tags: ["Cloudflare","边缘计算","架构优化","CPU"]
published_at: "2026-04-25T06:06:00+00:00"
created_at: "2026-04-25T22:58:55.102014+00:00"
---

# Cloudflare Optimizes Edge Stack for High-Core CPUs Instead of Large Cache

Canonical URL: https://www.traeai.com/articles/78eb325e-5be2-4c62-af44-64aefd03e9c2
Original source: https://www.infoq.com/news/2026/04/cache-parallelism-cloudflare/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=global

## Summary

Cloudflare优化了边缘计算架构，通过高核心CPU提升性能，而非依赖大容量缓存。

## Key Takeaways

- Cloudflare采用高核心CPU优化边缘堆栈性能。
- 减少对大容量缓存的依赖，提高并行处理能力。
- 展示了现代边缘计算架构设计的新思路。

## Content

Title: Cloudflare Optimizes Edge Stack for High-Core CPUs Instead of Large Cache

URL Source: http://www.infoq.com/news/2026/04/cache-parallelism-cloudflare/

Published Time: 2026-04-25T06:06:00+0000

Markdown Content:
# Cloudflare Optimizes Edge Stack for High-Core CPUs Instead of Large Cache - InfoQ

# Your choice regarding cookies on this site

We use cookies to optimise site functionality and give you the best possible experience.

I Accept I Do Not Accept Settings

[BT](http://www.infoq.com/int/bt/ "bt")

## InfoQ Software Architects' Newsletter

A monthly overview of things you need to know as an architect or aspiring architect.

[View an example](https://www.infoq.com/software-architects-newsletter#placeholderPastIssues)

Enter your e-mail address 

Select your country - [x] I consent to InfoQ.com handling my data as explained in this [Privacy Notice](https://www.infoq.com/privacy-notice). 

[We protect your privacy.](http://www.infoq.com/privacy-notice/)

Close

Live Webinar and Q&A: Designing Data Layers for Agentic AI: Patterns for State, Memory, and Coordination at Scale (May 12, 2026)[Save Your Seat](http://www.infoq.com/url/pb/7335c639-7219-4049-934f-9b4f7d82520e/)

Close 

Toggle Navigation 

Facilitating the Spread of Knowledge and Innovation in Professional Software Development

English edition 

*   [English edition](http://www.infoq.com/news/2026/04/cache-parallelism-cloudflare/#)
*   [Chinese edition](https://www.infoq.cn/)
*   [Japanese edition](http://www.infoq.com/jp/)
*   [French edition](http://www.infoq.com/fr/)

[Write for InfoQ](http://www.infoq.com/write-for-infoq/ "Write for InfoQ")

Search 

[Register](http://www.infoq.com/reginit.action?)[Sign in](http://www.infoq.com/social/keycloakLogin.action?fl=login)

## Unlock the full InfoQ experience

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources.

[Log In](http://www.infoq.com/social/keycloakLogin.action?fl=login)

or

### Don't have an InfoQ account?

[Register](http://www.infoq.com/reginit.action?)

*   **Stay updated on topics and peers that matter to you**Receive instant alerts on the latest insights and trends.
*   **Quickly access free resources for continuous learning**Minibooks, videos with transcripts, and training materials.
*   **Save articles and read at anytime**Bookmark articles to read whenever youre ready.

[Logo - Back to homepage](http://www.infoq.com/)

[News](http://www.infoq.com/news/)[Articles](http://www.infoq.com/articles/)[Presentations](http://www.infoq.com/presentations/)[Podcasts](http://www.infoq.com/podcasts/)[Guides](http://www.infoq.com/minibooks/)

### Topics

[Development](http://www.infoq.com/development/ "Development")

*   [Java](http://www.infoq.com/java/ "Java")
*   [Kotlin](http://www.infoq.com/kotlin/ "Kotlin")
*   [.Net](http://www.infoq.com/dotnet/ ".Net")
*   [C#](http://www.infoq.com/c_sharp/ "C#")
*   [Swift](http://www.infoq.com/swift/ "Swift")
*   [Go](http://www.infoq.com/golang/ "Go")
*   [Rust](http://www.infoq.com/rust/ "Rust")
*   [JavaScript](http://www.infoq.com/javascript/ "JavaScript")

### Featured in Development

*   #### [From VR to Flat Screens: Bridging the Input and Immersion Gap](http://www.infoq.com/presentations/game-vr-flat-screens)

Dany Lepage discusses the architectural journey of porting a hit VR title to seven non-VR platforms. He explains how his team solved the challenges of cross-progression, diverse input paradigms, and maintaining release velocity across Steam, iOS, and PlayStation. Beyond the tech, he shares candid lessons on the "product fit" gap when translating immersive social presence to 2D screens.

  [![Image 2: From VR to Flat Screens: Bridging the Input and Immersion Gap](https://imgopt.infoq.com/fit-in/100x100/filters:quality(80)/presentations/game-vr-flat-screens/en/smallimage/thumbnail-1775637585504.jpg)](http://www.infoq.com/presentations/game-vr-flat-screens) 

[All in development](http://www.infoq.com/development/)Follow Topic

[Architecture & Design](http://www.infoq.com/architecture-design/ "Architecture & Design")

*   [Architecture](http://www.infoq.com/architecture/ "Architecture")
*   [Enterprise Architecture](http://www.infoq.com/enterprise-architecture/ "Enterprise Architecture")
*   [Scalability/Performance](http://www.infoq.com/performance-scalability/ "Scalability/Performance")
*   [Design](http://www.infoq.com/design/ "Design")
*   [Case Studies](http://www.infoq.com/Case_Study/ "Case Studies")
*   [Microservices](http://www.infoq.com/microservices/ "Microservices")
*   [Service Mesh](http://www.infoq.com/servicemesh/ "Service Mesh")
*   [Patterns](http://www.infoq.com/DesignPattern/ "Patterns")
*   [Security](http://www.infoq.com/Security/ "Security")

### Featured in Architecture & Design

*   #### [How to Build an Exchange: Sub Millisecond Response Times and 24/7 Uptimes in the Cloud](http://www.infoq.com/presentations/exchange-systems-cloud)

Frank Yu shares Coinbase’s engineering philosophy for building resilient, fair, and fast financial exchanges. He explains the power of a single-threaded architecture combined with the Raft consensus algorithm to maintain 24/7 availability. He discusses how determinism enables zero-downtime rolling deployments and the ability to replay production logs for perfect bug reproduction.

  [![Image 3: How to Build an Exchange: Sub Millisecond Response Times and 24/7 Uptimes in the Cloud](https://imgopt.infoq.com/fit-in/100x100/filters:quality(80)/presentations/exchange-systems-cloud/en/smallimage/frank-yu-thumbnail-1776173818222.jpeg)](http://www.infoq.com/presentations/exchange-systems-cloud) 

[All in architecture-design](http://www.infoq.com/architecture-design/)Follow Topic

[AI Infrastructure](http://www.infoq.com/ai-ml-data-eng/ "AI Infrastructure")

*   [Big Data](http://www.infoq.com/bigdata/ "Big Data")
*   [Machine Learning](http://www.infoq.com/machinelearning/ "Machine Learning")
*   [NoSQL](http://www.infoq.com/nosql/ "NoSQL")
*   [Database](http://www.infoq.com/database/ "Database")
*   [Data Analytics](http://www.infoq.com/data-analytics/ "Data Analytics")
*   [Streaming](http://www.infoq.com/streaming/ "Streaming")

### Featured in AI, ML & Data Engineering

*   #### [Deepfakes, Disinformation, and AI Content Are Taking Over the Internet](http://www.infoq.com/presentations/deepfakes-ai)

Shuman Ghosemajumder explains how generative AI has transformed from a creative curiosity into a high-scale tool for disinformation and fraud. He shares insights on "Disinformation Automation," the fallacy of CAPTCHA in an AI world, and why engineering leaders must adopt zero-trust "cyber fusion" strategies to defend against automated attacks that mimic human behavior with chilling accuracy.

  [![Image 4: Deepfakes, Disinformation, and AI Content Are Taking Over the Internet](https://imgopt.infoq.com/fit-in/100x100/filters:quality(80)/presentations/deepfakes-ai/en/smallimage/shuman-ghosemajumder-thumbnail-1776248048343.jpeg)](http://www.infoq.com/presentations/deepfakes-ai) 

[All in ai-ml-data-eng](http://www.infoq.com/ai-ml-data-eng/)Follow Topic

[Culture & Methods](http://www.infoq.com/culture-methods/ "Culture & Methods")

*   [Agile](http://www.infoq.com/agile/ "Agile")
*   [Diversity](http://www.infoq.com/diversity/ "Diversity")
*   [Leadership](http://www.infoq.com/leadership/ "Leadership")
*   [Lean/Kanban](http://www.infoq.com/lean/ "Lean/Kanban")
*   [Personal Growth](http://www.infoq.com/personal-growth/ "Personal Growth")
*   [Scrum](http://www.infoq.com/scrum/ "Scrum")
*   [Sociocracy](http://www.infoq.com/sociocracy/ "Sociocracy")
*   [Software Craftmanship](http://www.infoq.com/software_craftsmanship/ "Software Craftmanship")
*   [Team Collaboration](http://www.infoq.com/team-collaboration/ "Team Collaboration")
*   [Testing](http://www.infoq.com/testing/ "Testing")
*   [UX](http://www.infoq.com/ux/ "UX")

### Featured in Culture & Methods

*   #### [Panel: Building a Culture that Works](http://www.infoq.com/presentations/panel-positive-culture)

The panelists share insights on evolving company culture. They discuss leveraging feedback loops, lending social capital, and the friction between legacy bureaucracy and agile engineering. The panel explains how to maintain cohesion in remote teams and use interviews to uncover the true "unmanicured" culture of a firm.

  [![Image 5: Panel: Building a Culture that Works](https://imgopt.infoq.com/fit-in/100x100/filters:quality(80)/presentations/panel-positive-culture/en/smallimage/ln-500x500-1775048593311.jpg)](http://www.infoq.com/presentations/panel-positive-culture) 

[All in culture-methods](http://www.infoq.com/culture-methods/)Follow Topic

[DevOps](http://www.infoq.com/devops/)

*   [Infrastructure](http://www.infoq.com/infrastructure/ "Infrastructure")
*   [Continuous Delivery](http://www.infoq.com/continuous_delivery/ "Continuous Delivery")
*   [Automation](http://www.infoq.com/automation/ "Automation")
*   [Containers](http://www.infoq.com/containers/ "Containers")
*   [Cloud](http://www.infoq.com/cloud-computing/ "Cloud")
*   [Observability](http://www.infoq.com/observability/ "Observability")

### Featured in DevOps

*   #### [Beyond One-Click: Designing an Enterprise-Grade Observability Extension for Docker](http://www.infoq.com/articles/enterprise-grade-observability-extension-docker)

Docker Extensions boost developer speed but create a "visibility gap" by isolating telemetry. To meet enterprise needs, extensions must act as bridges to centralized platforms. This article details how to use OpenTelemetry, policy-as-code, and encryption to build secure pipelines. Learn to balance developer productivity with the governance required for scalable, compliant observability.

  [![Image 6: Beyond One-Click: Designing an Enterprise-Grade Observability Extension for Docker](https://imgopt.infoq.com/fit-in/100x100/filters:quality(80)/articles/enterprise-grade-observability-extension-docker/en/smallimage/enterprise-grade-observability-extension-docker-thumbnail-1775560652994.jpg)](http://www.infoq.com/articles/enterprise-grade-observability-extension-docker) 

[All in devops](http://www.infoq.com/devops/)Follow Topic

[Events](https://events.infoq.com/ "Events")

### Helpful links

*   [About InfoQ](http://www.infoq.com/about-infoq "About InfoQ")
*   [InfoQ Editors](http://www.infoq.com/infoq-editors "InfoQ Editors")
*   [Write for InfoQ](http://www.infoq.com/write-for-infoq "Write for InfoQ")
*   [About C4Media](https://c4media.com/ "About C4Media")
*   [Diversity](https://c4media.com/diversity "Diversity")

### Choose your language

*   [En](http://www.infoq.com/news/2026/04/cache-parallelism-cloudflare/# "InfoQ English")
*   [中文](https://www.infoq.cn/)
*   [日本](http://www.infoq.com/jp/)
*   [Fr](http://www.infoq.com/fr/)

[![Image 7: InfoQ Architect Certification - image](https://imgopt.infoq.com/eyJidWNrZXQiOiAiYXNzZXRzLmluZm9xLmNvbSIsImtleSI6ICJ3ZWIvaGVhZGVyL2NvbmZlcmVuY2VzLzIwMjYvT25saW5lQ29ob3J0c01hcmNoMjAyNi10b3AtdjQuanBnIiwiZWRpdHMiOiB7ImpwZWciOiB7ICJxdWFsaXR5Ijo4MH19fQ==) Online InfoQ Architect Certification Join Luca Mezzalira for this 5-week online cohort. Master socio-technical architecture leadership. **Register Now.**](https://certification.qconferences.com/?utm_source=infoq&utm_medium=referral&utm_campaign=homepageheader_onlinecohortaprmayjun26)[![Image 8: QCon AI Boston - image](https://imgopt.infoq.com/eyJidWNrZXQiOiAiYXNzZXRzLmluZm9xLmNvbSIsImtleSI6ICJ3ZWIvaGVhZGVyL2NvbmZlcmVuY2VzLzIwMjYvUUNvbi1BSS1Cb3N0b24tMjAyNi10b3AuanBnIiwiZWRpdHMiOiB7ImpwZWciOiB7ICJxdWFsaXR5Ijo4MH19fQ==) QCon AI Boston Learn how leading engineering teams run AI in production—reliably, securely, and at scale. **Early Bird ends April 14.**](https://boston.qcon.ai/?utm_source=infoq&utm_medium=referral&utm_campaign=homepageheader_qaiboston26)[![Image 9: QCon San Francisco - image](https://imgopt.infoq.com/eyJidWNrZXQiOiAiYXNzZXRzLmluZm9xLmNvbSIsImtleSI6ICJ3ZWIvaGVhZGVyL2NvbmZlcmVuY2VzLzIwMjYvUUNvbi1TRi0yMDI2LXRvcC5qcGciLCJlZGl0cyI6IHsianBlZyI6IHsgInF1YWxpdHkiOjgwfX19) QCon San Francisco Learn what's next in AI and software, from teams already doing it. **Early Bird ends April 14.**](https://qconsf.com/?utm_source=infoq&utm_medium=referral&utm_campaign=homepageheader_qsf26)

[InfoQ Homepage](http://www.infoq.com/ "InfoQ Homepage")[News](http://www.infoq.com/news "News")Cloudflare Optimizes Edge Stack for High-Core CPUs Instead of Large Cache

[Cloud](http://www.infoq.com/Cloud/ "Cloud")

[Online InfoQ Architect Certification (April 15): Peer conversations that change how you think.](https://certification.qconferences.com/?utm_source=infoq&utm_medium=referral&utm_campaign=infoqyellowbox_onlinecohortaprmayjun26)

# Cloudflare Optimizes Edge Stack for High-Core CPUs Instead of Large Cache

Apr 25, 2026 2 min read

by

*   [![Image 10: Author photo](https://cdn.infoq.com/statics_s1_20260421232814/images/profiles/ptroF8HdI2vWXm0NDaKeS0JdiPxMOAra.jpg)](http://www.infoq.com/profile/Renato-Losio/)[Renato Losio](http://www.infoq.com/profile/Renato-Losio/)

Follow Cloud Expert | AWS Data Hero 

#### Write for InfoQ

**Feed your curiosity.**Help 550k+ global 

senior developers 

each month stay ahead.[Get in touch](https://www.infoq.com/write-for-infoq/)

Log in to listen to this article

Loading audio

 Your browser does not support the audio element. 

0:00 0:00

Normal 1.25x 1.5x

Like

*   [Reading list](http://www.infoq.com/showbookmarks.action)

Cloudflare [recently introduced its Gen 13 servers](https://blog.cloudflare.com/gen13-launch/), marking a shift in how its network handles traffic. Instead of relying on large CPU caches for speed, the company redesigned its software to leverage many more processor cores working in parallel in its latest AMD-based servers.

Highlighting the importance of hardware–software co-design, Cloudflare moved away from relying on very large CPU caches that had compensated for software that did not scale well across many cores. The hardware and software changes enable greater capacity per server and improved performance for edge applications, while enhancing energy efficiency.

According to the specifications, Gen 13 is designed with a 192-core[AMD EPYC Turin 9965](https://www.amd.com/en/products/processors/server/epyc/9005-series/amd-epyc-9965.html) processor, 768 GB of DDR5-6400 memory, 24 TB of PCIe 5.0 NVMe storage, and a dual 100 GbE network interface card. The new specs allow Gen 13 servers to handle up to twice as much traffic as the [previous Gen 12](https://blog.cloudflare.com/gen-12-servers/), which runs on the AMD Genoa-X 9684X, while meeting the same response-time targets. The changes deliver around 60% more capacity per rack without increasing power use, while also increasing available memory, storage, and network bandwidth.

In a separate article, "[Inside Gen 13: how we built our most powerful server yet](https://blog.cloudflare.com/gen13-config/)," [Syona Sarma](https://www.linkedin.com/in/syona-sarma-7824222/), JQ Lau, [Ma Xiong](https://www.linkedin.com/in/maxiong/), and [Victor Hwang](https://www.linkedin.com/in/victor-hwang/) explain the engineering choices behind the new platform, discussing the AMD EPYC 9965 server layout and components, along with details on the ideal GB-per-core configuration, thermal efficiency, and the transition to 100 GbE networking. In the post focusing on how the company aligned hardware with its [redesigned Rust-based FL2 software stack](https://blog.cloudflare.com/20-percent-internet-upgrade/), they write:

> The goal was to support workloads that now scale with parallelism rather than cache, enabling significantly higher request capacity and better performance-per-watt across Cloudflare’s global edge infrastructure.

According to the authors, Cloudflare had previously relied on processors with very large L3 caches to keep latency low, as parts of its software were not fully optimized. When testing newer Turin Dense CPUs, which have about one-third of that cache, latency initially increased by around 50%. By working with AMD to analyze the issue and rewriting key parts of their software, Cloudflare eliminated this latency penalty and unlocked significant gains. The team adds:

> FL2's cleaner architecture, with better memory access patterns and less dynamic allocation, might not depend on massive L3 caches the way FL1 did. This gave us an opportunity to use the FL2 transition to prove whether Gen 13's throughput gains could be realized without the latency penalty.

On a popular [Hacker News thread](https://news.ycombinator.com/item?id=47495795), many readers found the architectural shift interesting but questioned how much of the improvement came from the hardware versus the software rewrite; several asked for clearer benchmarks and more technical details, with user _gdwatson_ commenting:

> I don’t think they explained how they solved the cache issue except to say they rewrote the software in Rust (...) They talked about Rust's greater memory safety; it would have been nice to know whether there were specific language features that played into the cache difference or whether it just made the authors comfortable using a systems language in this application and that made the difference.

Beyond the core architectural changes, the announcement also introduces PCIe encryption hardware support and improved support for thermally demanding PCIe accelerators.

## About the Author

[![Image 11](https://cdn.infoq.com/statics_s1_20260421232814/images/profiles/ptroF8HdI2vWXm0NDaKeS0JdiPxMOAra.jpg)](http://www.infoq.com/profile/Renato-Losio/)

#### **Renato Losio**

Renato has extensive experience as a cloud architect, tech lead, and cloud services specialist. Currently, he lives in Berlin and works remotely as a principal cloud architect. His primary areas of interest include cloud services and relational databases. He is an editor at InfoQ and a recognized AWS Data Hero. You can connect with him on LinkedIn.

Show more Show less

#### This content is in the [Cloud](http://www.infoq.com/Cloud/) topic

Follow Topic

##### Related Topics:

*   [Architecture & Design](http://www.infoq.com/architecture-design/)### [Architecture & Design](http://www.infoq.com/architecture-design)

Followers: 10208

Follow Topic 
*   [DevOps](http://www.infoq.com/Devops/)### [DevOps](http://www.infoq.com/Devops)

Followers: 5051

Follow Topic 
*   [Rust](http://www.infoq.com/Rust/)### [Rust](http://www.infoq.com/Rust)

Followers: 433

Follow Topic 
*   [Infrastructure](http://www.infoq.com/Infrastructure/)### [Infrastructure](http://www.infoq.com/Infrastructure)

Followers: 370

Follow Topic 
*   [Edge Computing](http://www.infoq.com/edgecomputing/)### [Edge Computing](http://www.infoq.com/edgecomputing)

Followers: 52

Follow Topic 
*   [Cloudflare](http://www.infoq.com/cloudflare/)### [Cloudflare](http://www.infoq.com/cloudflare)

Followers: 16

Follow Topic 
*   [AMD](http://www.infoq.com/amd/)### [AMD](http://www.infoq.com/amd)

Followers: 0

Follow Topic 
*   [Cloud](http://www.infoq.com/Cloud/)### [Cloud](http://www.infoq.com/Cloud)

Followers: 2128

Follow Topic 

*   
#### Related Editorial

    *   ##### [How Cloudflare Migrated Quicksilver to Multi-Level Caching While Serving Billions of Requests](http://www.infoq.com/news/2025/08/cloudflare-key-value-store/)

    *   ##### [Cloudflare Sandboxes Reach General Availability, Giving AI Agents Persistent Isolated Environments](http://www.infoq.com/news/2026/04/cloudflare-sandboxes-ga/)

    *   ##### [Cloudflare Outlines MCP Architecture as Enterprises Confront Security and Governance Risks](http://www.infoq.com/news/2026/04/cloudflare-mcp/)

    *   ##### [Cloudflare Launches Dynamic Workers Open Beta: Isolate-Based Sandboxing for AI Agent Code Execution](http://www.infoq.com/news/2026/04/cloudflare-dynamic-workers-beta/)

    *   ##### [Cloudflare Introduces Local Uploads for R2 to Cut Cross-Region Write Latency by 75%](http://www.infoq.com/news/2026/02/cloudflare-local-uploads/)

*       
#### Related Sponsors

    *   ##### [Understanding AI Agent Security](http://www.infoq.com/url/f/7f42b86b-2b7e-4739-bb97-15ed875fced5/)

    *   ##### [The missing layer in the agentic AI stack: Why AI applications need durable sessions](http://www.infoq.com/vendorcontent/show.action?vcr=e4d4adf1-4896-415e-a413-5bd03ffc94a5&primaryTopicId=2961&vcrPlace=BOTTOM&pageType=NEWS_PAGE&vcrReferrer=https%3A%2F%2Fwww.infoq.com%2Fnews%2F2026%2F04%2Fcache-parallelism-cloudflare%2F)

    *   ##### [Architecture Beyond the Diagram: Decisions, Systems, and the Forces That Shape Them - Download the InfoQ eMag](http://www.infoq.com/vendorcontent/show.action?vcr=09bd1106-7112-40f3-886b-3afb04b78888&primaryTopicId=2961&vcrPlace=BOTTOM&pageType=NEWS_PAGE&vcrReferrer=https%3A%2F%2Fwww.infoq.com%2Fnews%2F2026%2F04%2Fcache-parallelism-cloudflare%2F)

    *   ##### [Harder, Better, Prompter, Stronger: AI system prompt hardening](http://www.infoq.com/vendorcontent/show.action?vcr=f86d2e64-3d54-4df7-9b21-79f066639589&primaryTopicId=2961&vcrPlace=BOTTOM&pageType=NEWS_PAGE&vcrReferrer=https%3A%2F%2Fwww.infoq.com%2Fnews%2F2026%2F04%2Fcache-parallelism-cloudflare%2F)

    *   ##### [Design for Failure: How to Guarantee Data Access During Cloud Outages](http://www.infoq.com/vendorcontent/show.action?vcr=b2c4539a-b77f-4893-8169-aadb23be83b2&primaryTopicId=2961&vcrPlace=BOTTOM&pageType=NEWS_PAGE&vcrReferrer=https%3A%2F%2Fwww.infoq.com%2Fnews%2F2026%2F04%2Fcache-parallelism-cloudflare%2F)

*   #### Related Sponsor

[![Image 12: Related sponsor icon](https://imgopt.infoq.com//fit-in/218x500/filters:quality(100)/filters:no_upscale()/sponsorship/topic/ae9df779-fe62-46d8-a42e-92795ae3c56e/promptfoo-horizontal-logo-1775562471842.png)](http://www.infoq.com/url/f/d99bf7a8-0d65-45c1-901f-1c40ce627952/)Confidently test, evaluate, and red-team your LLM apps with **Promptfoo** — catch regressions, benchmark models, and ship high-quality AI features faster; start testing your prompts today. **[Learn More](http://www.infoq.com/url/f/7efac22a-bbf7-40dc-ad9b-ac098e66c623/).**  

### Related Content

*   ##### [Cloudflare Sandboxes Reach General Availability, Giving AI Agents Persistent Isolated Environments](http://www.infoq.com/news/2026/04/cloudflare-sandboxes-ga/)

Apr 22, 2026    
*   ##### [Cloudflare Outlines MCP Architecture as Enterprises Confront Security and Governance Risks](http://www.infoq.com/news/2026/04/cloudflare-mcp/)

Apr 22, 2026    
*   ##### [Cloudflare Launches Dynamic Workers Open Beta: Isolate-Based Sandboxing for AI Agent Code Execution](http://www.infoq.com/news/2026/04/cloudflare-dynamic-workers-beta/)

Apr 01, 2026    
*   ##### [Cloudflare Introduces EmDash: TypeScript CMS Positioned as WordPress Successor](http://www.infoq.com/news/2026/04/cloudflare-emdash-wordpress/)

Apr 09, 2026    
*   Icon##### [How to Build an Exchange: Sub Millisecond Response Times and 24/7 Uptimes in the Cloud](http://www.infoq.com/presentations/exchange-systems-cloud/)

Apr 23, 2026   [![Image 13: Icon image](https://imgopt.infoq.com/fit-in/50x50/filters:quality(80)/presentations/exchange-systems-cloud/en/smallimage/frank-yu-thumbnail-1776173818222.jpeg)](http://www.infoq.com/presentations/exchange-systems-cloud/) 
*   ##### [When a Cloud Region Fails: Rethinking High Availability in a Geopolitically Unstable World](http://www.infoq.com/articles/sovereign-fault-domains-cloud-resilience/)

Apr 22, 2026   [![Image 14: Icon image](https://imgopt.infoq.com/fit-in/50x50/filters:quality(80)/articles/sovereign-fault-domains-cloud-resilience/en/smallimage/sovereign-fault-domains-cloud-resilience-thumbnail-1776430533702.jpg)](http://www.infoq.com/articles/sovereign-fault-domains-cloud-resilience/) 
*   ##### [Microsoft Launches Azure Copilot Migration Agent to Accelerate Cloud Migration Planning](http://www.infoq.com/news/2026/03/azure-copilot-migration-agent/)

Mar 29, 2026    
*   ##### ["Pick and Mix" Custom Regions: Cloudflare Introduces Fine-Grained Data Residency Control](http://www.infoq.com/news/2026/03/cloudflare-custom-regions/)

Mar 28, 2026    
*   ##### [Event-Driven Patterns for Cloud-Native Banking: Lessons from What Works and What Hurts](http://www.infoq.com/articles/event-driven-banking-architecture/)

Mar 31, 2026   [![Image 15: Icon image](https://imgopt.infoq.com/fit-in/50x50/filters:quality(80)/articles/event-driven-banking-architecture/en/smallimage/event-driven-banking-architecture-thumbnail-1774430827143.jpg)](http://www.infoq.com/articles/event-driven-banking-architecture/) 

### Related Sponsors

*   [![Image 16: Inside MCP: A Protocol for AI Integration](https://imgopt.infoq.com/fit-in/250x320/filters:quality(80)/sponsorship/rsc/d19b4af8-f5b6-447c-bcbe-687c94145134/cover/Promptfoo1-1775560075453.jpg)](http://www.infoq.com/vendorcontent/show.action?vcr=d19b4af8-f5b6-447c-bcbe-687c94145134&pageType=NEWS_PAGE&vcrPlace=TS_SPONSORED_CONTENT_TOP)#### [Inside MCP: A Protocol for AI Integration](http://www.infoq.com/vendorcontent/show.action?vcr=d19b4af8-f5b6-447c-bcbe-687c94145134&pageType=NEWS_PAGE&vcrPlace=TS_SPONSORED_CONTENT_TOP)

The Model Context Protocol (MCP) defines a standard way for AI systems to interact with tools, data, and services. This article explains MCP’s architecture—hosts, clients, and servers—and how it enables structured, secure integrations between AI models and external systems. 
*   Sponsored by

[![Image 17: Icon image](https://imgopt.infoq.com//fit-in/275x500/filters:quality(100)/filters:no_upscale()/sponsorship/topic/ae9df779-fe62-46d8-a42e-92795ae3c56e/promptfoo-horizontal-logo-1775562471842.png)](http://www.infoq.com/url/f/d99bf7a8-0d65-45c1-901f-1c40ce627952/)

### Related Content

*   Icon##### [Thinking Like a Detective: Solving Cloud Infrastructure Mysteries](http://www.infoq.com/presentations/solving-cloud-infrastructure/)

Jan 05, 2026   [![Image 18: Icon image](https://imgopt.infoq.com/fit-in/50x50/filters:quality(80)/presentations/solving-cloud-infrastructure/en/smallimage/brendan-mcloughlin-thumbnail-1766064244505.jpg)](http://www.infoq.com/presentations/solving-cloud-infrastructure/) 
*   ##### [Scaling Cloud and Distributed Applications: Lessons and Strategies](http://www.infoq.com/articles/scaling-cloud-distributed-applications/)

Dec 04, 2025   [![Image 19: Icon image](https://imgopt.infoq.com/fit-in/50x50/filters:quality(80)/articles/scaling-cloud-distributed-applications/en/smallimage/scaling-cloud-distributed-applications-thumbnail-1764662378257.jpg)](http://www.infoq.com/articles/scaling-cloud-distributed-applications/) 
*   Icon##### [Scaling Cloud and Distributed Applications: Lessons and Strategies from chase.com, #1 Banking Portal in the US](http://www.infoq.com/presentations/chase-scale-cloud-distributed/)

Dec 17, 2025   [![Image 20: Icon image](https://imgopt.infoq.com/fit-in/50x50/filters:quality(80)/presentations/chase-scale-cloud-distributed/en/smallimage/durai-arasan-thumbnail-1765444482482.jpg)](http://www.infoq.com/presentations/chase-scale-cloud-distributed/) 
*   ##### [Building Distributed Event-Driven Architectures across Multi-Cloud Boundaries](http://www.infoq.com/articles/multi-cloud-event-driven-architectures/)

Nov 19, 2025   [![Image 21: Icon image](https://imgopt.infoq.com/fit-in/50x50/filters:quality(80)/articles/multi-cloud-event-driven-architectures/en/smallimage/multi-cloud-event-driven-architectures-thumbnail-1762942967043.jpg)](http://www.infoq.com/articles/multi-cloud-event-driven-architectures/) 
*   ##### [Discord Open Sources Osprey Safety Rules Engine Processing 2.3 Million Rules per Second](http://www.infoq.com/news/2026/03/discord-osprey/)

Mar 31, 2026    
*   ##### [Inside Agoda’s Storefront: a Latency-Aware Reverse Proxy for Improving DNS Based Load Distribution](http://www.infoq.com/news/2026/03/agoda-rust-reverse-proxy/)

Mar 27, 2026    

### **The InfoQ** Newsletter

A round-up of last week’s content on InfoQ sent out every Tuesday. Join a community of over 250,000 senior developers. [View an example](https://assets.infoq.com/newsletter/regular/en/newsletter_sample/newsletter_sample.html)

Enter your e-mail address 

Select your country - [x] I consent to InfoQ.com handling my data as explained in this [Privacy Notice](https://www.infoq.com/privacy-notice). 

[We protect your privacy.](http://www.infoq.com/privacy-notice/)

*   [Development](http://www.infoq.com/development/) 

    *   ##### [C++26: Reflection, Memory Safety, Contracts, and a New Async Model](http://www.infoq.com/news/2026/04/cpp-26-reflection-safety-async/ "C++26: Reflection, Memory Safety, Contracts, and a New Async Model")

    *   ##### [From VR to Flat Screens: Bridging the Input and Immersion Gap](http://www.infoq.com/presentations/game-vr-flat-screens/ "From VR to Flat Screens: Bridging the Input and Immersion Gap")

    *   ##### [Cursor 3 Introduces Agent-First Interface, Moving beyond the IDE Model](http://www.infoq.com/news/2026/04/cursor-3-agent-first-interface/ "Cursor 3 Introduces Agent-First Interface, Moving beyond the IDE Model")

*   [Architecture & Design](http://www.infoq.com/architecture-design/) 

    *   ##### [How to Build an Exchange: Sub Millisecond Response Times and 24/7 Uptimes in the Cloud](http://www.infoq.com/presentations/exchange-systems-cloud/ "How to Build an Exchange: Sub Millisecond Response Times and 24/7 Uptimes in the Cloud")

    *   ##### [Dropbox Collaborates with GitHub to Reduce Monorepo Size from 87GB to 20GB](http://www.infoq.com/news/2026/04/dropbox-reduces-git-optimization/ "Dropbox Collaborates with GitHub to Reduce Monorepo Size from 87GB to 20GB")

    *   ##### [Cloudflare Outlines MCP Architecture as Enterprises Confront Security and Governance Risks](http://www.infoq.com/news/2026/04/cloudflare-mcp/ "Cloudflare Outlines MCP Architecture as Enterprises Confront Security and Governance Risks")

*   [Culture & Methods](http://www.infoq.com/culture-methods/) 

    *   ##### [How Observability and Telemetry Can Enhance the Practice of Software Engineering](http://www.infoq.com/news/2026/04/observability-telemetry/ "How Observability and Telemetry Can Enhance the Practice of Software Engineering")

    *   ##### [Panel: Building a Culture that Works](http://www.infoq.com/presentations/panel-positive-culture/ "Panel: Building a Culture that Works")

    *   ##### [Platform as a Product: Delivering Value While Balancing Competing Priorities](http://www.infoq.com/news/2026/04/platform-product-deliver-value/ "Platform as a Product: Delivering Value While Balancing Competing Priorities")

*   [AI, ML & Data Engineering](http://www.infoq.com/ai-ml-data-eng/) 

    *   ##### [Deepfakes, Disinformation, and AI Content Are Taking Over the Internet](http://www.infoq.com/presentations/deepfakes-ai/ "Deepfakes, Disinformation, and AI Content Are Taking Over the Internet")

    *   ##### [Orchestrating Agentic and Multimodal AI Pipelines with Apache Camel](http://www.infoq.com/articles/orchestrating-agentic-multimodal-ai-pipelines-apache-camel/ "Orchestrating Agentic and Multimodal AI Pipelines with Apache Camel")

    *   ##### [Dynamic Moments: Weaving LLMs into Deep Personalization at DoorDash](http://www.infoq.com/presentations/llm-personalization/ "Dynamic Moments: Weaving LLMs into Deep Personalization at DoorDash")

*   [DevOps](http://www.infoq.com/devops/) 

    *   ##### [Yelp Achieves Zero-Downtime Upgrade of over 1,000 Cassandra Nodes](http://www.infoq.com/news/2026/04/yelp-cassandra-upgrade/ "Yelp Achieves Zero-Downtime Upgrade of over 1,000 Cassandra Nodes")

    *   ##### [HashiCorp Vault 2.0 Marks Shift to IBM Lifecycle with New Identity Federation](http://www.infoq.com/news/2026/04/vault-2-0-ibm-identity/ "HashiCorp Vault 2.0 Marks Shift to IBM Lifecycle with New Identity Federation")

    *   ##### [Grafana Rearchitects Loki with Kafka and Ships a CLI to Bring Observability into Coding Agent](http://www.infoq.com/news/2026/04/grafana-loki-ai-agents/ "Grafana Rearchitects Loki with Kafka and Ships a CLI to Bring Observability into Coding Agent")

## **The InfoQ** Newsletter

A round-up of last week’s content on InfoQ sent out every Tuesday. Join a community of over 250,000 senior developers. [View an example](https://assets.infoq.com/newsletter/regular/en/newsletter_sample/newsletter_sample.html)

*   Get a quick overview of content published on a variety of innovator and early adopter technologies
*   Learn what you don’t know that you don’t know
*   Stay up to date with the latest information from the topics you are interested in

Enter your e-mail address 

Select your country - [x] I consent to InfoQ.com handling my data as explained in this [Privacy Notice](https://www.infoq.com/privacy-notice). 

[We protect your privacy.](http://www.infoq.com/privacy-notice/)

[**May 7 | June 10, 2026 | Online** Architecture decisions are hard to validate while shipping. Join a **5-week online cohort** for **senior engineers, architects, and team leads** to pressure-test real decisions, apply practical frameworks, and work through challenges with a confidential peer group. Facilitated by Luca Mezzalira, Principal Architect at AWS, this cohort helps you: * Pressure-test real decisions. * Apply frameworks to real problems. * Publish on InfoQ.com and earn your certification. **RESERVE YOUR PLACE**](https://certification.qconferences.com/?utm_source=infoq&utm_medium=referral&utm_campaign=largefooterad_onlinecohortaprmayjun26)

[Home](http://www.infoq.com/ "Home")[Create account](http://www.infoq.com/reginit.action "Create account")Log In[QCon Conferences](http://qconferences.com/ "QCon Conferences")[Events](https://events.infoq.com/)[Write for InfoQ](http://www.infoq.com/write-for-infoq/ "Write for InfoQ")[InfoQ Editors](http://www.infoq.com/infoq-editors/ "InfoQ Editors")[About InfoQ](http://www.infoq.com/about-infoq/ "About InfoQ")[About C4Media](https://c4media.com/ "About C4Media")[Media Kit](https://get.infoq.com/infoq-mediakit/ "Media Kit")[InfoQ Developer Marketing Blog](https://devmarketing.c4media.com/?utm_source=infoq "InfoQ Developer Marketing Blog")[Diversity](https://c4media.com/diversity "Diversity")

#### Events

*   ##### [Online InfoQ Architect Certification](https://certification.qconferences.com/?utm_source=infoq&utm_medium=referral&utm_campaign=footer_onlinecohortaprmayjun26)

May 7, 2026 
*   ##### [QCon AI Boston](https://boston.qcon.ai/?utm_source=infoq&utm_medium=referral&utm_campaign=footer_qaiboston26)

June 1-2, 2026 
*   ##### [Online InfoQ Architect Certification](https://certification.qconferences.com/?utm_source=infoq&utm_medium=referral&utm_campaign=footer_onlinecohortaprmayjun26)

June 10, 2026 
*   ##### [QCon San Francisco](https://qconsf.com/?utm_source=infoq&utm_medium=referral&utm_campaign=footer_qsf26)

November 16-20, 2026 

#### Follow us on

[Youtube 232K Followers](https://www.youtube.com/infoq)[Linkedin 26K Followers](http://www.linkedin.com/company/infoq)[RSS 19K Readers](https://feed.infoq.com/)[X 57.1k Followers](http://twitter.com/infoq)[Facebook 21K Likes](https://www.facebook.com/InfoQ-75911537320)[Bluesky New](https://bsky.app/profile/infoq.com)[Instagram New](https://www.instagram.com/infoqdotcom/)

#### Stay in the know

[The InfoQ Podcast![Image 22: The InfoQ Podcast Logo - Stay in the know](https://imgopt.infoq.com/eyJidWNrZXQiOiAiYXNzZXRzLmluZm9xLmNvbSIsImtleSI6ICJ3ZWIvZm9vdGVyL2luZm9xLXBvZGNhc3QuanBnIiwiZWRpdHMiOiB7ImpwZWciOiB7ICJxdWFsaXR5Ijo4MH19fQ==)](http://www.infoq.com/podcasts/)[Engineering Culture Podcast![Image 23: Engineering Culture Podcast Logo - Stay in the knoww](https://imgopt.infoq.com/eyJidWNrZXQiOiAiYXNzZXRzLmluZm9xLmNvbSIsImtleSI6ICJ3ZWIvZm9vdGVyL2luZm9xLXBvZGNhc3QtZW5naW5lZXJpbmctY3VsdHVyZS5qcGciLCJlZGl0cyI6IHsianBlZyI6IHsgInF1YWxpdHkiOjgwfX19)](http://www.infoq.com/podcasts/#engineering_culture)[The Software Architects' Newsletter![Image 24: The Software Architects' Newsletter Logo - Stay in the know](https://imgopt.infoq.com/eyJidWNrZXQiOiAiYXNzZXRzLmluZm9xLmNvbSIsImtleSI6ICJ3ZWIvZm9vdGVyL2luZm9xLWFyY2hpdGVjdC1uZXdzbGV0dGVyLmpwZyIsImVkaXRzIjogeyJqcGVnIjogeyAicXVhbGl0eSI6ODB9fX0=)](http://www.infoq.com/software-architects-newsletter/)

 General Feedback [feedback@infoq.com](mailto:feedback@infoq.com) Advertising [sales@infoq.com](mailto:sales@infoq.com) Editorial [editors@infoq.com](mailto:editors@infoq.com) Marketing [marketing@infoq.com](mailto:marketing@infoq.com)

InfoQ.com and all content copyright © 2006-2026 C4Media Inc.

[Privacy Notice](http://www.infoq.com/privacy-notice), [Terms And Conditions](http://www.infoq.com/terms-and-conditions), [Cookie Policy](http://www.infoq.com/cookie-policy)

Close

[BT](http://www.infoq.com/int/bt/ "bt")
