--- title: "Confluent Moves Schema IDs to Kafka Headers to Simplify Schema Governance" source_name: "InfoQ" original_url: "https://www.infoq.com/news/2026/05/confluent-kafka-header-schema-id/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=global" canonical_url: "https://www.traeai.com/articles/e0d55b46-6b27-4940-96f6-7fd16a9e48b3" content_type: "article" language: "英文" score: 7.2 tags: ["Apache Kafka","Schema Registry","Confluent","Data Governance"] published_at: "2026-05-01T14:06:00+00:00" created_at: "2026-05-01T23:09:16.783804+00:00" --- # Confluent Moves Schema IDs to Kafka Headers to Simplify Schema Governance Canonical URL: https://www.traeai.com/articles/e0d55b46-6b27-4940-96f6-7fd16a9e48b3 Original source: https://www.infoq.com/news/2026/05/confluent-kafka-header-schema-id/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=global ## Summary Confluent将Schema ID从消息体移至Kafka Headers，降低序列化耦合，提升Schema Registry治理效率与兼容性。 ## Key Takeaways - Schema ID迁移至Headers避免payload污染 - 支持零停机升级与多版本schema共存 - 需客户端/服务端协同升级以启用新机制 ## Content Title: Confluent Moves Schema IDs to Kafka Headers to Simplify Schema Governance URL Source: http://www.infoq.com/news/2026/05/confluent-kafka-header-schema-id/ Published Time: 2026-05-01T14:06:00+0000 Markdown Content: # Confluent Moves Schema IDs to Kafka Headers to Simplify Schema Governance - InfoQ # Your choice regarding cookies on this site We use cookies to optimise site functionality and give you the best possible experience. I Accept I Do Not Accept Settings [BT](http://www.infoq.com/int/bt/ "bt") ## InfoQ Software Architects' Newsletter A monthly overview of things you need to know as an architect or aspiring architect. [View an example](https://www.infoq.com/software-architects-newsletter#placeholderPastIssues) Enter your e-mail address Select your country - [x] I consent to InfoQ.com handling my data as explained in this [Privacy Notice](https://www.infoq.com/privacy-notice). [We protect your privacy.](http://www.infoq.com/privacy-notice/) Close Live Webinar and Q&A: Architecting for Autonomous Reliability: Embedding AI into Your Observability Stack (Jun 25, 2026)[Save Your Seat](http://www.infoq.com/url/pb/28f774ec-00c2-4ba1-bd02-125d6f26da7e/) Close Toggle Navigation Facilitating the Spread of Knowledge and Innovation in Professional Software Development English edition * [English edition](http://www.infoq.com/news/2026/05/confluent-kafka-header-schema-id/#) * [Chinese edition](https://www.infoq.cn/) * [Japanese edition](http://www.infoq.com/jp/) * [French edition](http://www.infoq.com/fr/) [Write for InfoQ](http://www.infoq.com/write-for-infoq/ "Write for InfoQ") Search [Register](http://www.infoq.com/reginit.action?)[Sign in](http://www.infoq.com/social/keycloakLogin.action?fl=login) ## Unlock the full InfoQ experience Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. [Log In](http://www.infoq.com/social/keycloakLogin.action?fl=login) or ### Don't have an InfoQ account? [Register](http://www.infoq.com/reginit.action?) * **Stay updated on topics and peers that matter to you**Receive instant alerts on the latest insights and trends. * **Quickly access free resources for continuous learning**Minibooks, videos with transcripts, and training materials. * **Save articles and read at anytime**Bookmark articles to read whenever youre ready. [Logo - Back to homepage](http://www.infoq.com/) [News](http://www.infoq.com/news/)[Articles](http://www.infoq.com/articles/)[Presentations](http://www.infoq.com/presentations/)[Podcasts](http://www.infoq.com/podcasts/)[Guides](http://www.infoq.com/minibooks/) ### Topics [Development](http://www.infoq.com/development/ "Development") * [Java](http://www.infoq.com/java/ "Java") * [Kotlin](http://www.infoq.com/kotlin/ "Kotlin") * [.Net](http://www.infoq.com/dotnet/ ".Net") * [C#](http://www.infoq.com/c_sharp/ "C#") * [Swift](http://www.infoq.com/swift/ "Swift") * [Go](http://www.infoq.com/golang/ "Go") * [Rust](http://www.infoq.com/rust/ "Rust") * [JavaScript](http://www.infoq.com/javascript/ "JavaScript") ### Featured in Development * #### [From VR to Flat Screens: Bridging the Input and Immersion Gap](http://www.infoq.com/presentations/game-vr-flat-screens) Dany Lepage discusses the architectural journey of porting a hit VR title to seven non-VR platforms. He explains how his team solved the challenges of cross-progression, diverse input paradigms, and maintaining release velocity across Steam, iOS, and PlayStation. Beyond the tech, he shares candid lessons on the "product fit" gap when translating immersive social presence to 2D screens. [![Image 3: From VR to Flat Screens: Bridging the Input and Immersion Gap](https://imgopt.infoq.com/fit-in/100x100/filters:quality(80)/presentations/game-vr-flat-screens/en/smallimage/thumbnail-1775637585504.jpg)](http://www.infoq.com/presentations/game-vr-flat-screens) [All in development](http://www.infoq.com/development/)Follow Topic [Architecture & Design](http://www.infoq.com/architecture-design/ "Architecture & Design") * [Architecture](http://www.infoq.com/architecture/ "Architecture") * [Enterprise Architecture](http://www.infoq.com/enterprise-architecture/ "Enterprise Architecture") * [Scalability/Performance](http://www.infoq.com/performance-scalability/ "Scalability/Performance") * [Design](http://www.infoq.com/design/ "Design") * [Case Studies](http://www.infoq.com/Case_Study/ "Case Studies") * [Microservices](http://www.infoq.com/microservices/ "Microservices") * [Service Mesh](http://www.infoq.com/servicemesh/ "Service Mesh") * [Patterns](http://www.infoq.com/DesignPattern/ "Patterns") * [Security](http://www.infoq.com/Security/ "Security") ### Featured in Architecture & Design * #### [Stripe’s Docdb: How Zero-Downtime Data Movement Powers Trillion-Dollar Payment Processing](http://www.infoq.com/presentations/docdb-online-database) Jimmy Morzaria discusses the evolution of Stripe’s database tier to support 5 million QPS with 5.5 nines of reliability. He explains the architecture of DocDB and shares how Stripe leverages a custom zero-downtime data movement platform to perform horizontal sharding, version upgrades, and multi-tenant migrations - all while maintaining the strict consistency required for global commerce. [![Image 4: Stripe’s Docdb: How Zero-Downtime Data Movement Powers Trillion-Dollar Payment Processing](https://imgopt.infoq.com/fit-in/100x100/filters:quality(80)/presentations/docdb-online-database/en/smallimage/jimmy-morzaria-thumbnail-1776864724742.jpeg)](http://www.infoq.com/presentations/docdb-online-database) [All in architecture-design](http://www.infoq.com/architecture-design/)Follow Topic [AI Infrastructure](http://www.infoq.com/ai-ml-data-eng/ "AI Infrastructure") * [Big Data](http://www.infoq.com/bigdata/ "Big Data") * [Machine Learning](http://www.infoq.com/machinelearning/ "Machine Learning") * [NoSQL](http://www.infoq.com/nosql/ "NoSQL") * [Database](http://www.infoq.com/database/ "Database") * [Data Analytics](http://www.infoq.com/data-analytics/ "Data Analytics") * [Streaming](http://www.infoq.com/streaming/ "Streaming") ### Featured in AI, ML & Data Engineering * #### [The Next Generation of AI Products](http://www.infoq.com/presentations/ai-products) Hilary Mason shares her journey from academia to building AI products at scale. She discusses the shift from discrete engineering to probabilistic mindsets, explaining why managing "human considerations" is the hardest part of the stack. She explains the "existential crisis" for engineers, arguing that great architecture today is about context management, systems thinking, and good taste. [![Image 5: The Next Generation of AI Products](https://imgopt.infoq.com/fit-in/100x100/filters:quality(80)/presentations/ai-products/en/smallimage/hilary-mason-thumbnail-1776947360498.jpeg)](http://www.infoq.com/presentations/ai-products) [All in ai-ml-data-eng](http://www.infoq.com/ai-ml-data-eng/)Follow Topic [Culture & Methods](http://www.infoq.com/culture-methods/ "Culture & Methods") * [Agile](http://www.infoq.com/agile/ "Agile") * [Diversity](http://www.infoq.com/diversity/ "Diversity") * [Leadership](http://www.infoq.com/leadership/ "Leadership") * [Lean/Kanban](http://www.infoq.com/lean/ "Lean/Kanban") * [Personal Growth](http://www.infoq.com/personal-growth/ "Personal Growth") * [Scrum](http://www.infoq.com/scrum/ "Scrum") * [Sociocracy](http://www.infoq.com/sociocracy/ "Sociocracy") * [Software Craftmanship](http://www.infoq.com/software_craftsmanship/ "Software Craftmanship") * [Team Collaboration](http://www.infoq.com/team-collaboration/ "Team Collaboration") * [Testing](http://www.infoq.com/testing/ "Testing") * [UX](http://www.infoq.com/ux/ "UX") ### Featured in Culture & Methods * #### [Panel: Building a Culture that Works](http://www.infoq.com/presentations/panel-positive-culture) The panelists share insights on evolving company culture. They discuss leveraging feedback loops, lending social capital, and the friction between legacy bureaucracy and agile engineering. The panel explains how to maintain cohesion in remote teams and use interviews to uncover the true "unmanicured" culture of a firm. [![Image 6: Panel: Building a Culture that Works](https://imgopt.infoq.com/fit-in/100x100/filters:quality(80)/presentations/panel-positive-culture/en/smallimage/ln-500x500-1775048593311.jpg)](http://www.infoq.com/presentations/panel-positive-culture) [All in culture-methods](http://www.infoq.com/culture-methods/)Follow Topic [DevOps](http://www.infoq.com/devops/) * [Infrastructure](http://www.infoq.com/infrastructure/ "Infrastructure") * [Continuous Delivery](http://www.infoq.com/continuous_delivery/ "Continuous Delivery") * [Automation](http://www.infoq.com/automation/ "Automation") * [Containers](http://www.infoq.com/containers/ "Containers") * [Cloud](http://www.infoq.com/cloud-computing/ "Cloud") * [Observability](http://www.infoq.com/observability/ "Observability") ### Featured in DevOps * #### [AI-Powered SRE for Autonomous Incident Response](http://www.infoq.com/presentations/ai-sre-incident-response) The presenters discuss incident response, how AI-enhanced SRE platforms connect signals from logs, metrics, traces, and historical incidents to enable autonomous decisions. [![Image 7: AI-Powered SRE for Autonomous Incident Response](https://imgopt.infoq.com/fit-in/100x100/filters:quality(80)/presentations/ai-sre-incident-response/en/smallimage/infoq-live-thumbnail-1777368469045.jpg)](http://www.infoq.com/presentations/ai-sre-incident-response) [All in devops](http://www.infoq.com/devops/)Follow Topic [Events](https://events.infoq.com/ "Events") ### Helpful links * [About InfoQ](http://www.infoq.com/about-infoq "About InfoQ") * [InfoQ Editors](http://www.infoq.com/infoq-editors "InfoQ Editors") * [Write for InfoQ](http://www.infoq.com/write-for-infoq "Write for InfoQ") * [About C4Media](https://c4media.com/ "About C4Media") * [Diversity](https://c4media.com/diversity "Diversity") ### Choose your language * [En](http://www.infoq.com/news/2026/05/confluent-kafka-header-schema-id/# "InfoQ English") * [中文](https://www.infoq.cn/) * [日本](http://www.infoq.com/jp/) * [Fr](http://www.infoq.com/fr/) [![Image 8: InfoQ Architect Certification - image](https://imgopt.infoq.com/eyJidWNrZXQiOiAiYXNzZXRzLmluZm9xLmNvbSIsImtleSI6ICJ3ZWIvaGVhZGVyL2NvbmZlcmVuY2VzLzIwMjYvT25saW5lQ29ob3J0c01hcmNoMjAyNi10b3AtdjQuanBnIiwiZWRpdHMiOiB7ImpwZWciOiB7ICJxdWFsaXR5Ijo4MH19fQ==) Online InfoQ Architect Certification Join Luca Mezzalira for this 5-week online cohort. Master socio-technical architecture leadership. **Register Now.**](https://certification.qconferences.com/?utm_source=infoq&utm_medium=referral&utm_campaign=homepageheader_onlinecohortaprmayjun26)[![Image 9: QCon AI Boston - image](https://imgopt.infoq.com/eyJidWNrZXQiOiAiYXNzZXRzLmluZm9xLmNvbSIsImtleSI6ICJ3ZWIvaGVhZGVyL2NvbmZlcmVuY2VzLzIwMjYvUUNvbi1BSS1Cb3N0b24tMjAyNi10b3AuanBnIiwiZWRpdHMiOiB7ImpwZWciOiB7ICJxdWFsaXR5Ijo4MH19fQ==) QCon AI Boston Learn how leading engineering teams run AI in production—reliably, securely, and at scale. **Early Bird ends April 14.**](https://boston.qcon.ai/?utm_source=infoq&utm_medium=referral&utm_campaign=homepageheader_qaiboston26)[![Image 10: QCon San Francisco - image](https://imgopt.infoq.com/eyJidWNrZXQiOiAiYXNzZXRzLmluZm9xLmNvbSIsImtleSI6ICJ3ZWIvaGVhZGVyL2NvbmZlcmVuY2VzLzIwMjYvUUNvbi1TRi0yMDI2LXRvcC5qcGciLCJlZGl0cyI6IHsianBlZyI6IHsgInF1YWxpdHkiOjgwfX19) QCon San Francisco Learn what's next in AI and software, from teams already doing it. **Early Bird ends April 14.**](https://qconsf.com/?utm_source=infoq&utm_medium=referral&utm_campaign=homepageheader_qsf26) [InfoQ Homepage](http://www.infoq.com/ "InfoQ Homepage")[News](http://www.infoq.com/news "News")Confluent Moves Schema IDs to Kafka Headers to Simplify Schema Governance [Architecture & Design](http://www.infoq.com/architecture-design/ "Architecture & Design") [Portable by Design: Data Mobility & Recovery Patterns for Multi-Cloud Systems (Webinar May 21st)](https://www.infoq.com/url/t/b6e26c58-60b6-4d7e-8e9f-7dd796a77fd7/?label=Eon-EventPromoBox) # Confluent Moves Schema IDs to Kafka Headers to Simplify Schema Governance May 01, 2026 2 min read by * [![Image 11: Author photo](https://cdn.infoq.com/statics_s1_20260421232814/images/profiles/oZlePVmvHTLAVzoapw4QLpkecE5BfJW9.jpeg)](http://www.infoq.com/profile/Leela-Kumili/)[Leela Kumili](http://www.infoq.com/profile/Leela-Kumili/) Follow Lead Engineer #### Write for InfoQ **Feed your curiosity.**Help 550k+ global senior developers each month stay ahead.[Get in touch](https://www.infoq.com/write-for-infoq/) Log in to listen to this article Audio ready to play Your browser does not support the audio element. 0:00 0:00 Normal 1.25x 1.5x Like * [Reading list](http://www.infoq.com/showbookmarks.action) Confluent has introduced [a new approach to managing schema metadata in Apache Kafka](https://www.confluent.io/blog/schema-id-kafka-headers-data-governance/) by enabling schema IDs to be stored in message headers rather than in the payload. The update is designed to simplify data governance and enable teams to adopt schema validation without changing existing event formats. The feature builds on Kafka’s native header support and integrates with Confluent Schema Registry, which is widely used by organizations managing event-driven architectures across microservices, analytics pipelines, and data platforms. In traditional Kafka deployments using Confluent’s wire format, schema IDs are embedded directly in the message payload. This ensures consumers can correctly deserialize events, but it tightly couples schema metadata with the data itself. Over time, this coupling complicates schema evolution, especially in environments where multiple teams and systems consume the same event streams. It also increases coordination overhead when schema changes are introduced across producers and consumers. With the new approach, schema identifiers are stored in Kafka record headers while the payload remains unchanged. Consumers retrieve the schema from the schema registry at runtime using the ID in the header. This maintains compatibility with formats such as [Avro](https://github.com/apache/avro), [Protobuf](https://en.wikipedia.org/wiki/Protocol_Buffers), and JSON Schema while reducing dependence on tightly coupled wire formats. Schema resolution is decoupled from the payload, making event streams more flexible and easier to integrate across downstream systems and tooling. ![Image 12](https://imgopt.infoq.com/fit-in/3000x4000/filters:quality(85)/filters:no_upscale()/news/2026/05/confluent-kafka-header-schema-id/en/resources/1conflunentheader-1776737160055.jpeg) _Schema handling before and after moving schema IDs to Kafka headers (Source: [Confluent Blog Post)](https://www.confluent.io/blog/schema-id-kafka-headers-data-governance/)_ [Patrick Neff](https://www.linkedin.com/in/patrick-neff-7bb3b21a4/), CSTA Team Lead CEMEA at Confluent, highlights the importance of schema governance in enabling reuse across streaming and analytics systems in a LinkedIn [post](https://www.linkedin.com/posts/patrick-neff-7bb3b21a4_this-is-huge-with-schema-ids-in-headers-share-7438539292341104641-wwC8?utm_source=share&utm_medium=member_desktop&rcm=ACoAAArnikgBqzTxA9Y838-O55QUcB2McACIq94). > Schemas are the key enabler for unlocking the full value of your data. The header-based approach also supports incremental adoption. Organizations can introduce schema governance without large-scale rewrites or coordinated changes across all producers and consumers. Schema IDs can be attached to existing event streams, allowing teams to gradually adopt stricter schema management practices while maintaining backward compatibility. [Gunnar Morling](https://www.linkedin.com/in/gunnar-morling/), Technologist at Confluent, emphasized improved interoperability with storage systems and downstream processing frameworks in [post](https://www.linkedin.com/posts/gunnar-morling_putting-schema-ids-into-kafka-message-headers-share-7438135378118696961-XgAz?utm_source=share&utm_medium=member_desktop&rcm=ACoAAArnikgBqzTxA9Y838-O55QUcB2McACIq94). > Schema ids into Kafka message headers rather than the message payload is a massive quality of life improvement: payloads become valid, self-contained. Separating schema metadata from payloads enables independent evolution of producers and consumers, with validation centralized in the schema registry. This reduces coordination overhead and simplifies schema evolution at scale. It also improves interoperability with tools like Apache Flink and analytics or ML systems by enabling consistent reuse of structured event data across pipelines. [David Araujo](https://www.linkedin.com/in/davidaraujo/), Director of Product Management at Coflunent, describes how the feature enables zero downtime and client-independent adoption patterns. > By moving schema IDs to headers, you can attach schemas to existing data in Kafka without touching payload formats. The transition may require updates to Kafka connectors and downstream tools that assume schema metadata is embedded in payloads, creating a period where both approaches may coexist, depending on ecosystem readiness. The feature is available in Confluent Cloud and is expected in Confluent Platform with Schema Registry support under existing licensing models. ## About the Author [![Image 13](https://cdn.infoq.com/statics_s1_20260421232814/images/profiles/oZlePVmvHTLAVzoapw4QLpkecE5BfJW9.jpeg)](http://www.infoq.com/profile/Leela-Kumili/) #### **Leela Kumili** Leela is a Lead Software Engineer at Starbucks with deep expertise in building scalable, cloud-native systems and distributed platforms. She drives architecture, delivery, and operational excellence across the Rewards Platform, leading efforts to modernize systems, improve scalability, and enhance reliability. In addition to her technical leadership, Leela serves as an AI Champion for the organization, identifying opportunities to improve developer productivity and workflows using LLM-based tools and establishing best practices for AI adoption. She is passionate about building production-ready systems, enhancing developer experience, and mentoring engineers to grow in both technical and strategic impact. Her interests include platform engineering, distributed systems, developer productivity, and bridging technical solutions with business and product goals. Show more Show less #### This content is in the [Machine Learning](http://www.infoq.com/MachineLearning/) topic Follow Topic ##### Related Topics: * [Development](http://www.infoq.com/development/)### [Development](http://www.infoq.com/development) Followers: 4093 Follow Topic * [Architecture & Design](http://www.infoq.com/architecture-design/)### [Architecture & Design](http://www.infoq.com/architecture-design) Followers: 10214 Follow Topic * [Protocol Buffers](http://www.infoq.com/ProtocolBuffers/)### [Protocol Buffers](http://www.infoq.com/ProtocolBuffers) Followers: 24 Follow Topic * [Schema](http://www.infoq.com/schema/)### [Schema](http://www.infoq.com/schema) Followers: 3 Follow Topic * [Machine Learning](http://www.infoq.com/MachineLearning/)### [Machine Learning](http://www.infoq.com/MachineLearning) Followers: 14444 Follow Topic * [Data Analytics](http://www.infoq.com/Data-Analytics/)### [Data Analytics](http://www.infoq.com/Data-Analytics) Followers: 255 Follow Topic * [Apache Flink](http://www.infoq.com/Apache-Flink/)### [Apache Flink](http://www.infoq.com/Apache-Flink) Followers: 36 Follow Topic * [Data Pipelines](http://www.infoq.com/Data-Pipelines/)### [Data Pipelines](http://www.infoq.com/Data-Pipelines) Followers: 63 Follow Topic * [JSON](http://www.infoq.com/json/)### [JSON](http://www.infoq.com/json) Followers: 5 Follow Topic * [Apache Kafka](http://www.infoq.com/apache_kafka/)### [Apache Kafka](http://www.infoq.com/apache_kafka) Followers: 305 Follow Topic * [Event Stream Processing](http://www.infoq.com/esp/)### [Event Stream Processing](http://www.infoq.com/esp) Followers: 94 Follow Topic * [Avro](http://www.infoq.com/avro/)### [Avro](http://www.infoq.com/avro) Followers: 1 Follow Topic * [Streaming](http://www.infoq.com/Streaming/)### [Streaming](http://www.infoq.com/Streaming) Followers: 1127 Follow Topic * #### Related Editorial * ##### [AWS Lambda Gains Native Avro and Protobuf Support for Kafka Events with Schema Registry Integration](http://www.infoq.com/news/2025/06/aws-lambda-avro-protobuf-kafka/) * ##### [Zod v4 Available with Major Performance Improvements and Introduction of Zod Mini](http://www.infoq.com/news/2025/08/zod-v4-available/) * ##### [Helidon 4.4.0 Introduces Alignment with OpenJDK Cadence and Support via Java Verified Portfolio](http://www.infoq.com/news/2026/04/helidon-4-4-released/) * ##### [Vercel Releases JSON-Render: a Generative UI Framework for AI-Driven Interface Composition](http://www.infoq.com/news/2026/03/vercel-json-render/) * ##### [Agoda’s API Agent Converts Any API to MCP with Zero Code and Deployments](http://www.infoq.com/news/2026/02/agoda-api-agent/) * #### Related Sponsors * ##### [AI Agent Swarm Patterns (InfoQ Webinar) - Watch Now On-Demand](http://www.infoq.com/vendorcontent/show.action?vcr=b04e8a98-3462-46e7-bb9d-c621b641e63c&primaryTopicId=2498&vcrPlace=BOTTOM&pageType=NEWS_PAGE&vcrReferrer=https%3A%2F%2Fwww.infoq.com%2Fnews%2F2026%2F05%2Fconfluent-kafka-header-schema-id%2F) * ##### [Design for Failure: How to Guarantee Data Access During Cloud Outages](http://www.infoq.com/vendorcontent/show.action?vcr=b2c4539a-b77f-4893-8169-aadb23be83b2&primaryTopicId=2498&vcrPlace=BOTTOM&pageType=NEWS_PAGE&vcrReferrer=https%3A%2F%2Fwww.infoq.com%2Fnews%2F2026%2F05%2Fconfluent-kafka-header-schema-id%2F) * ##### [8 Deployment Pattern Structures to Transform your CI/CD](http://www.infoq.com/vendorcontent/show.action?vcr=52318350-f698-4619-9bd5-4d0e77e65a52&primaryTopicId=2498&vcrPlace=BOTTOM&pageType=NEWS_PAGE&vcrReferrer=https%3A%2F%2Fwww.infoq.com%2Fnews%2F2026%2F05%2Fconfluent-kafka-header-schema-id%2F) * ##### [The Essential Guide to AI Tools for Jakarta EE Developers](http://www.infoq.com/vendorcontent/show.action?vcr=9da508bb-ebe9-438c-a72f-a16498c12425&primaryTopicId=2498&vcrPlace=BOTTOM&pageType=NEWS_PAGE&vcrReferrer=https%3A%2F%2Fwww.infoq.com%2Fnews%2F2026%2F05%2Fconfluent-kafka-header-schema-id%2F) * ##### [Why APIs Can’t Trust Clients—and How to Bridge the Gap](http://www.infoq.com/url/f/a7035507-bffb-4548-8fb1-edf4886c1f91/) * #### Related Sponsor [![Image 14: Related sponsor icon](https://imgopt.infoq.com//fit-in/218x500/filters:quality(100)/filters:no_upscale()/sponsorship/topic/25bab595-37d6-4ab7-9248-20338e1e96da/GuardsquareLogoRSB-1775221099682.png)](http://www.infoq.com/url/f/77854e53-bd10-4c28-87a5-45badc5dd1b5/)**Test. Protect. Repeat. Guardsquare pairs mobile app testing and protection, delivering max security with zero performance trade-offs. [Request a Quote](http://www.infoq.com/url/f/e322e49b-fc5d-4712-9e5b-ecb7ce06f225/).** ### Related Content * ##### [Helidon 4.4.0 Introduces Alignment with OpenJDK Cadence and Support via Java Verified Portfolio](http://www.infoq.com/news/2026/04/helidon-4-4-released/) Apr 02, 2026 * Icon##### [From Confusion to Clarity: Advanced Observability Strategies for Media Workflows at Netflix](http://www.infoq.com/presentations/stream-pipeline-observability/) Jan 02, 2026 [![Image 15: Icon image](https://imgopt.infoq.com/fit-in/50x50/filters:quality(80)/presentations/stream-pipeline-observability/en/smallimage/thumbnail-sujana-sooreddy-naveen-mareddy-1766067087244.jpg)](http://www.infoq.com/presentations/stream-pipeline-observability/) * ##### [Building Streaming Infrastructure That Scales: Because Viewers Won't Wait until Tomorrow](http://www.infoq.com/articles/evolution-backend-streaming-application/) Dec 23, 2025 [![Image 16: Icon image](https://imgopt.infoq.com/fit-in/50x50/filters:quality(80)/articles/evolution-backend-streaming-application/en/smallimage/thumbnail-evolution-backend-streaming-application-1766049421558.jpg)](http://www.infoq.com/articles/evolution-backend-streaming-application/) * ##### [Uber’s Hive Federation Decentralizes 16K Datasets and 10+ PB for Zero-Downtime Analytics at Scale](http://www.infoq.com/news/2026/04/uber-hive-decentralized-data/) Apr 09, 2026 * ##### [Legare Kerrison and Cedric Clyburn on LLM Performance and Evaluations](http://www.infoq.com/news/2026/04/kerrison-clyburn-llm-performance/) Apr 28, 2026 * ##### [Spring News Roundup: First Release Candidates of Boot, Security, Integration, Modulith, AMQP](http://www.infoq.com/news/2026/04/spring-news-roundup-apr20-2026/) Apr 27, 2026 * ##### [Orchestrating Agentic and Multimodal AI Pipelines with Apache Camel](http://www.infoq.com/articles/orchestrating-agentic-multimodal-ai-pipelines-apache-camel/) Apr 24, 2026 [![Image 17: Icon image](https://imgopt.infoq.com/fit-in/50x50/filters:quality(80)/articles/orchestrating-agentic-multimodal-ai-pipelines-apache-camel/en/smallimage/orchestrating-agentic-multimodal-ai-pipelines-apache-camel-thumbnail-1776763980414.jpg)](http://www.infoq.com/articles/orchestrating-agentic-multimodal-ai-pipelines-apache-camel/) * ##### [Grafana Rearchitects Loki with Kafka and Ships a CLI to Bring Observability into Coding Agent](http://www.infoq.com/news/2026/04/grafana-loki-ai-agents/) Apr 23, 2026 * ##### [Lyft Scales Global Localization Using AI and Human-in-the-Loop Review](http://www.infoq.com/news/2026/04/lyft-ai-localization-pipeline/) Apr 13, 2026 ### Related Sponsors * [![Image 18: The Case for Real-Time Threat Monitoring and Analysis in Modern Mobile App Security](https://imgopt.infoq.com/fit-in/250x320/filters:quality(80)/sponsorship/rsc/521c6b76-1144-41d1-95c5-3897292ddeb3/cover/Ad_InfoQ_Q2_The-Case-for-Real-Time-Threat_750x960-1775219624717.jpg)](http://www.infoq.com/vendorcontent/show.action?vcr=521c6b76-1144-41d1-95c5-3897292ddeb3&pageType=NEWS_PAGE&vcrPlace=TS_SPONSORED_CONTENT_TOP)#### [The Case for Real-Time Threat Monitoring and Analysis in Modern Mobile App Security](http://www.infoq.com/vendorcontent/show.action?vcr=521c6b76-1144-41d1-95c5-3897292ddeb3&pageType=NEWS_PAGE&vcrPlace=TS_SPONSORED_CONTENT_TOP) Drive better mobile security with real‑time insights. This Guardsquare report shows why traditional client‑side defenses fall short against persistent threats and how continuous threat monitoring and analysis gives teams actionable visibility to protect apps, users, and revenue. * [![Image 19: Rethinking AppSec: Why Compiler‑Level Security Changes the Architecture Conversation (Live Webinar Jun 11th) - Save Your Seat](https://imgopt.infoq.com/fit-in/250x320/filters:quality(80)/sponsorship/rsc/5ac9a5a0-70a2-4c24-a241-fa93516b9e7a/cover/GuardsquareWebinarJune11-RSC-1777540520281.jpg)](http://www.infoq.com/vendorcontent/show.action?vcr=5ac9a5a0-70a2-4c24-a241-fa93516b9e7a&pageType=NEWS_PAGE&vcrPlace=TS_SPONSORED_CONTENT_TOP)#### [Rethinking AppSec: Why Compiler‑Level Security Changes the Architecture Conversation (Live Webinar Jun 11th) - Save Your Seat](http://www.infoq.com/vendorcontent/show.action?vcr=5ac9a5a0-70a2-4c24-a241-fa93516b9e7a&pageType=NEWS_PAGE&vcrPlace=TS_SPONSORED_CONTENT_TOP) Security bolted on after the build process adds fragility and blind spots. Embedding protection at compile time improves performance and resilience. This session compares wrapper, runtime, and compiler approaches to help you choose where security belongs in your SDLC. * Sponsored by [![Image 20: Icon image](https://imgopt.infoq.com//fit-in/275x500/filters:quality(100)/filters:no_upscale()/sponsorship/topic/25bab595-37d6-4ab7-9248-20338e1e96da/GuardsquareLogoRSB-1775221099682.png)](http://www.infoq.com/url/f/77854e53-bd10-4c28-87a5-45badc5dd1b5/) ### Related Content * Icon##### [Reimagining Platform Engagement with Graph Neural Networks](http://www.infoq.com/presentations/graph-neural-networks/) Apr 13, 2026 [![Image 21: Icon image](https://imgopt.infoq.com/fit-in/50x50/filters:quality(80)/presentations/graph-neural-networks/en/smallimage/Mariia-Bulycheva-thumbnail-1775048997053.jpeg)](http://www.infoq.com/presentations/graph-neural-networks/) * ##### [Cloudflare and ETH Zurich Outline Approaches for AI-Driven Cache Optimization](http://www.infoq.com/news/2026/04/cloudflare-ai-caching-strategies/) Apr 08, 2026 * ##### [Inside Spotify’s 2025 Wrapped Archive: AI Narratives at Scale and the Privacy Trade‑Off](http://www.infoq.com/news/2026/04/spotify-wrapped-privacy/) Apr 08, 2026 * Icon##### [Building Embedding Models for Large-Scale Real-World Applications](http://www.infoq.com/presentations/llm-large-scale-applications/) Feb 13, 2026 [![Image 22: Icon image](https://imgopt.infoq.com/fit-in/50x50/filters:quality(80)/presentations/llm-large-scale-applications/en/smallimage/sahil-dua-thumbnail-1769590214923.jpeg)](http://www.infoq.com/presentations/llm-large-scale-applications/) * ##### [Why Most Machine Learning Projects Fail to Reach Production](http://www.infoq.com/articles/why-ml-projects-fail-production/) Feb 02, 2026 [![Image 23: Icon image](https://imgopt.infoq.com/fit-in/50x50/filters:quality(80)/articles/why-ml-projects-fail-production/en/smallimage/why-ml-projects-fail-production-thumbnail-1769072877092.jpg)](http://www.infoq.com/articles/why-ml-projects-fail-production/) * Icon##### [How to Unlock Insights and Enable Discovery within Petabytes of Autonomous Driving Data](http://www.infoq.com/presentations/autonomous-driving-data/) Jan 21, 2026 [![Image 24: Icon image](https://imgopt.infoq.com/fit-in/50x50/filters:quality(80)/presentations/autonomous-driving-data/en/smallimage/kyra-mozley-thumbnail-1768380754768.jpeg)](http://www.infoq.com/presentations/autonomous-driving-data/) ### **The InfoQ** Newsletter A round-up of last week’s content on InfoQ sent out every Tuesday. Join a community of over 250,000 senior developers. [View an example](https://assets.infoq.com/newsletter/regular/en/newsletter_sample/newsletter_sample.html) Enter your e-mail address Select your country - [x] I consent to InfoQ.com handling my data as explained in this [Privacy Notice](https://www.infoq.com/privacy-notice). [We protect your privacy.](http://www.infoq.com/privacy-notice/) * [Development](http://www.infoq.com/development/) * ##### [QCon San Francisco 2026: 12 Tracks Announced](http://www.infoq.com/news/2026/04/qconsf-2026-tracks-announced/ "QCon San Francisco 2026: 12 Tracks Announced") * ##### [Microsoft's Russinovich and Hanselman Warn AI Is Hollowing out the Junior Developer Pipeline](http://www.infoq.com/news/2026/04/junior-developer-pipeline-crisis/ "Microsoft's Russinovich and Hanselman Warn AI Is Hollowing out the Junior Developer Pipeline") * ##### [C++26: Reflection, Memory Safety, Contracts, and a New Async Model](http://www.infoq.com/news/2026/04/cpp-26-reflection-safety-async/ "C++26: Reflection, Memory Safety, Contracts, and a New Async Model") * [Architecture & Design](http://www.infoq.com/architecture-design/) * ##### [Confluent Moves Schema IDs to Kafka Headers to Simplify Schema Governance](http://www.infoq.com/news/2026/05/confluent-kafka-header-schema-id/ "Confluent Moves Schema IDs to Kafka Headers to Simplify Schema Governance") * ##### [Meta's Approach to Migrating their Systems to Post-Quantum Cryptography](http://www.infoq.com/news/2026/04/meta-quantum-crypto-migration/ "Meta's Approach to Migrating their Systems to Post-Quantum Cryptography") * ##### [Stripe’s Docdb: How Zero-Downtime Data Movement Powers Trillion-Dollar Payment Processing](http://www.infoq.com/presentations/docdb-online-database/ "Stripe’s Docdb: How Zero-Downtime Data Movement Powers Trillion-Dollar Payment Processing") * [Culture & Methods](http://www.infoq.com/culture-methods/) * ##### [Driving and Measuring the Impact of Platform Engineering](http://www.infoq.com/news/2026/04/measure-platform-engineering/ "Driving and Measuring the Impact of Platform Engineering") * ##### [How Observability and Telemetry Can Enhance the Practice of Software Engineering](http://www.infoq.com/news/2026/04/observability-telemetry/ "How Observability and Telemetry Can Enhance the Practice of Software Engineering") * ##### [Panel: Building a Culture that Works](http://www.infoq.com/presentations/panel-positive-culture/ "Panel: Building a Culture that Works") * [AI, ML & Data Engineering](http://www.infoq.com/ai-ml-data-eng/) * ##### [The Next Generation of AI Products](http://www.infoq.com/presentations/ai-products/ "The Next Generation of AI Products") * ##### [NVIDIA Launches Ising Open Models for Quantum Computing](http://www.infoq.com/news/2026/04/nvidia-ising-quantum/ "NVIDIA Launches Ising Open Models for Quantum Computing") * ##### [Vercel Releases Open Agents to Support Background AI Coding Workflows](http://www.infoq.com/news/2026/04/vercel-open-agents/ "Vercel Releases Open Agents to Support Background AI Coding Workflows") * [DevOps](http://www.infoq.com/devops/) * ##### [Meta Deploys Unified AI Agents to Automate Performance Optimization at Hyperscale](http://www.infoq.com/news/2026/05/meta-ai-agents-hyperscale/ "Meta Deploys Unified AI Agents to Automate Performance Optimization at Hyperscale") * ##### [Broadcom Donates Velero to CNCF, Shifting Kubernetes Backup to Community Governance](http://www.infoq.com/news/2026/05/broadcom-velero-cncf/ "Broadcom Donates Velero to CNCF, Shifting Kubernetes Backup to Community Governance") * ##### [Dropbox Redesigns Compaction to Reclaim Space from Underfilled Storage Volumes](http://www.infoq.com/news/2026/04/dropbox-tiered-compaction/ "Dropbox Redesigns Compaction to Reclaim Space from Underfilled Storage Volumes") ## **The InfoQ** Newsletter A round-up of last week’s content on InfoQ sent out every Tuesday. Join a community of over 250,000 senior developers. [View an example](https://assets.infoq.com/newsletter/regular/en/newsletter_sample/newsletter_sample.html) * Get a quick overview of content published on a variety of innovator and early adopter technologies * Learn what you don’t know that you don’t know * Stay up to date with the latest information from the topics you are interested in Enter your e-mail address Select your country - [x] I consent to InfoQ.com handling my data as explained in this [Privacy Notice](https://www.infoq.com/privacy-notice). [We protect your privacy.](http://www.infoq.com/privacy-notice/) [**May 7 | June 10, 2026 | Online** Architecture decisions are hard to validate while shipping. Join a **5-week online cohort** for **senior engineers, architects, and team leads** to pressure-test real decisions, apply practical frameworks, and work through challenges with a confidential peer group. Facilitated by Luca Mezzalira, Principal Architect at AWS, this cohort helps you: * Pressure-test real decisions. * Apply frameworks to real problems. * Publish on InfoQ.com and earn your certification. **RESERVE YOUR PLACE**](https://certification.qconferences.com/?utm_source=infoq&utm_medium=referral&utm_campaign=largefooterad_onlinecohortaprmayjun26) [Home](http://www.infoq.com/ "Home")[Create account](http://www.infoq.com/reginit.action "Create account")Log In[QCon Conferences](http://qconferences.com/ "QCon Conferences")[Events](https://events.infoq.com/)[Write for InfoQ](http://www.infoq.com/write-for-infoq/ "Write for InfoQ")[InfoQ Editors](http://www.infoq.com/infoq-editors/ "InfoQ Editors")[About InfoQ](http://www.infoq.com/about-infoq/ "About InfoQ")[About C4Media](https://c4media.com/ "About C4Media")[Media Kit](https://get.infoq.com/infoq-mediakit/ "Media Kit")[InfoQ Developer Marketing Blog](https://devmarketing.c4media.com/?utm_source=infoq "InfoQ Developer Marketing Blog")[Diversity](https://c4media.com/diversity "Diversity") #### Events * ##### [Online InfoQ Architect Certification](https://certification.qconferences.com/?utm_source=infoq&utm_medium=referral&utm_campaign=footer_onlinecohortaprmayjun26) May 7, 2026 * ##### [QCon AI Boston](https://boston.qcon.ai/?utm_source=infoq&utm_medium=referral&utm_campaign=footer_qaiboston26) June 1-2, 2026 * ##### [Online InfoQ Architect Certification](https://certification.qconferences.com/?utm_source=infoq&utm_medium=referral&utm_campaign=footer_onlinecohortaprmayjun26) June 10, 2026 * ##### [QCon San Francisco](https://qconsf.com/?utm_source=infoq&utm_medium=referral&utm_campaign=footer_qsf26) November 16-20, 2026 #### Follow us on [Youtube 232K Followers](https://www.youtube.com/infoq)[Linkedin 26K Followers](http://www.linkedin.com/company/infoq)[Instagram New](https://www.instagram.com/infoqdotcom/)[RSS 19K Readers](https://feed.infoq.com/)[X 57.1k Followers](http://twitter.com/infoq)[Facebook 21K Likes](https://www.facebook.com/InfoQ-75911537320)[Bluesky New](https://bsky.app/profile/infoq.com) #### Stay in the know [The InfoQ Podcast![Image 25: The InfoQ Podcast Logo - Stay in the know](https://imgopt.infoq.com/eyJidWNrZXQiOiAiYXNzZXRzLmluZm9xLmNvbSIsImtleSI6ICJ3ZWIvZm9vdGVyL2luZm9xLXBvZGNhc3QuanBnIiwiZWRpdHMiOiB7ImpwZWciOiB7ICJxdWFsaXR5Ijo4MH19fQ==)](http://www.infoq.com/podcasts/)[Engineering Culture Podcast![Image 26: Engineering Culture Podcast Logo - Stay in the knoww](https://imgopt.infoq.com/eyJidWNrZXQiOiAiYXNzZXRzLmluZm9xLmNvbSIsImtleSI6ICJ3ZWIvZm9vdGVyL2luZm9xLXBvZGNhc3QtZW5naW5lZXJpbmctY3VsdHVyZS5qcGciLCJlZGl0cyI6IHsianBlZyI6IHsgInF1YWxpdHkiOjgwfX19)](http://www.infoq.com/podcasts/#engineering_culture)[The Software Architects' Newsletter![Image 27: The Software Architects' Newsletter Logo - Stay in the know](https://imgopt.infoq.com/eyJidWNrZXQiOiAiYXNzZXRzLmluZm9xLmNvbSIsImtleSI6ICJ3ZWIvZm9vdGVyL2luZm9xLWFyY2hpdGVjdC1uZXdzbGV0dGVyLmpwZyIsImVkaXRzIjogeyJqcGVnIjogeyAicXVhbGl0eSI6ODB9fX0=)](http://www.infoq.com/software-architects-newsletter/) General Feedback [feedback@infoq.com](mailto:feedback@infoq.com) Advertising [sales@infoq.com](mailto:sales@infoq.com) Editorial [editors@infoq.com](mailto:editors@infoq.com) Marketing [marketing@infoq.com](mailto:marketing@infoq.com) InfoQ.com and all content copyright © 2006-2026 C4Media Inc. [Privacy Notice](http://www.infoq.com/privacy-notice), [Terms And Conditions](http://www.infoq.com/terms-and-conditions), [Cookie Policy](http://www.infoq.com/cookie-policy) Close [BT](http://www.infoq.com/int/bt/ "bt")