T
traeai
Sign in
返回首页
Databricks

Expanded interoperability with Unity Catalog Open APIs

7.5Score
Expanded interoperability with Unity Catalog Open APIs

TL;DR · AI Summary

Databricks expands Unity Catalog open APIs to enhance cross-platform data governance and interoperability.

Key Takeaways

  • Unity Catalog now supports RESTful APIs and SDKs for third-party integration.
  • New APIs cover metadata management, access control, and data sharing.
  • Enterprises can automate governance policies via scripting.

Outline

Jump quickly between sections.

  1. §Introduction

    Databricks introduces open APIs for Unity Catalog to improve cross-platform interoperability.

  2. ·Core Features

    RESTful APIs and SDKs support metadata, access control, and data sharing.

  3. ·Use Cases

    Enterprises can use APIs for automated governance and system integration.

  4. ›Technical Advantages

    Standardized interfaces reduce integration costs and improve governance efficiency.

Mindmap

See how the topics connect at a glance.

查看大纲文本（无障碍 / 无 JS 友好）
  • Unity Catalog Open APIs
    • 核心功能
      • 元数据管理
      • 权限控制
      • 数据共享
    • 技术实现
      • RESTful API
      • SDK 支持
      • CLI 工具
    • 应用场景
      • 跨平台集成
      • 自动化治理
      • 数据安全合规

Highlights

Key sentences worth saving and sharing.

#Databricks#Data Governance#API
Open original article

Expanded interoperability with Unity Catalog Open APIs | Databricks Blog

Skip to main content

[![Image 1](blob:http://localhost/c3d26385bd032c882a09c45135533626)](https://www.databricks.com/)

[![Image 2](blob:http://localhost/c3d26385bd032c882a09c45135533626)](https://www.databricks.com/)

  • Why Databricks
  • * Discover
  • Customers
  • Partners
  • Product
  • * Databricks Platform
  • Integrations and Data
  • Pricing
  • Open Source
  • Solutions
  • * Databricks for Industries
  • Cross Industry Solutions
  • Migration & Deployment
  • Solution Accelerators
  • Resources
  • * Learning
  • Events
  • Blog and Podcasts
  • Get Help
  • Dive Deep
  • About
  • * Company
  • Careers
  • Press
  • Security and Trust
  • DATA + AI SUMMIT ![Image 3: Data+ai summit promo JUNE 15–18|SAN FRANCISCO Join us at the world’s largest data, apps and AI event. Register](https://www.databricks.com/dataaisummit?itm_source=www&itm_category=home&itm_page=home&itm_location=navigation&itm_component=navigation&itm_offer=dataaisummit)
  1. All blogs
  2. / Platform

Table of contents

Table of contents

Table of contents

PlatformMay 14, 2026

Expanded interoperability with Unity Catalog Open APIs

Create, read, and write to managed Delta tables from external engines.

by Alex Jiang and Tathagata Das

Summary

  • External access to UC managed Delta tables is now in Beta. External engines like Apache Spark, Flink, and DuckDB can now create, read, write to managed Delta tables.
  • UC managed Delta tables are built on Delta Lake's new catalog commits feature — an open standard that coordinates commits through the catalog, enabling safe concurrent writes, audibility, and multi-statement transactions
  • Credential vending is now generally available. Thousands of customers use credential vending to securely access UC data assets from external engines, now with M2M OAuth support and automatic credential refresh for long-running pipelines

Unity Catalog was designed for the open lakehouse. Previously, data teams were stuck in silos, often forced to duplicate data across platforms just to use the tools they wanted. Every new platform or tool meant copying datasets, rebuilding access policies from scratch, and keeping everything in sync. The result was increased costs from redundant storage, policies that drifted out of sync, and fragmented data access and discovery.

When we open sourced Unity Catalog and launched Open APIs, we broke down the silos that previously kept customers locked-in. Enterprises could finally keep one copy of data, use any compute engine, and govern everything from one place. The UC ecosystem has thrived since. Today, thousands of customers use Unity Catalog to govern and access Delta Lake and Apache Iceberg tables, with dozens of integrations in the growing Unity Catalog ecosystem — from Apache Spark and Trino to DuckDB and Confluent Tableflow.

External Access to Managed Tables, Now in Beta

UC managed tables are where openness meets performance. These advanced tables use Predictive Optimization and Liquid Clustering to automatically tune data layouts, run compaction and vacuuming, and keep statistics fresh — delivering up to 20× faster queries and 50% lower storage costs, while staying fully accessible through open APIs.

Now in Beta, external engines, such as Apache Spark, Flink, and DuckDB, can create and write to UC managed Delta tables with centralized governance and automatic optimizations.

With the Beta, external engines can:

  • Create managed tables — Stand up new UC managed tables directly from an external engine.
  • Batch read and write — Read and write to managed tables with full transactional safety.
  • Stream to and from managed tables — Use managed tables as both a streaming source and sink, enabling end-to-end real-time pipelines on Apache Spark.

Because every operation flows through UC managed tables built on catalog commits, you get serialized commits that prevent log corruption and complete auditability of every read and write. Predictive Optimization continues to run seamlessly, even on tables accessed by external engines. Catalog commits also lay the groundwork for features like multi-statement, multi-table transactions that require a centralized commit coordinator.

The thriving UC ecosystem is continuing to grow as engines expand support for external access to managed tables. Delta Kernel — the open source Java and Rust library for reading, writing, and committing to Delta tables — abstracts the low-level protocol details so connector developers can focus on UC integration, not Delta implementation. Apache Spark, Delta Flink, and DuckDB have all leveraged Delta Kernel to support external writes to UC managed tables and integrate with catalog-managed commits, and the ecosystem continues to grow. By handling the low-level protocol complexity, Delta Kernel makes it straightforward for any engine to integrate with Unity Catalog which contributes to a growing ecosystem of connectors.

Secure External Access Made Possible By Credential Vending

For an external engine to access data in UC, it needs a secure way to authenticate and get scoped access to cloud storage without requiring broad, static permissions or credentials tied to a specific account. Unity Catalog handles this through credential vending, which is now generally available (GA): UC issues short-lived, scoped credentials to external engines on demand, with access policies enforced centrally.

Thousands of customers have used UC Open APIs and two additions make it production-ready at enterprise scale. External engines can now authenticate to UC using machine-to-machine (M2M) OAuth, meeting enterprise security requirements without relying on personalized access tokens (PATs), which are per-user, long-lived, and hard to rotate. And credentials are refreshed automatically by engines via the UC credential vending APIs, so pipelines that run for hours complete reliably without tokens expiring mid-job.

Image 4: Query execution with credential vending

Expand

Query execution with credential vending using an external compute engine

With credential vending, enterprises can read, write, and create managed and external tables in Unity Catalog from any compatible engine or tool. These credentials are short-lived, scoped to the requested resource, and governed by UC privileges. This means your platform team retains full control over which principals can access data externally and what they can do with it.

With Unity Catalog’s Open APIs, we've empowered our teams to use their preferred tools while maintaining governance and data consistency. We can leverage the benefits of managed tables within a truly interoperable data and AI platform that works across multiple compute engines.— Sudipta Das, Director of Enterprise Data Operations at PepsiCo

Credential Vending for Volumes

Credential vending extends not only to tables but also unstructured data. Volume credential vending is now in Public Preview, so external clients can request temporary, scoped credentials to access images, PDFs, and videos stored in volumes with Unity Catalog governance. The same access control model, audit trail, and scoped credentials apply whether you're querying a table or processing a raw video file externally.

What's Next?

We're continuing to invest in making external access more capable. Credential vending today governs coarse-grained access controls for external engines. We've also developed functionality to enforce attribute-based access controls (ABAC) for external reads, which makes governance fine-grained. This makes it possible to enforce row and column level ABAC policies when UC managed tables are read rom external engines.

Get Started Today

To get started with credential vending, see our documentation. To use the Beta of external access to managed Delta tables:

  1. Enroll in "External Access to Unity Catalog Managed Delta Table" in the Databricks preview portal (see Manage Databricks previews)
  2. Enable external data access on your metastore and grant EXTERNAL_USE_SCHEMA on the schema containing the tables you want to access.
  3. Create a new UC managed table. To move existing data, see the migration guide for converting external tables to managed.
  4. Use Delta-Spark 4.2 with Unity Catalog 0.4.1 to create, read, and write to managed tables from external compute. See the external access documentation.

Join us at Data and AI Summit 2026

Data and AI Summit 2026 is almost here! Join us June 15-18, 2026 at the Moscone Center in San Francisco, California to learn how leading organizations are using Unity Catalog to govern data and AI across engines. Register today to get a first look at what’s coming next for open, unified governance.

Get the latest posts in your inbox

Subscribe to our blog and get the latest posts delivered to your inbox.

Sign up

*

Work Email

*

Country Country*

By clicking “Subscribe” I understand that I will receive Databricks communications, and I agree to Databricks processing my personal data in accordance with its Privacy Policy.

Subscribe

View all blogs

Image 5: databricks logo

Why Databricks

Discover

Customers

Partners

Why Databricks

Discover

Customers

Partners

Product

Databricks Platform

Pricing

Open Source

Integrations and Data

Product

Databricks Platform

Pricing

Open Source

Integrations and Data

Solutions

Databricks For Industries

Cross Industry Solutions

Data Migration

Professional Services

Solution Accelerators

Solutions

Databricks For Industries

Cross Industry Solutions

Data Migration

Professional Services

Solution Accelerators

Resources

Documentation

Customer Support

Community

Learning

Events

Blog and Podcasts

Resources

Documentation

Customer Support

Community

Learning

Events

Blog and Podcasts

About

Company

Careers

Press

Security and Trust

About

Company

Careers

Press

Security and Trust

Image 7: databricks logo

Databricks Inc.

160 Spear Street, 15th Floor

San Francisco, CA 94105

1-866-330-0121

  • [](https://www.linkedin.com/company/databricks)
  • [](https://www.facebook.com/pages/Databricks/560203607379694)
  • [](https://twitter.com/databricks)
  • [](https://www.databricks.com/feed)
  • [](https://www.glassdoor.com/Overview/Working-at-Databricks-EI_IE954734.11,21.htm)
  • [](https://www.youtube.com/@Databricks)
Image 9

See Careers

at Databricks

  • [](https://www.linkedin.com/company/databricks)
  • [](https://www.facebook.com/pages/Databricks/560203607379694)
  • [](https://twitter.com/databricks)
  • [](https://www.databricks.com/feed)
  • [](https://www.glassdoor.com/Overview/Working-at-Databricks-EI_IE954734.11,21.htm)
  • [](https://www.youtube.com/@Databricks)

© Databricks 2026. All rights reserved. Apache, Apache Spark, Spark, the Spark Logo, Apache Iceberg, Iceberg, and the Apache Iceberg logo are trademarks of the Apache Software Foundation.

We Care About Your Privacy

Databricks uses cookies and similar technologies to enhance site navigation, analyze site usage, personalize content and ads, and as further described in our Cookie Notice. To disable non-essential cookies, click “Reject All”. You can also manage your cookie settings by clicking “Manage Preferences.”

Manage Preferences

Reject All Accept All

Image 12: Databricks Company Logo

Privacy Preference Center

Opt-Out Preference Signal Honored

Privacy Preference Center

  • ### Your Privacy
  • ### Strictly Necessary Cookies
  • ### Performance Cookies
  • ### Functional Cookies
  • ### Targeting Cookies
  • ### TOTHR

#### Your Privacy

When you visit any website, it may store or retrieve information on your browser, mostly in the form of cookies. This information might be about you, your preferences or your device and is mostly used to make the site work as you expect it to. The information does not usually directly identify you, but it can give you a more personalized web experience. Because we respect your right to privacy, you can choose not to allow some types of cookies. Click on the different category headings to find out more and change our default settings. However, blocking some types of cookies may impact your experience of the site and the services we are able to offer.

#### Opting out of sales, sharing, and targeted advertising

Depending on your location, you may have the right to opt out of the “sale” or “sharing” of your personal information or the processing of your personal information for purposes of online “targeted advertising.” You can opt out based on cookies and similar identifiers by disabling optional cookies here. To opt out based on other identifiers (such as your email address), submit a request in our Privacy Request Center.

More information

#### Strictly Necessary Cookies

Always Active

These cookies are necessary for the website to function and cannot be switched off in our systems. They assist with essential site functionality such as setting your privacy preferences, logging in or filling in forms. You can set your browser to block or alert you about these cookies, but some parts of the site will no longer work.

#### Performance Cookies

  • [x] Performance Cookies

These cookies allow us to count visits and traffic sources so we can measure and improve the performance of our site. They help us to know which pages are the most and least popular and see how visitors move around the site.

#### Functional Cookies

  • [x] Functional Cookies

These cookies enable the website to provide enhanced functionality and personalization. They may be set by us or by third party providers whose services we have added to our pages. If you do not allow these cookies then some or all of these services may not function properly.

#### Targeting Cookies

  • [x] Targeting Cookies

These cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant advertisements on other sites. If you do not allow these cookies, you will experience less targeted advertising.

#### TOTHR

  • [x] TOTHR

Cookie List

Consent Leg.Interest

  • [x] checkbox label label
  • [x] checkbox label label
  • [x] checkbox label label

Clear

  • - [x] checkbox label label

Apply Cancel

Confirm My Choices

Allow All

Image 13: Powered by Onetrust
Image 15

Image 16Image 17

Image 18

AI may generate inaccurate information. Please verify important content.