Clean Rooms now support shared output tables across all collaborators
Clean Room notebooks can now write tables to a shared schema accessible by all collaborators in real time, even before the run completes.
O que mudou
Databricks has made shared output in Clean Rooms generally available (GA). Notebook runs within a clean room can now write tables directly to a shared schema that every collaborator can query immediately, even before the run finishes.
Use cases
Imagine two organizations collaborating in a Clean Room to calculate audience overlap or campaign attribution. Previously, output tables were accessible only to the runner upon completion. With shared output, you can:
- Distribute aggregated results and metrics to all participants simultaneously.
- Expose intermediate tables and operational logs while the notebook is still running.
- Connect shared analytical outputs directly into automated Lakeflow Jobs.
How to use
In your clean room notebook, build the three-part namespace using the parameters :cr_output_catalog and :cr_shared_output_schema:
CREATE TABLE identifier(:cr_output_catalog || '.' || :cr_shared_output_schema || '.audiencia_sobreposta') AS
SELECT
origem.segmento_id,
COUNT(DISTINCT parceiro.email) AS total_sobreposicao
FROM parceiro.base.perfis AS parceiro
JOIN criador.base.perfis AS origem
ON parceiro.email = origem.email
GROUP BY origem.segmento_id;
What happens in this code:
- The
:cr_output_catalogparameter references the output catalog provisioned in the Unity Catalog metastore. - The
:cr_shared_output_schemaparameter routes table creation into the schema accessible by all collaborators. - The resulting table becomes immediately queryable for everyone in the room as soon as the cell finishes, even if subsequent notebook cells are still executing.
To write tables that should remain private to the executor, use :cr_output_schema instead.
Limitations and requirements
- Maturity: Generally Available (GA).
- Account setup: On Enterprise tiers (and Azure Premium), account admins must enable Shared Output from the Previews console. All collaborators in the clean room must have identical settings enabled.
- Clean room creation: Shared output must be activated during clean room creation; existing clean rooms cannot be retrofitted.
- Output catalog: Collaborators must create an output catalog via the UI (Catalog > Clean Rooms > Output > Create catalog) using
EXECUTE CLEAN ROOM TASKpermissions. - Compute: Reading output tables requires serverless compute.
- Storage limits: Only tables are supported (no views or volumes). Tables are read-only and automatically purged after 30 days unless replicated to local storage.
Using it in a pipeline
You can schedule clean room notebooks using Lakeflow Jobs. Once the shared tables are written, downstream workflows on each collaborator's side can ingest the output into internal Silver or Gold layers for local reporting.
- clean rooms
- unity catalog
- data sharing
- serverless
- lakeflow jobs
Shared output in clean rooms is now generally available
Resumo e explicação gerados por IA a partir da release note oficial. Em caso de dúvida, a documentação oficial da plataforma prevalece.
Relacionadas
- DatabricksBeta
Conector do SurveyMonkey chega ao Lakeflow Connect no Databricks
O Lakeflow Connect agora conta com conector nativo para o SurveyMonkey em Beta, permitindo ingestão incremental de pesquisas, respostas e contatos com governança no Unity Catalog.
lakeflow connect · surveymonkey - DatabricksBeta
Lakeflow Connect adiciona conector do Oracle Eloqua em Beta
O Lakeflow Connect agora oferece um conector gerenciado em Beta para o Oracle Eloqua, permitindo ingestão incremental de dados de marketing governados pelo Unity Catalog.
lakeflow connect · oracle eloqua - DatabricksBeta
Ingira métricas do GA4 com o novo conector do Lakeflow Connect
O Lakeflow Connect ganha conector gerenciado em Beta para o Google Analytics 4, permitindo ingestão incremental de relatórios agregados via API com governança no Unity Catalog.
lakeflow connect · google analytics