Ingest Celigo audit logs into Databricks using Lakeflow
The new Celigo connector in Lakeflow Connect allows ingesting audit events directly into Databricks using an API token.
O que mudou
Use cases
Imagine that you need to centralize integration audits and want to bring resource creation, update, and deletion events from Celigo (integrator.io) into your lakehouse.
- Ingest Celigo audit log events incrementally.
- Automate schema evolution for new or removed columns.
How to use
CREATE CONNECTION my_celigo_connection
TYPE CELIGO
OPTIONS (
api_token 'your_api_token_here'
);
What happens in this code:
- Creates a secure connection in Unity Catalog to store the access credentials.
- Sets up basic authentication using the Celigo API key.
Limitations and requirements
- Feature is in Beta.
- Requires a workspace admin to enable Lakeflow Connect for Celigo from the Previews page.
- Authentication is restricted to full-access Celigo integrator.io API tokens.
- API-based row filtering is not supported.
- Data type changes or column renames require a full refresh.
- lakeflow connect
- celigo
- unity catalog
- ingestion
- audit logs
Celigo connector (Beta)
Resumo e explicação gerados por IA a partir da release note oficial. Em caso de dúvida, a documentação oficial da plataforma prevalece.
Relacionadas
- DatabricksGA
Repositórios de pacotes em nível de workspace para Databricks Apps
Administradores de workspace podem configurar repositórios padrão de pacotes Python e npm para Databricks Apps.
databricks apps · workspace settings - DatabricksGA
Redimensione partições de stateful streaming sem perder o checkpoint no Databricks
Agora é possível alterar o número de partições de shuffle em queries Structured Streaming e pipelines Lakeflow sem descartar o estado do checkpoint.
structured streaming · lakeflow - DatabricksAtualização
Google Gemini 4 Argon disponível no Unity Gateway do Databricks
O modelo multimodal Google Gemini 4 Argon já pode ser acessado via Foundation Model APIs e Unity Gateway.
unity catalog · foundation model apis