Connect Workday activity logs directly into Databricks
The new Lakeflow Connect connector brings Workday activity logs into Databricks incrementally.
O que mudou
Use cases
Imagine you need to audit user activity and access in Workday by combining these logs with your enterprise data. With this connector, you can:
- Ingest user activity logs incrementally.
- Use Unity Catalog for data governance.
- Orchestrate ingestion using Databricks Workflows.
How to use
You can create a pipeline using notebooks or Asset Bundles, authenticating via an OAuth refresh token.
from databricks.sdk import WorkspaceClient
w = WorkspaceClient()
# Example of creating an ingestion pipeline
pipeline = w.pipelines.create(
name="workday_logs_pipeline",
storage="/Volumes/my_catalog/default/storage_path",
target="my_catalog.default",
libraries=[{"notebook": {"path": "/Workspace/Users/admin/workday_notebook"}}]
)
What happens in this code:
- Initializes the Databricks Workspace client.
- Creates a new pipeline pointing to a volume and target schema in Unity Catalog.
- Associates a notebook that executes the ingestion logic.
Limitations and requirements
- Stage: Beta.
- Requires a workspace admin to enable the feature from the Previews page.
- Authentication is supported exclusively via OAuth refresh token.
- Does not support SCD Type 2 or API-based row filtering.
Using it in a pipeline
Raw logs land in the Bronze layer from the Workday connector and can be cleaned and structured in the Silver layer for security and compliance audits.
- lakeflow connect
- workday
- streaming
- unity catalog
- pipelines
Workday Activity Logging connector (Beta)
Resumo e explicação gerados por IA a partir da release note oficial. Em caso de dúvida, a documentação oficial da plataforma prevalece.
Relacionadas
- DatabricksGA
Repositórios de pacotes em nível de workspace para Databricks Apps
Administradores de workspace podem configurar repositórios padrão de pacotes Python e npm para Databricks Apps.
databricks apps · workspace settings - DatabricksGA
Redimensione partições de stateful streaming sem perder o checkpoint no Databricks
Agora é possível alterar o número de partições de shuffle em queries Structured Streaming e pipelines Lakeflow sem descartar o estado do checkpoint.
structured streaming · lakeflow - DatabricksAtualização
Google Gemini 4 Argon disponível no Unity Gateway do Databricks
O modelo multimodal Google Gemini 4 Argon já pode ser acessado via Foundation Model APIs e Unity Gateway.
unity catalog · foundation model apis