Anaplan connector in Lakeflow Connect for data ingestion
The new Anaplan connector in Lakeflow Connect lets you ingest audit events and user records directly into Databricks.
O que mudou
Use cases
Imagine you need to centralize operational data from Anaplan into your lakehouse for analysis and auditing. With this connector, you can:
- Ingest audit events incrementally.
- Refresh the users table with a full snapshot on each pipeline update.
- Govern data directly using Unity Catalog.
How to use
To create the connection and configure ingestion using SQL in Databricks, use the commands to establish the connection and pipeline:
CREATE CONNECTION my_anaplan_connection
TO anaplan
OPTIONS (
ca_certificate '-----BEGIN CERTIFICATE-----\n...',
private_key '-----BEGIN PRIVATE KEY-----\n...'
);
CREATE DATAFLOW my_pipeline
AS INGEST INTO my_catalog.my_schema.audit_events
FROM CONNECTION my_anaplan_connection;
What happens in this code:
- Creates a connection object in Catalog Explorer storing the Anaplan CA certificate and paired private key credentials.
- Sets up the data source using the managed Lakeflow Connect connector.
- Defines the Unity Catalog destination to write the audit events table.
Limitations and requirements
- This feature is in Beta and must be enabled by workspace admins from the Previews page.
- Authentication is supported exclusively via Anaplan CA certificate and paired private key.
- API-based row filtering and SCD Type 2 are not supported.
- Data type changes and column renames require a full refresh.
- lakeflow connect
- anaplan
- ingestion
- unity catalog
- pipeline
Anaplan connector (Beta)
Resumo e explicação gerados por IA a partir da release note oficial. Em caso de dúvida, a documentação oficial da plataforma prevalece.
Relacionadas
- DatabricksGA
Repositórios de pacotes em nível de workspace para Databricks Apps
Administradores de workspace podem configurar repositórios padrão de pacotes Python e npm para Databricks Apps.
databricks apps · workspace settings - DatabricksGA
Redimensione partições de stateful streaming sem perder o checkpoint no Databricks
Agora é possível alterar o número de partições de shuffle em queries Structured Streaming e pipelines Lakeflow sem descartar o estado do checkpoint.
structured streaming · lakeflow - DatabricksAtualização
Google Gemini 4 Argon disponível no Unity Gateway do Databricks
O modelo multimodal Google Gemini 4 Argon já pode ser acessado via Foundation Model APIs e Unity Gateway.
unity catalog · foundation model apis