Skip to content
Lucas Lessa
Voltar para as notícias
DatabricksBetaImpacto: Médio

Anaplan connector in Lakeflow Connect for data ingestion

The new Anaplan connector in Lakeflow Connect lets you ingest audit events and user records directly into Databricks.

O que mudou

Use cases

Imagine you need to centralize operational data from Anaplan into your lakehouse for analysis and auditing. With this connector, you can:

  • Ingest audit events incrementally.
  • Refresh the users table with a full snapshot on each pipeline update.
  • Govern data directly using Unity Catalog.

How to use

To create the connection and configure ingestion using SQL in Databricks, use the commands to establish the connection and pipeline:

CREATE CONNECTION my_anaplan_connection
TO anaplan
OPTIONS (
  ca_certificate '-----BEGIN CERTIFICATE-----\n...', 
  private_key '-----BEGIN PRIVATE KEY-----\n...'
);

CREATE DATAFLOW my_pipeline
AS INGEST INTO my_catalog.my_schema.audit_events
FROM CONNECTION my_anaplan_connection;

What happens in this code:

  1. Creates a connection object in Catalog Explorer storing the Anaplan CA certificate and paired private key credentials.
  2. Sets up the data source using the managed Lakeflow Connect connector.
  3. Defines the Unity Catalog destination to write the audit events table.

Limitations and requirements

  • This feature is in Beta and must be enabled by workspace admins from the Previews page.
  • Authentication is supported exclusively via Anaplan CA certificate and paired private key.
  • API-based row filtering and SCD Type 2 are not supported.
  • Data type changes and column renames require a full refresh.
Ver nota oficial do Databricks

Anaplan connector (Beta)

Resumo e explicação gerados por IA a partir da release note oficial. Em caso de dúvida, a documentação oficial da plataforma prevalece.

Relacionadas