Skip to content
Lucas Lessa
Café com Features
Voltar para as notícias
SnowflakeGAImpacto: Alto

External lineage in Snowflake is now generally available

Snowflake now supports OpenLineage events from external tools like dbt and Airflow to track data flows outside the platform.

O que mudou

External lineage extends Snowflake's native lineage to include external data sources and destinations using the OpenLineage standard. Tools like dbt and Apache Airflow send events via a REST endpoint to unify data flow visibility in Snowsight and enable SQL queries.

Use cases

Imagine you need to audit pipelines passing through external systems before reaching Snowflake or flowing strictly between third-party tools.

  • Send OpenLineage events to the dedicated Snowflake endpoint.
  • Track dependencies between external objects without requiring Snowflake tables.
  • Query combined lineage using the GET_LINEAGE function.

How to use

Configure account permissions and send events through the REST API using integrated tools like dbt or Airflow.

CREATE ROLE dbt_lineage_role;
GRANT INGEST LINEAGE ON ACCOUNT TO ROLE dbt_lineage_role;
GRANT ROLE dbt_lineage_role TO USER dbt_integration_user;

What happens in this code:

  1. Creates a new dedicated role in Snowflake.
  2. Grants the lineage ingestion privilege to the role.
  3. Assigns the role to the integration tool's service user.

Limitations and requirements

Requires Enterprise Edition or higher. Sending lineage requires the INGEST LINEAGE privilege on the account, and removing it requires DELETE LINEAGE.

Ver nota oficial do Snowflake

External lineage (General availability)

Resumo e explicação gerados por IA a partir da release note oficial. Em caso de dúvida, a documentação oficial da plataforma prevalece.

Relacionadas