Ingest Google Workspace data with the new Lakeflow Connect connector

The managed Google Workspace connector brings audit logs and activity data from Google apps and services directly into Databricks incrementally.

Use cases

Imagine you need to centralize company user access audits and security events inside the Lakehouse.

• Ingest Google Workspace audit activity.
• Run automated incremental loads.
• Govern data centrally with Unity Catalog.

How to use

# Example of setting up an ingestion pipeline via SDK
from databricks.sdk import WorkspaceClient

w = WorkspaceClient()

# Illustrative example of creating a pipeline tied to the Google Workspace connection
# Ensure you configure the Unity Catalog connection beforehand.

What happens in this code:

1. The Workspace client initializes communication with the Databricks API.
2. The pipeline uses the OAuth user authorization credentials configured in the connection.
3. Audit data begins extracting incrementally.

Limitations and requirements

• Stage: Beta.
• A workspace admin must turn on Lakeflow Connect for Google Workspace from the Previews page.
• Supported authentication method: OAuth U2M.
• API-based row filtering and SCD Type 2 are not supported.

Using it in a pipeline

Place this connector in the Bronze layer to receive raw audit and security events, enabling downstream transformations in the Silver layer for compliance analytics.