Feature Views are now generally available for batch and streaming
Feature Views are now GA, bringing support for batch, streaming, and request-time data in Databricks.
O que mudou
Feature Views enable you to define and compute features from sources such as Delta tables, Kafka streams, and request-time data, integrating with Unity Catalog for model training and serving.
Use cases
Imagine you need to feed machine learning models with consistent temporal aggregations and real-time data.
- Define feature objects directly in Unity Catalog.
- Compute point-in-time features for model training and inference.
- Materialize features to offline and online stores.
How to use
Install the library and define features using Python.
from databricks.feature_engineering import FeatureEngineeringClient
from databricks.feature_engineering.entities import (
DeltaTableSource, Feature, AggregationFunction, Avg, TumblingWindow
)
from datetime import timedelta
source = DeltaTableSource(catalog_name="main", schema_name="feature_store", table_name="transactions")
avg_feature = Feature(
source=source,
entity=["user_id"],
timeseries_column="transaction_time",
function=AggregationFunction(Avg(input="amount"), TumblingWindow(window_duration=timedelta(days=30))),
name="avg_transaction_30d",
)
fe = FeatureEngineeringClient()
feature_df = fe.compute_features(features=[avg_feature])
feature_df.display()
What happens in this code:
- Configures the data source pointing to a Delta table.
- Defines a rolling average feature with a 30-day window grouped by user.
- Initializes the feature engineering client and computes the resulting DataFrame.
Limitations and requirements
- Requires serverless compute or a classic compute cluster running Databricks Runtime 17.0 ML or above.
- You must install the
databricks-feature-engineering>=0.16.0package. - Streaming features require an
online_configand do not supportoffline_configdirectly.
Using it in a pipeline
They fit right after ingestion in the Bronze/Silver layers to unify feature engineering logic between offline model training and low-latency online model serving.
- feature views
- unity catalog
- mlflow
- machine learning
- streaming
Feature Views are now generally available
Resumo e explicação gerados por IA a partir da release note oficial. Em caso de dúvida, a documentação oficial da plataforma prevalece.
Relacionadas
- DatabricksGA
Repositórios de pacotes em nível de workspace para Databricks Apps
Administradores de workspace podem configurar repositórios padrão de pacotes Python e npm para Databricks Apps.
databricks apps · workspace settings - DatabricksGA
Redimensione partições de stateful streaming sem perder o checkpoint no Databricks
Agora é possível alterar o número de partições de shuffle em queries Structured Streaming e pipelines Lakeflow sem descartar o estado do checkpoint.
structured streaming · lakeflow - DatabricksAtualização
Google Gemini 4 Argon disponível no Unity Gateway do Databricks
O modelo multimodal Google Gemini 4 Argon já pode ser acessado via Foundation Model APIs e Unity Gateway.
unity catalog · foundation model apis