Elastic Channels for Snowpipe Streaming reach general availability
Snowpipe Streaming Elastic Channels are now GA, providing server-managed ingestion paths without requiring manual channel naming or lifecycle management.
O que mudou
Elastic Channels for Snowpipe Streaming provide a server-scaled implicit ingestion path per pipe, enabling concurrent producers to stream directly to Snowflake tables and managed Iceberg tables without managing channel names or offset tokens.
Use cases
Imagine you have concurrent applications sending real-time events and you want to avoid managing channel lifecycles and manual offsets.
- Stream data directly into Snowflake and Iceberg tables.
- Ingest data without manual channel management or lifecycle coordination.
- Use fire-and-forget or waitable append methods in supported SDKs.
How to use
Use version 1.8.0 or later of the Snowpipe Streaming SDK to access the GA API for Elastic Channels in Java, Python, or Node.js.
from snowpipe_streaming import StreamingClient
client = StreamingClient()
client.append_rows(
table_name="my_table",
data=[
{"column1": "value1", "column2": 123},
{"column1": "value2", "column2": 456}
]
)
What happens in this code:
- Initializes the streaming client.
- Appends a batch of rows directly to the target table using the managed elastic endpoint.
- Receives durable per-append acknowledgements.
Limitations and requirements
- Generally available (GA).
- Requires Snowpipe Streaming SDK version 1.8.0 or later.
- Elastic Channels provide at-least-once delivery without strict ordering; use Named Channels for ordered, exactly-once ingestion.
Using it in a pipeline
Removes intermediate staging files and message bus steps, allowing real-time producer applications to feed ingestion rows directly into bronze lakehouse tables with low latency.
- snowpipe streaming
- ingestion
- streaming
- iceberg
- python
- java
Elastic Channels for Snowpipe Streaming (General availability)
Resumo e explicação gerados por IA a partir da release note oficial. Em caso de dúvida, a documentação oficial da plataforma prevalece.
Relacionadas
- SnowflakeGA
Geração de documentos em PDF, Word e PowerPoint no Snowflake CoWork
O Snowflake CoWork agora gera arquivos PDF, Word, PowerPoint e HTML diretamente de suas análises usando a ferramenta de execução de código do Cortex Agent.
snowflake cowork · cortex agent - SnowflakePublic Preview
Cortex Agent SDK para Python e TypeScript no Snowflake
O Cortex Agent SDK permite criar aplicações que utilizam Cortex Agents e Cortex Code em Python e TypeScript.
cortex agents · python - SnowflakeAtualização
Mensagens de erro mais detalhadas na classificação de dados sensíveis
A view DATA_CLASSIFICATION_LATEST agora traz mensagens de erro específicas e códigos do Snowflake para falhas na classificação.
data governance · trust center