Streaming Data Ingestion

capability.streaming-ingestion ↗

The ability to continuously ingest event streams or change-data-capture feeds into a cloud data warehouse with sub-minute end-to-end latency. In the composable CDP stack, streaming ingestion is the mechanism that keeps CDW profile models fresh enough to power near-real-time activation: events (page views, purchases, support interactions) flow from production systems to Snowflake within seconds to minutes, rather than waiting for the next scheduled batch load. Primary implementations: Snowflake Kafka Connector (Kafka-based; v3 Classic formal deprecation announcement planned mid-2026 — existing workloads fully supported, 18-month migration window starts upon announcement, EoL approximately late 2027; v4 current), Snowpipe Streaming SDK (programmatic, no Kafka required), and Fivetran connectors with append-mode scheduling (1–15 minute cadence; not open-connection streaming). Latency target: sub-minute to 5 minutes. Distinct from AEP Edge Network real-time event processing (sub-100ms, intra-request) — streaming ingestion feeds the CDW profile store, not the edge decisioning plane.