Snowflake Snowpipe Overview (2026)
Official Snowflake documentation covering Snowpipe continuous data loading.
Key facts surfaced (2026-05-19):
- Processes staged files in micro-batches as soon as they arrive in cloud storage (S3, GCS, Azure Blob/ADLS Gen2).
- Two detection methods: automated cloud messaging event notifications, or manual REST API file lists.
- Uses Snowflake-supplied compute resources (not user-managed virtual warehouses).
- Load history retained for 14 days (vs. 64 days for bulk loads).
- Prevents duplication via file loading metadata tracking paths and names.
- Curriculum reference: composable CDP equivalent of AEP Streaming Ingestion for near-real-time event loads (Module 2).