Archetype — AEP-Heavy Enterprise Evaluating Composable
Organizational profile
Large enterprise (typically >$1B revenue, >500K customer profiles in AEP). AEP is the primary CDP, often alongside Adobe Campaign, Marketo Engage, or Target in the same licensing agreement. IT and Marketing each hold separate Responsible roles; the Accountable is typically a VP Marketing Ops, CDO, or CTO.
A cloud data warehouse (Snowflake, Databricks, or BigQuery) has grown organically — driven by data science and finance, not marketing. The marketing team is increasingly aware the CDW exists and wants access to what's in it.
Trigger pattern
The evaluation is usually precipitated by one or more of:
- AEP egress limits (constraint.aep-first-gen-export-500kb, constraint.aep-second-gen-export-1500kb) blocking analyst self-service reporting.
- Query timeouts (constraint.aep-adhoc-query-timeout-10min) frustrating data scientists who expected SQL access to be "like Snowflake."
- A new use case (personalized pricing, ML propensity modeling) that the CDW team wants to own end-to-end but that marketing needs for activation.
- Second-gen Data Access API ceiling (constraint.aep-second-gen-data-access-api-200kb): when second-gen profile data exceeds 200 KB/profile/year in export volume via the Data Access API path, the Destination SDK constraint creates an architectural fork — accept AEP ecosystem lock-in for the higher (1500 KB) limit, or adopt the AEP-as-edge-node pattern.
- Batch activation scheduling congestion (constraint.aep-batch-audiences-per-hour-100, constraint.aep-simultaneous-activation-per-destination-50): When the enterprise has >100 batch-activated audiences, scheduling them in the same export hour produces throughput degradation. The 100-audiences-per-hour performance guardrail and the 50-simultaneous-activations-per-destination guardrail interact: high-density scheduling windows exceed both limits, creating delayed export delivery and missed activation windows. This friction is often discovered during the first production export scale-up.
- Ad-hoc activation bottlenecks (constraint.aep-adhoc-activation-max-audiences-80, constraint.aep-adhoc-concurrent-job-per-audience-1): Time-sensitive campaign launches requiring immediate activation of many audiences — flash sales, emergency suppressions, go-live events — are constrained by the 80-audience-per-ad-hoc-job limit and the 1-concurrent-job-per-audience serialization. Multi-destination rapid-fire activation for the same audience queues sequentially rather than executing in parallel. These limits become operational bottlenecks for enterprises with promotional marketing at scale.
Common presenting symptoms
- "We can't get our own data out of AEP fast enough."
- "Our data science team won't use AEP Query Service — they just run everything in Snowflake."
- "We're building the same audience twice: once in AEP for activation, once in the CDW for the ML team."
- "Our batch exports don't all deliver by the time our morning email campaign fires — something in the AEP scheduling is backing up."
Recommended direction
pattern.aep-as-edge-node: move audience computation and profile assembly to the CDW; keep AEP as the activation-side consumer. Use reverse-ETL to push CDW-assembled audiences into AEP for activation. This avoids ripping out AEP (expensive and politically difficult) while relieving data-engineering from AEP's compute constraints.
Key tradeoffs
- tradeoff.center-of-gravity: CDW becomes the source of truth; AEP becomes a consumer.
- tradeoff.data-egress: Egress pressure is relieved once audiences are computed outside AEP.
- tradeoff.integration-philosophy: A reverse-ETL tool (vendor-neutral alternatives: Hightouch, Fivetran Activations (formerly Census, acquired May 2025), RudderStack) becomes a new system to operate and govern.
- tradeoff.cost-predictability: CDW costs are consumption-based and require FinOps discipline.