Skip to main content

Guides

ScenarioGuide
Ingest files landing in S3, ADLS, or GCS using Databricks AutoloaderAutoloader / Cloud Files
Ingest from Kafka or Azure Event HubsKafka & Event Hubs
CDC merge — Type 1 or Type 2 SCD from a change-data-capture sourceCDC with apply_changes
Full snapshot ingestion — replace-all semantics, not streamingSnapshot Ingestion
Fan-out: one bronze table as source for multiple silver tablesSilver Fanout
Write pipeline output to an external Delta table or Kafka topicDLT Sink
Multiple source paths (e.g. US, EU, APAC) → single target tableMulti-Source CDC
Filter rows at pipeline time by column valueRow Filters