Skip to contents

Delta Sync Vector Search Index Specification

Usage

delta_sync_index_spec(
  source_table,
  embedding_writeback_table = NULL,
  embedding_source_columns = NULL,
  embedding_vector_columns = NULL,
  pipeline_type = c("TRIGGERED", "CONTINUOUS")
)

Arguments

source_table

The name of the source table.

embedding_writeback_table

Name of table to sync index contents and computed embeddings back to delta table, see details.

embedding_source_columns

The columns that contain the embedding source, must be one or list of embedding_source_column()

embedding_vector_columns

The columns that contain the embedding, must be one or list of embedding_vector_column()

pipeline_type

Pipeline execution mode, see details.

Details

pipeline_type is either:

  • "TRIGGERED": If the pipeline uses the triggered execution mode, the system stops processing after successfully refreshing the source table in the pipeline once, ensuring the table is updated based on the data available when the update started.

  • "CONTINUOUS" If the pipeline uses continuous execution, the pipeline processes new data as it arrives in the source table to keep vector index fresh.

The only supported naming convention for embedding_writeback_table is "<index_name>_writeback_table".