Skip to main content

databricks.labs.dqx.llm.llm_engine

DQLLMEngine Objects​

class DQLLMEngine()

High-level interface for LLM-based data quality rule generation.

This class serves as a Facade pattern, providing a simple interface to the underlying complex LLM system.

__init__​

def __init__(model_config: LLMModelConfig,
             custom_check_functions: dict[str, Callable] | None = None)

Initialize the LLM engine.

Arguments:

  • model_config - Configuration for the LLM model.
  • custom_check_functions - Optional custom check functions to include.

get_business_rules_with_llm​

def get_business_rules_with_llm(
        user_input: str,
        schema_info: str = "") -> dspy.primitives.prediction.Prediction

Get DQX rules based on natural language request with optional schema.

If schema_info is empty (default), it will automatically infer the schema from the user_input before generating rules.

Arguments:

  • user_input - Natural language description of data quality requirements.
  • schema_info - Optional JSON string containing table schema. If empty (default), triggers schema inference.

Returns:

A Prediction object containing:

  • quality_rules: The generated DQ rules
  • reasoning: Explanation of the rules
  • guessed_schema_json: The inferred schema (if schema was inferred)
  • assumptions_bullets: Assumptions made (if schema was inferred)
  • schema_info: The final schema used (if schema was inferred)