dbldatagen package

Subpackages

• dbldatagen.constraints package
  • Submodules
    • dbldatagen.constraints.chained_relation module
      • ChainedRelation
    • dbldatagen.constraints.constraint module
      • Constraint
      • NoFilterMixin
      • NoPrepareTransformMixin
    • dbldatagen.constraints.literal_range_constraint module
      • LiteralRange
    • dbldatagen.constraints.literal_relation_constraint module
      • LiteralRelation
    • dbldatagen.constraints.negative_values module
      • NegativeValues
    • dbldatagen.constraints.positive_values module
      • PositiveValues
    • dbldatagen.constraints.ranged_values_constraint module
      • RangedValues
    • dbldatagen.constraints.sql_expr module
      • SqlExpr
    • dbldatagen.constraints.unique_combinations module
      • UniqueCombinations
  • Module contents
• dbldatagen.datasets package
  • Submodules
    • dbldatagen.datasets.basic_geometries module
      • BasicGeometriesProvider
    • dbldatagen.datasets.basic_process_historian module
      • BasicProcessHistorianProvider
    • dbldatagen.datasets.basic_telematics module
      • BasicTelematicsProvider
    • dbldatagen.datasets.basic_user module
      • BasicUserProvider
    • dbldatagen.datasets.benchmark_groupby module
      • BenchmarkGroupByProvider
    • dbldatagen.datasets.dataset_provider module
      • DatasetProvider
      • dataset_definition()
    • dbldatagen.datasets.multi_table_telephony_provider module
      • MultiTableTelephonyProvider
  • Module contents
• dbldatagen.distributions package
  • Submodules
    • dbldatagen.distributions.beta module
      • Beta
    • dbldatagen.distributions.data_distribution module
      • DataDistribution
    • dbldatagen.distributions.exponential_distribution module
      • Exponential
    • dbldatagen.distributions.gamma module
      • Gamma
    • dbldatagen.distributions.normal_distribution module
      • Normal
  • Module contents

Submodules

• dbldatagen.column_generation_spec module
  • ColumnGenerationSpec
    • ColumnGenerationSpec.baseColumn
    • ColumnGenerationSpec.baseColumns
    • ColumnGenerationSpec.begin
    • ColumnGenerationSpec.datatype
    • ColumnGenerationSpec.end
    • ColumnGenerationSpec.expr
    • ColumnGenerationSpec.exprs
    • ColumnGenerationSpec.getNames()
    • ColumnGenerationSpec.getNamesAndTypes()
    • ColumnGenerationSpec.getOrElse()
    • ColumnGenerationSpec.getPlanEntry()
    • ColumnGenerationSpec.inferDatatype
    • ColumnGenerationSpec.interval
    • ColumnGenerationSpec.isFieldOmitted
    • ColumnGenerationSpec.isRandom
    • ColumnGenerationSpec.isWeightedValuesColumn
    • ColumnGenerationSpec.keys()
    • ColumnGenerationSpec.makeGenerationExpressions()
    • ColumnGenerationSpec.max
    • ColumnGenerationSpec.min
    • ColumnGenerationSpec.numColumns
    • ColumnGenerationSpec.numFeatures
    • ColumnGenerationSpec.prefix
    • ColumnGenerationSpec.randomSeed
    • ColumnGenerationSpec.setBaseColumnDatatypes()
    • ColumnGenerationSpec.specOptions
    • ColumnGenerationSpec.step
    • ColumnGenerationSpec.structType()
    • ColumnGenerationSpec.suffix
    • ColumnGenerationSpec.textGenerator
    • ColumnGenerationSpec.text_separator
• dbldatagen.column_spec_options module
  • ColumnSpecOptions
    • ColumnSpecOptions.checkBoolOption()
    • ColumnSpecOptions.checkExclusiveOptions()
    • ColumnSpecOptions.checkOptionValues()
    • ColumnSpecOptions.checkValidColumnProperties()
    • ColumnSpecOptions.getOrElse()
    • ColumnSpecOptions.options
• dbldatagen.data_analyzer module
  • DataAnalyzer
    • DataAnalyzer.scriptDataGeneratorFromData()
    • DataAnalyzer.scriptDataGeneratorFromSchema()
    • DataAnalyzer.summarize()
    • DataAnalyzer.summarizeToDF()
• dbldatagen.data_generator module
  • DataGenerator
    • DataGenerator.build()
    • DataGenerator.build_order
    • DataGenerator.clone()
    • DataGenerator.computeBuildPlan()
    • DataGenerator.describe()
    • DataGenerator.explain()
    • DataGenerator.flatten()
    • DataGenerator.generateName()
    • DataGenerator.getColumnSpec()
    • DataGenerator.getColumnType()
    • DataGenerator.getInferredColumnNames()
    • DataGenerator.getOutputColumnNames()
    • DataGenerator.getOutputColumnNamesAndTypes()
    • DataGenerator.hasColumnSpec()
    • DataGenerator.inferredSchema
    • DataGenerator.isFieldExplicitlyDefined()
    • DataGenerator.option()
    • DataGenerator.options()
    • DataGenerator.random
    • DataGenerator.randomSeed
    • DataGenerator.reset()
    • DataGenerator.rowCount
    • DataGenerator.schema
    • DataGenerator.schemaFields
    • DataGenerator.scriptMerge()
    • DataGenerator.scriptTable()
    • DataGenerator.seedColumnName
    • DataGenerator.setRowCount()
    • DataGenerator.useSeed()
    • DataGenerator.use_seed()
    • DataGenerator.withColumn()
    • DataGenerator.withColumnSpec()
    • DataGenerator.withColumnSpecs()
    • DataGenerator.withConstraint()
    • DataGenerator.withConstraints()
    • DataGenerator.withIdOutput()
    • DataGenerator.withRowCount()
    • DataGenerator.withSchema()
    • DataGenerator.withSqlConstraint()
    • DataGenerator.withStructColumn()
• dbldatagen.datagen_constants module
• dbldatagen.datarange module
  • DataRange
    • DataRange.adjustForColumnDatatype()
    • DataRange.getContinuousRange()
    • DataRange.getDiscreteRange()
    • DataRange.getScale()
    • DataRange.isEmpty()
    • DataRange.isFullyPopulated()
    • DataRange.max
    • DataRange.min
• dbldatagen.datasets_object module
  • Datasets
    • Datasets.NavigatorNode
      • Datasets.NavigatorNode.addEntry()
      • Datasets.NavigatorNode.find()
      • Datasets.NavigatorNode.isFinal()
    • Datasets.describe()
    • Datasets.get()
    • Datasets.getAssociatedDataset()
    • Datasets.getCombinedDataset()
    • Datasets.getEnrichedDataset()
    • Datasets.getProviderDefinitions()
    • Datasets.getSummaryDataset()
    • Datasets.getSupportingDataset()
    • Datasets.list()
• dbldatagen.daterange module
  • DateRange
    • DateRange.DEFAULT_DATE_FORMAT
    • DateRange.DEFAULT_END_DATE
    • DateRange.DEFAULT_END_DATE_TIMESTAMP
    • DateRange.DEFAULT_END_TIMESTAMP
    • DateRange.DEFAULT_START_DATE
    • DateRange.DEFAULT_START_DATE_TIMESTAMP
    • DateRange.DEFAULT_START_TIMESTAMP
    • DateRange.DEFAULT_UTC_TS_FORMAT
    • DateRange.adjustForColumnDatatype()
    • DateRange.computeDateRange()
    • DateRange.computeTimestampIntervals()
    • DateRange.computeTimestampRange()
    • DateRange.getContinuousRange()
    • DateRange.getDiscreteRange()
    • DateRange.getScale()
    • DateRange.isEmpty()
    • DateRange.isFullyPopulated()
    • DateRange.parseInterval()
• dbldatagen.function_builder module
  • ColumnGeneratorBuilder
    • ColumnGeneratorBuilder.mkExprChoicesFn()
• dbldatagen.html_utils module
  • HtmlUtils
    • HtmlUtils.formatCodeAsHtml()
    • HtmlUtils.formatTextAsHtml()
• dbldatagen.nrange module
  • NRange
    • NRange.adjustForColumnDatatype()
    • NRange.getContinuousRange()
    • NRange.getDiscreteRange()
    • NRange.getScale()
    • NRange.isEmpty()
    • NRange.isFullyPopulated()
• dbldatagen.schema_parser module
  • SchemaParser
    • SchemaParser.columnTypeFromString()
    • SchemaParser.columnsReferencesFromSQLString()
    • SchemaParser.getTypeDefinitionParser()
    • SchemaParser.parseCreateTable()
• dbldatagen.spark_singleton module
  • SparkSingleton
    • SparkSingleton.getInstance()
    • SparkSingleton.getLocalInstance()
• dbldatagen.text_generator_plugins module
  • FakerTextFactory
  • PyfuncText
    • PyfuncText.pandasGenerateText()
  • PyfuncTextFactory
    • PyfuncTextFactory.withInit()
    • PyfuncTextFactory.withInitPerBatch()
    • PyfuncTextFactory.withRootProperty()
  • fakerText()
• dbldatagen.text_generators module
  • ILText
    • ILText.classicGenerateText()
    • ILText.generateText()
    • ILText.pandasGenerateText()
  • TemplateGenerator
    • TemplateGenerator.classicGenerateText()
    • TemplateGenerator.pandasGenerateText()
    • TemplateGenerator.templates
  • TextGenerator
    • TextGenerator.compactNumpyTypeForValues()
    • TextGenerator.getAsTupleOrElse()
    • TextGenerator.getNPRandomGenerator()
    • TextGenerator.randomSeed
    • TextGenerator.withRandomSeed()
• dbldatagen.utils module
  • DataGenError
  • coalesce_values()
  • deprecated()
  • ensure()
  • json_value_from_path()
  • mkBoundsList()
  • parse_time_interval()
  • split_list_matching_condition()
  • strip_margins()
  • system_time_millis()
  • topologicalSort()

Module contents

This module defines the package contents for the test data generator library

The main entry point for any test data generation activities is the DataGenerator class.

Most of the other classes are used for internal purposes only