Overture Maps Downloader
Overture Maps Downloader
OvertureClient fetches Overture Maps GeoParquet data for any bounding-box AOI and stages it into a Unity Catalog Volume. It covers all Overture themes — buildings, transportation, places, base, divisions, and more — filtered to your exact area of interest at download time.
- GeoBrix installed (wheel includes
databricks.labs.gbx.sample) - Unity Catalog Volume already exists at
/Volumes/{catalog}/{schema}/{volume}/... - The
overturemapsCLI is recommended for fast bbox pushdown (install viapip install overturemaps); the client falls back to distributed Spark reads from Overture's public GeoParquet if the CLI is absent
How It Works
The client follows a discover → download → read pattern that separates metadata inspection from data I/O:
-
discover(bbox, themes=None, release=None)— driver-side, metadata-only. Queries the Overture STAC catalog and returns a DataFrame (one row per intersecting GeoParquet asset) with columnstheme,type,href,asset_bbox,release. No data is downloaded at this step. -
download(assets_df, out_dir, *, bbox=None, table=None, ...)— distributed I/O. Routes to the fastest available path:- CLI path (preferred): when
bboxis provided and theoverturemapsCLI is installed, runsoverturemaps download --stac --bbox=...per(theme, type)pair — server-side pushdown, minimal data transfer. - Distributed Spark path: when assets resolve to cloud object-store paths (s3://, abfss://, etc.) or FUSE-mounted Volumes, reads GeoParquet directly with bbox struct predicate pushdown.
- HTTP fallback: whole-file download fanned out across Spark tasks for any other href scheme.
All paths are idempotent — existing valid files are skipped on re-runs.
- CLI path (preferred): when
-
read(source, theme=None, type=None, bbox=None)— loads staged GeoParquet back into a Spark DataFrame.sourcecan be a Volume directory, a metadata Delta table name, or the metadata DataFrame returned bydownload().
API Reference
OvertureClient
from databricks.labs.gbx.sample.overture import OvertureClient
client = OvertureClient(
release=None, # str or None — e.g. "2024-07-22". None → latest available.
)