← Library / Lakehouse & Databricks
Lakehouse & DatabricksAnimated

DuckDB — in-process analytics, no cluster required

SQL on Parquet, CSV, lake storage and DataFrames from inside your code: what DuckDB is for, and when you should keep the cluster.

The trade-off I'd flag

Match the engine to the data, not to the habit. Below a few hundred GB, a single machine with DuckDB is often faster than a cluster — and free.

← PreviousDatabricks Learning Guide (50 pages) Next →Agent Harness — the infrastructure layer your agents need