🧀 BigCheese.ai

Social

Smallpond – A lightweight data processing framework built on DuckDB and 3FS

🧀

Smallpond is a lightweight data processing framework that utilizes DuckDB and 3FS for high-performance and scalable operations, capable of handling PB-scale datasets. It provides easy operations without requiring long-running services.

  • Built on DuckDB
  • Scales for PB data
  • No long services
  • MIT licensed
  • Benchmarked sort