Welcome to the Daft blog
Join us as we explore innovative ways to handle multimodal datasets, optimize performance, and simplify your data workflows.
Engineering
August 26, 2025
How to Build Scalable, End-to-end Batch Inference Pipelines with Daft
From prompts to parquet: making batch inference simple, fast, and scalable.
Engineering
Video
August 13, 2025
Embedding Millions of Text Documents With Qwen3
Near-100% GPU Utilization
Engineering
August 6, 2025
Processing 300K Images Without OOM
A Streaming Solution
Engineering
April 22, 2025
We cloned over 15,000 repos to find the best developers
An adventure in AI and data engineering to analyze developers across Github
Engineering
March 18, 2025
DeepSeek smallpond, 3FS and data processing for AI
A closer look beyond the AI hype
Engineering
October 23, 2024
Introducing Daft-SQL
A SQL API enabling users to interact with their data in a new but familiar way!
Engineering
April 10, 2024
Reading Delta Lake with Daft
Announcing the launch of Daft's Delta Lake read support
Engineering
March 6, 2024
Adversarial file reading: from 10,000 small CSVs to massive Parquet files
How Daft optimizes the reading of real-world data which is often a mix of "many small files" and "few large files"
Engineering
July 12, 2023
Working with the Apache Parquet file format
Quick notes written from 200 meters down the Parquet rabbit hole
