Daft (@daftengine) / X

Daft

665 posts

Daft

@daftengine

Distributed query engine providing simple and reliable data processing for any modality and scale (github.com/Eventual-Inc/D…)

daft.ai

Joined September 2022

Following

846

Followers

Pinned
Daft
@daftengine
Dec 11, 2025
.@SourcetableApp CTO @andrewgrosser shares his recommended tech stack for serious startups - a "wicked combination" that includes: - S3 + Cassandra for data - Daft for processing - Python, WASM, Ray Learn how they built the first AI-powered spreadsheet: daft.ai/blog/how-sourc…
00:00
1.5K
Daft
@daftengine
Jun 6, 2023
🚀Introducing... Daft!🚀 Daft is a Python dataframe library that works really well with multimodal data at terabyte-scale. To do this, we leverage the power of the @raydistributed framework! Getting started is as simple as: `pip install getdaft` 🧵1/2
7.4K
Daft
@daftengine
Aug 27, 2025
1/ It's now easier than ever to use @huggingface 🤗 Datasets at scale! Introducing Daft's native support for reading from and writing to Hugging Face.
18K
Daft
@daftengine
Sep 27, 2024
You heard it from Chris Riccomini! "Daft’s next-generation query engine is going after not only Spark-scale workloads, but DuckDB as well." Read his full article highlighting the industry trend moving towards flexible deployment: materializedview.io/p/the-new-era-…
2K
Daft
@daftengine
Jun 2, 2025
🚨 LAUNCH WEEK IS HERE 🚨 Watch Sammy, Co-Founder & CEO of Eventual, kick off an exciting week. We’ve rebranded. Rebuilt. Reimagined Daft. getdaft.io 🧠 Faster docs ⚡️ Cleaner UX 📦 Ready for AI workloads at scale Try out Daft today: pip install daft
00:00
5.6K
Daft
@daftengine
Sep 30, 2024
Daft has added support for writing to partitioned Iceberg & Delta tables in v0.3.4 👀 github.com/Eventual-Inc/D… (Besides Spark) We are now the only Python engine that can do this 🚀 Not to brag but Daft can bucket partition an Iceberg table WITHOUT the JVM! Try it out yourself 🤷‍♀️
Release v0.3.4 · Eventual-Inc/Daft
From github.com
1.4K
Daft
@daftengine
Dec 11, 2024
We just surpassed 2400 stars! The year may be coming to an end, but our team is still cranking out features left and right. Follow along and star our repo, help us get to 2500 stars 😎🌟
GitHub - Eventual-Inc/Daft: High-performance data engine for AI and multimodal workloads. Process...
From github.com
473
Daft
@daftengine
Jun 3, 2025
🔥 Fixed batch sizes are old news. DAY 2 OF DAFT #LAUNCHWEEK: Introducing Dynamic Execution for Multimodal Data Processing Daft is built to adapt in real time to multimodal workloads. Resize images, upload to S3, write to parquet – All optimized. All in one pipeline. ✨ Ditch
00:00
1.4K
Daft
@daftengine
Nov 14, 2024
See Daft-SQL in action! Check out this quick little demo of using Daft-SQL to search for the most haunted city in the US 👻 Watch the full deep dive from our contributor sync to learn about the different components for building a SQL engine: buff.ly/40rCDFw
00:00
627
Daft
@daftengine
Oct 1, 2024
Daft-SQL is our new SQL API that enables experts to interact with their data and leverage the language in a familiar way, whether you’re analyzing large datasets or performing simple queries. Sneak peak at our docs & stay tuned! buff.ly/3Y3CaHQ #Daft #DataFrame #SQL
GIF
1.2K
Daft
@daftengine
Oct 23, 2024
Daft-SQL is designed to let users interact with their data using traditional SQL queries within the Daft ecosystem without losing speed or efficiency, regardless if you’re analyzing large datasets or performing simple queries:
Eventual Blog
From eventual.ai
657
Daft
@daftengine
May 8, 2024
Daft v0.2.24: 🔬 Reading from @lancedb 🤝 Left/Right/Outer joins! 📊 Approximate percentile calculations 🔥 Adaptive Query Execution (experimental support!) 🦘 Dataframe Pivot/Unpivot 🏎️ 20% improvement in JSON reading with simd_json Learn more:
Release v0.2.24 · Eventual-Inc/Daft
From github.com
744
Daft
@daftengine
Aug 20, 2025
Processing 24 trillion tokens without a single crash. @essential_ai built Essential-Web v1.0 using Daft: • 23.6B LLM queries in 7 days • 90K AMD MI300X GPU hours • 32K sustained req/s per VM Scaling vLLM inference at web scale 👇
389
Daft
@daftengine
Nov 22, 2024
Show some love to Daft-SQL ❤️ In the last month, we’ve managed to complete 23 of 99 TPC-DS SQL queries to showcase that Daft can handle diverse queries 💪 Read our blog about Daft-SQL and how you can easily switch between the DataFrame API and SQL API: buff.ly/3ZgPxF7
765