You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Nice -- I have a few more PRs I would like to get in to simplify / speed up the tpcds data generators (removing the last vestiges of the Java per row overhead).
Ok, I think we now have all the core functionality done (TPC-DS and basic optimzations) I am sure there is more we could do but the most eggregious stuff is done
It looks like maybe we just have some benchmarking to do
Ok, in my mind the only thing that we should have before release is a performance comparison / summary for TPC-DS. I think @kevinjqliu may have one (see #511 (comment))
is there anything else yall think we should do before the v4 release? #591 is at its final stretch, I'll do a few audits of the repo and CLI to make sure there's nothing major we missed.
18. @alamb@clflushopt
is there anything else yall think we should do before the v4 release? #591 is at its final stretch, I'll do a few audits of the repo and CLI to make sure there's nothing major we missed.
Activity
docs: keep pypi install example with a note; align subcommand --version
alamb commentedon Sep 27, 2026
We are very close to getting TPCDS done
I also have a PR out to fix #262
docs: update tpcgen-cli docs and help text to use consistent binary n…
kevinjqliu commentedon Oct 2, 2026
We got the release process prepped and ready (#545, #546, #547). Both for the repo side publishing and the crates.io/pypi settings.
Whenever we're ready, we can publish all 6 crates and both pypi cli. 🚀 🚀 🚀
alamb commentedon Oct 2, 2026
Nice -- I have a few more PRs I would like to get in to simplify / speed up the tpcds data generators (removing the last vestiges of the Java per row overhead).
alamb commentedon Oct 3, 2026
Ok, I think we now have all the core functionality done (TPC-DS and basic optimzations) I am sure there is more we could do but the most eggregious stuff is done
It looks like maybe we just have some benchmarking to do
And then maybe take one more pass through the docs.
alamb commentedon Oct 5, 2026
I have been obsessing (and need to get done with this so I can move on to something else 😅 )
I have a few doc PRs that I would like to get in
tpcgen-cli#571In my opinion, the only thing after those that is left is to get some sort of performance chart that shows tpch and TPCDS generation speed on the tpcgen-cli README page https://github.com/datafusion-contrib/tpcgen-rs/tree/main/tpcgen-cli
I also have a bunch of other PRs for cleaning up the code, but I don't think they are needed
clflushopt commentedon Oct 8, 2026
Approved them all @alamb thanks to you and @kevinjqliu both for driving this to the finish line.
alamb commentedon Oct 8, 2026
Ok, in my mind the only thing that we should have before release is a performance comparison / summary for TPC-DS. I think @kevinjqliu may have one (see #511 (comment))
kevinjqliu commentedon Oct 15, 2026
@alamb @clflushopt
is there anything else yall think we should do before the v4 release? #591 is at its final stretch, I'll do a few audits of the repo and CLI to make sure there's nothing major we missed.
alamb commentedon Oct 15, 2026
I think we need to slap a performance graph on the readme from https://github.com/datafusion-contrib/tpcgen-rs/tree/main/tpcgen-cli
There is enough data in #511 to do so, i think?
kevinjqliu commentedon Oct 15, 2026
Nice! I'll also take another look at 511 today.
alamb commentedon Oct 16, 2026
Ok in my mind this is the last PR before 4.0.0 (it is basically technical marketing)
A teaser image
kevinjqliu commentedon Oct 16, 2026
once these last PRs are in, we can do a test publish, the workspace version is currently set to
4.0.0-rc.1.If everything goes well with the RC, we can publish V4 🚀
alamb commentedon Oct 17, 2026
I also filed a ticket to track a new release
However I need to avoid getting sucked into that again -- I have spent a LOT of time on this over the last month that I didn't plan to :)
kevinjqliu commentedon Oct 17, 2026
yes same here. I think this is ready to go and is much much better than the alternative already (and for a long time 😄 )
Lets get this out the door!
kevinjqliu commentedon Oct 17, 2026
There's 2 cleanup PRs I want to get in:
Then we can release the V4 RC. The repo is already at
v4.0.0-rc.1, we just need to follow RELEASE.md and runalamb commentedon Oct 18, 2026
Merged.
I think we are ready to release 🤞
@kevinjqliu would you like me to run the process? I would be more than happy for you to as well
kevinjqliu commentedon Oct 18, 2026
either way works for me. looks like you havent done it yet, so i'll do the
v4.0.0-rc.1release right now 😄kevinjqliu commentedon Oct 18, 2026
Running this on latest main (4f19db7):
kevinjqliu commentedon Oct 18, 2026
Create the
v4.0.0-rc.1release which triggered both crates.io and pypi publishing workflowsAll 6 crates have the new
v4.0.0-rc.1versionAnd both pypi packages have the new
4.0.0rc1version🎊 🔥 🚢 🚢 🚢 🚀 🚀
kevinjqliu commentedon Oct 18, 2026
im doing some testing now
kevinjqliu commentedon Oct 19, 2026
found a bug in RC, see #641. I can release v4 after this fix. we already bumped the version in #631
kevinjqliu commentedon Oct 19, 2026
I believe we are ready for the v4.0 release 😄 (i dont think we need an rc2)
kevinjqliu commentedon Oct 19, 2026
Im going to publish using the latest main commit: 2a9b886
https://github.com/datafusion-contrib/tpcgen-rs/releases/tag/untagged-50a03de7f5d41bc43885
->
made some edits to the release note:
This is now kicking off
All 6 crates have the new
v4.0.0versionAnd both pypi packages have the new
4.0.0versionI also started the process to add to homebrew: Homebrew/homebrew-core#319633
EDIT: its now also available on homebrew: formulae.brew.sh/formula/tpcgen-cli
kevinjqliu commentedon Oct 19, 2026
🚀 🚀 🚀
thanks a bunch @clflushopt @alamb, been really awesome working with y'all on this
kevinjqliu commentedon Oct 20, 2026
With homebrew added, we can call this done 😄
alamb commentedon Oct 20, 2026
oh baby. now we need to have some marketing blitz
kevinjqliu commentedon Oct 20, 2026
Let's do it!
I opened #642 to track users of this project. Very surprising to see all the integrations already!!