Skip to content

[DISCUSS] v4.0.0 #307

Closed
Closed

Activity

  1. alamb commented on Sep 27, 2026

    @alamb
    CollaboratorAuthor

    We are very close to getting TPCDS done

    I also have a PR out to fix #262

  2. kevinjqliu commented on Oct 2, 2026

    @kevinjqliu
    Collaborator

    We got the release process prepped and ready (#545, #546, #547). Both for the repo side publishing and the crates.io/pypi settings.

    Whenever we're ready, we can publish all 6 crates and both pypi cli. 🚀 🚀 🚀

  3. alamb commented on Oct 2, 2026

    @alamb
    CollaboratorAuthor

    Nice -- I have a few more PRs I would like to get in to simplify / speed up the tpcds data generators (removing the last vestiges of the Java per row overhead).

  4. alamb commented on Oct 3, 2026

    @alamb
    CollaboratorAuthor

    Ok, I think we now have all the core functionality done (TPC-DS and basic optimzations) I am sure there is more we could do but the most eggregious stuff is done

    It looks like maybe we just have some benchmarking to do

    And then maybe take one more pass through the docs.

  5. alamb commented on Oct 5, 2026

    @alamb
    CollaboratorAuthor

    I have been obsessing (and need to get done with this so I can move on to something else 😅 )

    I have a few doc PRs that I would like to get in

    In my opinion, the only thing after those that is left is to get some sort of performance chart that shows tpch and TPCDS generation speed on the tpcgen-cli README page https://github.com/datafusion-contrib/tpcgen-rs/tree/main/tpcgen-cli

    I also have a bunch of other PRs for cleaning up the code, but I don't think they are needed

  6. clflushopt commented on Oct 8, 2026

    @clflushopt
    Member

    Approved them all @alamb thanks to you and @kevinjqliu both for driving this to the finish line.

  7. alamb commented on Oct 8, 2026

    @alamb
    CollaboratorAuthor

    Ok, in my mind the only thing that we should have before release is a performance comparison / summary for TPC-DS. I think @kevinjqliu may have one (see #511 (comment))

  8. kevinjqliu commented on Oct 15, 2026

    @kevinjqliu
    Collaborator

    @alamb @clflushopt

    is there anything else yall think we should do before the v4 release? #591 is at its final stretch, I'll do a few audits of the repo and CLI to make sure there's nothing major we missed.

  9. alamb commented on Oct 15, 2026

    @alamb
    CollaboratorAuthor

    18. @alamb @clflushopt
    is there anything else yall think we should do before the v4 release? #591 is at its final stretch, I'll do a few audits of the repo and CLI to make sure there's nothing major we missed.

    I think we need to slap a performance graph on the readme from https://github.com/datafusion-contrib/tpcgen-rs/tree/main/tpcgen-cli

    There is enough data in #511 to do so, i think?

  10. kevinjqliu commented on Oct 15, 2026

    @kevinjqliu
    Collaborator

    Nice! I'll also take another look at 511 today.

  11. alamb commented on Oct 16, 2026

    @alamb
    CollaboratorAuthor

    Ok in my mind this is the last PR before 4.0.0 (it is basically technical marketing)

    A teaser image

    Image
  12. kevinjqliu commented on Oct 16, 2026

    @kevinjqliu
    Collaborator

    once these last PRs are in, we can do a test publish, the workspace version is currently set to 4.0.0-rc.1.

    If everything goes well with the RC, we can publish V4 🚀

  13. alamb commented on Oct 17, 2026

    @alamb
    CollaboratorAuthor

    I also filed a ticket to track a new release

    However I need to avoid getting sucked into that again -- I have spent a LOT of time on this over the last month that I didn't plan to :)

  14. kevinjqliu commented on Oct 17, 2026

    @kevinjqliu
    Collaborator

    yes same here. I think this is ready to go and is much much better than the alternative already (and for a long time 😄 )

    Lets get this out the door!

  15. kevinjqliu commented on Oct 17, 2026

    @kevinjqliu
    Collaborator

    There's 2 cleanup PRs I want to get in:

    Then we can release the V4 RC. The repo is already at v4.0.0-rc.1, we just need to follow RELEASE.md and run

    gh release create v4.0.0-rc.1 --target <commit-sha> --title v4.0.0-rc.1 --generate-notes --prerelease
    
  16. alamb commented on Oct 18, 2026

    @alamb
    CollaboratorAuthor

    There's 2 cleanup PRs I want to get in:

    Merged.

    I think we are ready to release 🤞

    @kevinjqliu would you like me to run the process? I would be more than happy for you to as well

  17. kevinjqliu commented on Oct 18, 2026

    @kevinjqliu
    Collaborator

    either way works for me. looks like you havent done it yet, so i'll do the v4.0.0-rc.1 release right now 😄

  18. kevinjqliu commented on Oct 18, 2026

    @kevinjqliu
    Collaborator

    Running this on latest main (4f19db7):

    # 1. Create the pre-release (this triggers both publish workflows)
    gh release create v4.0.0-rc.1 \
      --repo datafusion-contrib/tpcgen-rs \
      --target 4f19db75e7969aa7fc96e03456019a980025cce5 \
      --title v4.0.0-rc.1 \
      --generate-notes --notes-start-tag v3.0.0 \
      --prerelease
    
    # 2. Watch the publish workflows (crates.io and PyPI)
    gh run watch --repo datafusion-contrib/tpcgen-rs
    
    # 3. Verify
    cargo install tpcgen-cli --version 4.0.0-rc.1
    uvx [email protected] --version
    uvx [email protected] --version
    
  19. kevinjqliu commented on Oct 18, 2026

    @kevinjqliu
    Collaborator

    Create the v4.0.0-rc.1 release which triggered both crates.io and pypi publishing workflows

    All 6 crates have the new v4.0.0-rc.1 version

    And both pypi packages have the new 4.0.0rc1 version

    🎊 🔥 🚢 🚢 🚢 🚀 🚀

  20. kevinjqliu commented on Oct 18, 2026

    @kevinjqliu
    Collaborator

    im doing some testing now

  21. kevinjqliu commented on Oct 19, 2026

    @kevinjqliu
    Collaborator

    found a bug in RC, see #641. I can release v4 after this fix. we already bumped the version in #631

  22. kevinjqliu commented on Oct 19, 2026

    @kevinjqliu
    Collaborator

    I believe we are ready for the v4.0 release 😄 (i dont think we need an rc2)

  23. kevinjqliu commented on Oct 19, 2026

    @kevinjqliu
    Collaborator

    Im going to publish using the latest main commit: 2a9b886

    gh release create v4.0.0 \
      --repo datafusion-contrib/tpcgen-rs \
      --target 2a9b8868aa1006aded4176abff45318a9e808ba4 \
      --title v4.0.0 \
      --generate-notes --notes-start-tag v3.0.0 \
      --draft
    

    https://github.com/datafusion-contrib/tpcgen-rs/releases/tag/untagged-50a03de7f5d41bc43885
    ->
    made some edits to the release note:

    This is now kicking off

    All 6 crates have the new v4.0.0 version

    And both pypi packages have the new 4.0.0 version

    I also started the process to add to homebrew: Homebrew/homebrew-core#319633

    EDIT: its now also available on homebrew: formulae.brew.sh/formula/tpcgen-cli

  24. kevinjqliu commented on Oct 19, 2026

    @kevinjqliu
    Collaborator

    🚀 🚀 🚀

    thanks a bunch @clflushopt @alamb, been really awesome working with y'all on this

  25. kevinjqliu commented on Oct 20, 2026

    @kevinjqliu
    Collaborator

    With homebrew added, we can call this done 😄

  26. alamb commented on Oct 20, 2026

    @alamb
    CollaboratorAuthor

    oh baby. now we need to have some marketing blitz

  27. kevinjqliu commented on Oct 20, 2026

    @kevinjqliu
    Collaborator

    27. oh baby. now we need to have some marketing blitz

    Let's do it!

    I opened #642 to track users of this project. Very surprising to see all the integrations already!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions