Skip to content

slow hypothesis tests are too slow #3010

Closed

Description

@d-v-b

see https://github.com/zarr-developers/zarr-python/actions/runs/14613337704/job/41002901719#step:7:296, this test was running for 20+ minutes and failed. Something has changed about the test itself or our deployment of test resources. Either way we should fix it.

Activity

  1. added
    help wantedIssue could use help from someone with familiarity on the topic
    on Apr 23, 2025
  2. TomAugspurger commented on Apr 25, 2025

    @TomAugspurger
    Contributor

    HypothesisWorks/hypothesis#4364 noted a performance regression in hypothesis. Not sure what version that was but IIRC it's fixed now.

    We might want to use something like pytest-timeout to limit the runtime of those tests regardless.

  3. dstansby commented on May 7, 2025

    @dstansby
    Contributor

    Currently running at > 30 mins and counting over at https://github.com/zarr-developers/zarr-python/actions/runs/14883916292/job/41798353654?pr=3041. Would be great if someone can think of a way to speed up the hypothesis tests.

  4. dcherian commented on May 7, 2025

    @dcherian
    Contributor

    I can take a look next week. One option is to run the stateful tests (which are the slowest one) only nightly.

  5. added 3 commits that reference this issue on Jun 12, 2025
    612e3ef
    248a32c
    9c6ae50
  6. added a commit that references this issue on Jun 13, 2025
    c972f7f
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    help wantedIssue could use help from someone with familiarity on the topic

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions