Skip to content

Conversation

@fanquake
Copy link
Member

@fanquake fanquake commented Sep 17, 2025

Now that we've migrated to the new CI setup, and runtimes are looking decent, we could re-add some of the nightly/jobs runs in other repos, back to the main CI. This also came up in #33201 (comment).

@DrahtBot DrahtBot added the Tests label Sep 17, 2025
@DrahtBot
Copy link
Contributor

DrahtBot commented Sep 17, 2025

The following sections might be updated with supplementary metadata relevant to reviewers and maintainers.

Code Coverage & Benchmarks

For details see: https://corecheck.dev/bitcoin/bitcoin/pulls/33411.

Reviews

See the guideline for information on the review process.

Type Reviewers
Concept ACK willcl-ark

If your review is incorrectly listed, please react with 👎 to this comment and the bot will ignore it on the next update.

Conflicts

No conflicts as of last run.

@fanquake fanquake marked this pull request as draft September 17, 2025 09:26
@fanquake fanquake marked this pull request as ready for review September 17, 2025 09:28
@fanquake fanquake marked this pull request as draft September 17, 2025 09:32
@fanquake
Copy link
Member Author

The runtime isn't too bad, and it's just blown out by wallet_miniscript.py, which is ~4 times slower than the next slowest running test (signet_miner.py):

tool_signet_miner.py                                   | ✓ Passed  | 536 s
wallet_miniscript.py                                   | ✓ Passed  | 2086 s

@fanquake
Copy link
Member Author

With wallet_miniscript skipped, this finishes faster than the ASAN job, and ~roughly the same time as msan & fuzzer.

@willcl-ark
Copy link
Member

Concept ACK to re-introducing this job.

Wondering whether it's worth adding an extra runner if we add a new lg-sized job? On the whole CI queue sizes/times have been reasonable I think since the migration, and we did reduce a few job sizes recently. But still might be worth considering.

The 16th seemed unusually active, most days top out around 20 min max queue time AFAIK, but for reference here's the previous 7 days:

image

@fanquake fanquake marked this pull request as ready for review September 18, 2025 09:36
@fanquake
Copy link
Member Author

Adjusted to remove the conflict with #31425 and add context to the final commit.

@maflcko
Copy link
Member

maflcko commented Sep 23, 2025

No objection, but are there any real issues that this task has found in the last years? The only ones I am aware of are false-positives around valgrind and questions around updating the task config itself for a newly added package. If those are the only reasons to add it, the reasoning seems circular and pull request authors having to deal with valgrind false positives directly in their pull requests may even be counter-productive? For example, https://github.com/bitcoin/bitcoin/pull/31282/files was open for 4 months, and #29635 is still open with no clear solution. I am not sure if it is beneficial to block or delay a perfectly good pull requests based on a false-positive red valgrind CI.

@maflcko
Copy link
Member

maflcko commented Oct 16, 2025

Again, this seems fine, and I don't want to raise an objection. However, the general question of how to deal with the false-positives (see my previous comment) here is still unanswered. IIUC, valgrind may not work under a given compiler (version). For example, currently it doesn't work under clang out of the box. There are workarounds needed, but they come with drawbacks:

  • Add a suppression, but if this one is too broad, it decreases the value of running valgrind
  • Use -O1, but valgrind is already slow, and this will make it even slower
  • Refactor the code somehow randomly, until it isn't hit, but that is tedious and unclear, because it isn't trivially actionable

Generally, I have the impression that the existing asan and msan task find all memory issues before valgrind could find them. If there was one, it would be good to know it.

@fanquake
Copy link
Member Author

Can leave it to *san for now.

@fanquake fanquake closed this Oct 21, 2025
@maflcko
Copy link
Member

maflcko commented Oct 21, 2025

Maybe we can add it to just run under the default branch (master) on merges? Brought up in the context of #33509 (comment), but i guess the same approach could be used for several tasks? Maybe a brainstorming issue?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants