Skip to content

Conversation

@maflcko
Copy link
Member

@maflcko maflcko commented May 17, 2019

When testing a combination of settings that affect the datadir (e.g. prune, blockfilter, ...) we may need a lot of datadirs.
Bump the maximum number of nodes proactively from 8 to 12, so that caches get populated with 12 node dirs, as opposed to 8.

Also, add an assert that the list of deterministic keys is exactly the number of max nodes (and not more than that.

Also, create the cache faster.

@DrahtBot DrahtBot added the Tests label May 17, 2019
@maflcko maflcko force-pushed the 1905-testMaxNodes branch from fa491b3 to fa47330 Compare May 17, 2019 17:21
@maflcko
Copy link
Member Author

maflcko commented May 17, 2019

Added a commit to create the cache in less than a second.

Can be tested with time ./test/functional/create_cache.py --cachedir="/tmp/test/cache_$(date)" --tmpdir=/tmp/test/temp

@DrahtBot
Copy link
Contributor

The following sections might be updated with supplementary metadata relevant to reviewers and maintainers.

Conflicts

Reviewers, this pull request conflicts with the following ones:

  • #15845 (wallet: Fast rescan with BIP157 block filters by MarcoFalke)

If you consider this pull request important, please also help to review the conflicting pull requests. Ideally, start with the one that should be merged first.

@laanwj
Copy link
Member

laanwj commented May 23, 2019

utACK fa47330
I think tests should create as few nodes as they can get away with, but if a test with 12 nodes is useful to get more coverage, then let's bump this.

@laanwj
Copy link
Member

laanwj commented May 23, 2019

When testing a combination of settings that affect the datadir (e.g. prune, blockfilter, ...) we may need a lot of datadirs.

Oh so these run in serial instead of in parallel? That makes more sense then.

maflcko pushed a commit to maflcko/bitcoin-core that referenced this pull request May 24, 2019
fa47330 test: Speed up cache creation (MarcoFalke)
fa6ad7a test: Bump MAX_NODES to 12 (MarcoFalke)

Pull request description:

  When testing a combination of settings that affect the datadir (e.g. prune, blockfilter, ...) we may need a lot of datadirs.
  Bump the maximum number of nodes proactively from 8 to 12, so that caches get populated with 12 node dirs, as opposed to 8.

  Also, add an assert that the list of deterministic keys is exactly the number of max nodes (and not more than that.

  Also, create the cache faster.

ACKs for commit fa4733:
  laanwj:
    utACK fa47330

Tree-SHA512: 9803c765ed52d344102f5a3bce57b05d88a7429dcb05ed66ed6c881fda8d87c2834d02d21b95fe9f39c0efe3b8527e13cf94f006588cde22e8c2cd50b2d517a6
@maflcko maflcko merged commit fa47330 into bitcoin:master May 24, 2019
@maflcko maflcko deleted the 1905-testMaxNodes branch May 24, 2019 11:05
sidhujag pushed a commit to syscoin/syscoin that referenced this pull request May 25, 2019
fa47330 test: Speed up cache creation (MarcoFalke)
fa6ad7a test: Bump MAX_NODES to 12 (MarcoFalke)

Pull request description:

  When testing a combination of settings that affect the datadir (e.g. prune, blockfilter, ...) we may need a lot of datadirs.
  Bump the maximum number of nodes proactively from 8 to 12, so that caches get populated with 12 node dirs, as opposed to 8.

  Also, add an assert that the list of deterministic keys is exactly the number of max nodes (and not more than that.

  Also, create the cache faster.

ACKs for commit fa4733:
  laanwj:
    utACK fa47330

Tree-SHA512: 9803c765ed52d344102f5a3bce57b05d88a7429dcb05ed66ed6c881fda8d87c2834d02d21b95fe9f39c0efe3b8527e13cf94f006588cde22e8c2cd50b2d517a6
deadalnix pushed a commit to Bitcoin-ABC/bitcoin-abc that referenced this pull request May 7, 2020
Summary:
test: Speed up cache creation

This is a backport of Core [[bitcoin/bitcoin#16042 | PR16042]]

Depends on D5984

Test Plan:
  ninja all check-all

Reviewers: #bitcoin_abc, Fabien

Reviewed By: #bitcoin_abc, Fabien

Subscribers: Fabien

Differential Revision: https://reviews.bitcoinabc.org/D5985
@bitcoin bitcoin locked as resolved and limited conversation to collaborators Feb 15, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants