Skip to content

MemPostings: Use dolthub SwissMap for label values/postings map#13644

Closed
aknuds1 wants to merge 1 commit intoprometheus:mainfrom
aknuds1:arve/mempostings-dolthub-swissmap
Closed

MemPostings: Use dolthub SwissMap for label values/postings map#13644
aknuds1 wants to merge 1 commit intoprometheus:mainfrom
aknuds1:arve/mempostings-dolthub-swissmap

Conversation

@aknuds1
Copy link
Copy Markdown
Contributor

@aknuds1 aknuds1 commented Feb 26, 2024

Test of dolthub SwissMap instead of standard map in tsdb/index.MemPostings, for performance. Requested by @bboreham for prombench-ing, so we can see if there's any real difference.

Confer corresponding PR for CockroachDB implementation.

@bboreham
Copy link
Copy Markdown
Member

/prombench main

@prombot
Copy link
Copy Markdown
Contributor

prombot commented Feb 26, 2024

⏱️ Welcome to Prometheus Benchmarking Tool. ⏱️

Compared versions: PR-13644 and main

After successful deployment, the benchmarking results can be viewed at:

Other Commands:
To stop benchmark: /prombench cancel
To restart benchmark: /prombench restart main

@bboreham
Copy link
Copy Markdown
Member

No material difference observed.

image

@aknuds1
Copy link
Copy Markdown
Contributor Author

aknuds1 commented Feb 26, 2024

@bboreham isn't there a noticeable difference Avg HTTP request latency (especially /api/v1/query_range)?

Also HTTP request/s for the same endpoint (/api/v1/query_range).

@bboreham
Copy link
Copy Markdown
Member

Yeah if you can explain why the endpoint varies when the time to evaluate doesn't.
The test is explicitly designed to send requests at the same rate.

@aknuds1 aknuds1 force-pushed the arve/mempostings-dolthub-swissmap branch from c2ba4c5 to c69ed1a Compare February 26, 2024 15:59
@bboreham
Copy link
Copy Markdown
Member

The difference in http latency measurement has disappeared.

@bboreham
Copy link
Copy Markdown
Member

/prombench cancel

1 similar comment
@bboreham
Copy link
Copy Markdown
Member

/prombench cancel

@prombot
Copy link
Copy Markdown
Contributor

prombot commented Feb 29, 2024

Benchmark cancel is in progress.

1 similar comment
@prombot
Copy link
Copy Markdown
Contributor

prombot commented Feb 29, 2024

Benchmark cancel is in progress.

@aknuds1
Copy link
Copy Markdown
Contributor Author

aknuds1 commented Mar 4, 2024

Closing since outlived its usefulness.

@aknuds1 aknuds1 closed this Mar 4, 2024
@aknuds1 aknuds1 deleted the arve/mempostings-dolthub-swissmap branch March 4, 2024 16:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants