Skip to content

Comments

refactor(ci): include drop in semantic benchmark#5245

Merged
Boshen merged 2 commits intomainfrom
08-26-refactor_ci_include_drop_in_semantic_benchmark
Aug 27, 2024
Merged

refactor(ci): include drop in semantic benchmark#5245
Boshen merged 2 commits intomainfrom
08-26-refactor_ci_include_drop_in_semantic_benchmark

Conversation

@overlookmotel
Copy link
Member

@overlookmotel overlookmotel commented Aug 26, 2024

Include dropping Semantic in semantic benchmark measure.

If you create a Semantic, you have to drop it, so the time it takes to drop is part of the cost of using this API, and we should be working to reduce it. Therefore I think it should be included in the benchmark.

It'll be interesting to see what effect a PR like #5232 which removes a bunch of Vecs from Semantic has on the drop time.

Copy link
Member Author

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @overlookmotel and the rest of your teammates on Graphite Graphite

@graphite-app
Copy link
Contributor

graphite-app bot commented Aug 26, 2024

Your org has enabled the Graphite merge queue for merging into main

Add the label “merge” to the PR and Graphite will automatically add it to the merge queue when it’s ready to merge. Or use the label “hotfix” to add to the merge queue as a hot fix.

You must have a Graphite account and log in to Graphite in order to use the merge queue. Sign up using this link.

@overlookmotel overlookmotel marked this pull request as ready for review August 26, 2024 20:02
@codspeed-hq
Copy link

codspeed-hq bot commented Aug 26, 2024

CodSpeed Performance Report

Merging #5245 will degrade performances by 5.2%

Comparing 08-26-refactor_ci_include_drop_in_semantic_benchmark (c284772) with main (9f772c9)

Summary

❌ 4 regressions
✅ 25 untouched benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Benchmarks breakdown

Benchmark main 08-26-refactor_ci_include_drop_in_semantic_benchmark Change
semantic[antd.js] 125.7 ms 132.6 ms -5.2%
semantic[cal.com.tsx] 46.1 ms 48.4 ms -4.58%
semantic[checker.ts] 75.3 ms 79.3 ms -5.1%
semantic[pdf.mjs] 20.7 ms 21.8 ms -4.85%

@Boshen Boshen merged commit 7c4f009 into main Aug 27, 2024
@Boshen Boshen deleted the 08-26-refactor_ci_include_drop_in_semantic_benchmark branch August 27, 2024 01:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants