feat: change the benchmark report to json format#6818
Merged
zirain merged 7 commits intoenvoyproxy:mainfrom Dec 19, 2025
Merged
feat: change the benchmark report to json format#6818zirain merged 7 commits intoenvoyproxy:mainfrom
zirain merged 7 commits intoenvoyproxy:mainfrom
Conversation
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #6818 +/- ##
==========================================
- Coverage 72.33% 72.30% -0.04%
==========================================
Files 232 232
Lines 34114 34143 +29
==========================================
+ Hits 24678 24688 +10
- Misses 7661 7676 +15
- Partials 1775 1779 +4 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
Contributor
|
thanks, can you share a before / after |
zirain
force-pushed
the
bench/output-format
branch
from
271e9d6 to
9832c57
Compare
Contributor
|
This pull request has been automatically marked as stale because it has not had activity in the last 30 days. Please feel free to give a status update now, ping for review, when it's ready. Thank you for your contributions! |
arkodg
reviewed
Sep 24, 2025
| @@ -259,8 +259,8 @@ run-benchmark: install-benchmark-server prepare-ip-family ## Run benchmark tests | |||
| .PHONY: install-benchmark-server | |||
| install-benchmark-server: ## Install nighthawk server for benchmark test | |||
| @$(LOG_TARGET) | |||
| kubectl create namespace benchmark-test | |||
| kubectl -n benchmark-test create configmap test-server-config --from-file=test/benchmark/config/nighthawk-test-server-config.yaml -o yaml | |||
| kubectl create namespace benchmark-test --dry-run=client -o yaml | kubectl apply -f - | |||
Member
Author
There was a problem hiding this comment.
make this the target could be run multiple times.
arkodg
reviewed
Sep 24, 2025
Contributor
|
This pull request has been automatically marked as stale because it has not had activity in the last 30 days. Please feel free to give a status update now, ping for review, when it's ready. Thank you for your contributions! |
zirain
force-pushed
the
bench/output-format
branch
3 times, most recently
from
c1cf3ac to
a89dee8
Compare
zirain
force-pushed
the
bench/output-format
branch
5 times, most recently
from
366127d to
477ad88
Compare
Signed-off-by: zirain <[email protected]>
Signed-off-by: zirain <[email protected]>
Signed-off-by: zirain <[email protected]>
Signed-off-by: zirain <[email protected]>
Signed-off-by: zirain <[email protected]>
Signed-off-by: zirain <[email protected]>
zirain
force-pushed
the
bench/output-format
branch
from
c498990 to
4304320
Compare
Member
Author
|
before: |
Member
Author
arkodg
previously approved these changes
Dec 1, 2025
Signed-off-by: zirain <[email protected]>
Member
|
bump to get a final review and see if we can have this merged? 🙇♂️ |
arkodg
approved these changes
Dec 19, 2025
millermatt
pushed a commit
to millermatt/envoy-gateway
that referenced
this pull request
Jan 4, 2026
* benchmark json output Signed-off-by: zirain <[email protected]> * fix Signed-off-by: zirain <[email protected]> * fix Signed-off-by: zirain <[email protected]> * fix lint Signed-off-by: zirain <[email protected]> * fix Signed-off-by: zirain <[email protected]> * revert Signed-off-by: zirain <[email protected]> * fix seconds Signed-off-by: zirain <[email protected]> --------- Signed-off-by: zirain <[email protected]> Signed-off-by: Matt Miller <[email protected]>
rudrakhp
pushed a commit
to rudrakhp/gateway
that referenced
this pull request
Jan 8, 2026
* benchmark json output Signed-off-by: zirain <[email protected]> * fix Signed-off-by: zirain <[email protected]> * fix Signed-off-by: zirain <[email protected]> * fix lint Signed-off-by: zirain <[email protected]> * fix Signed-off-by: zirain <[email protected]> * revert Signed-off-by: zirain <[email protected]> * fix seconds Signed-off-by: zirain <[email protected]> --------- Signed-off-by: zirain <[email protected]> Signed-off-by: Rudrakh Panigrahi <[email protected]>
rudrakhp
added a commit
that referenced
this pull request
Jan 9, 2026
* fix: set observedGeneration in envoy patch policy (#7715) * fix: set observedGeneration in envoy patch policy Signed-off-by: kkk777-7 <[email protected]> * add release note Signed-off-by: kkk777-7 <[email protected]> --------- Signed-off-by: kkk777-7 <[email protected]> Signed-off-by: Rudrakh Panigrahi <[email protected]> * fix: add validation for request buffer limit (#7687) Signed-off-by: kkk777-7 <[email protected]> Signed-off-by: Rudrakh Panigrahi <[email protected]> * fix: nil pointer error when applying BackendTrafficPolicy to HTTPRoute with no backendRefs (#7765) * fix: checking route section name in backend traffic policy Signed-off-by: kkk777-7 <[email protected]> Signed-off-by: Rudrakh Panigrahi <[email protected]> * fix: setting externalTrafficPolicy for NodePort service type (#7823) Signed-off-by: Rudrakh Panigrahi <[email protected]> * fix: add indexing and processing for CRL references in ClientTrafficPolicies (#7829) Signed-off-by: Rudrakh Panigrahi <[email protected]> * feat: change the benchmark report to json format (#6818) * benchmark json output Signed-off-by: zirain <[email protected]> * fix Signed-off-by: zirain <[email protected]> * fix Signed-off-by: zirain <[email protected]> * fix lint Signed-off-by: zirain <[email protected]> * fix Signed-off-by: zirain <[email protected]> * revert Signed-off-by: zirain <[email protected]> * fix seconds Signed-off-by: zirain <[email protected]> --------- Signed-off-by: zirain <[email protected]> Signed-off-by: Rudrakh Panigrahi <[email protected]> * bechmark: scale up RPS to test data plane CPU performance (#7810) * Scale up RPS to test data plane CPU performance Signed-off-by: Huabing Zhao <[email protected]> * set duration to 120s Signed-off-by: Huabing Zhao <[email protected]> * discard invalid samples Signed-off-by: Huabing Zhao <[email protected]> * change scrape interval to 10s Signed-off-by: Huabing Zhao <[email protected]> * remove invalid cpu sampling data Signed-off-by: Huabing Zhao <[email protected]> * reduce duration to 60 Signed-off-by: Huabing Zhao <[email protected]> * fix benchmark end time Signed-off-by: Huabing Zhao <[email protected]> * fix data plane benchmark start time Signed-off-by: Huabing Zhao <[email protected]> * increase test time to get more samples Signed-off-by: Huabing Zhao <[email protected]> * adjust rps for each scale Signed-off-by: Huabing Zhao <[email protected]> * address comments Signed-off-by: Huabing(Robin) Zhao <[email protected]> --------- Signed-off-by: Huabing Zhao <[email protected]> Signed-off-by: Huabing(Robin) Zhao <[email protected]> Signed-off-by: Rudrakh Panigrahi <[email protected]> * fix: make port-forward worked for OTel collector on port 19001 (#7860) Signed-off-by: zirain <[email protected]> Signed-off-by: Rudrakh Panigrahi <[email protected]> * chore: fix goroutine leak (#7880) fix goroutine leak Signed-off-by: Huabing Zhao <[email protected]> Signed-off-by: Rudrakh Panigrahi <[email protected]> * fix gen-check Signed-off-by: Rudrakh Panigrahi <[email protected]> --------- Signed-off-by: kkk777-7 <[email protected]> Signed-off-by: Rudrakh Panigrahi <[email protected]> Signed-off-by: zirain <[email protected]> Signed-off-by: Huabing Zhao <[email protected]> Signed-off-by: Huabing(Robin) Zhao <[email protected]> Co-authored-by: Kota Kimura <[email protected]> Co-authored-by: zirain <[email protected]> Co-authored-by: Huabing (Robin) Zhao <[email protected]>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
5 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Change the benchmark report to json format for better post-process(e.g. show it on doc site).