Skip to content

fix(ci): fix baseline for semver checking#1475

Merged
hoolioh merged 1 commit intomainfrom
julio/versioning/fix-semver-baseline
Jan 27, 2026
Merged

fix(ci): fix baseline for semver checking#1475
hoolioh merged 1 commit intomainfrom
julio/versioning/fix-semver-baseline

Conversation

@hoolioh
Copy link
Copy Markdown
Contributor

@hoolioh hoolioh commented Jan 26, 2026 •
edited
Loading

What does this PR do?

Fix the baseline name for cargo-semver-check

@hoolioh hoolioh requested a review from a team as a code owner January 26, 2026 16:12
@hoolioh
Copy link
Copy Markdown
Contributor Author

hoolioh commented Jan 26, 2026

/merge

@gh-worker-devflow-routing-ef8351
Copy link
Copy Markdown

gh-worker-devflow-routing-ef8351 Bot commented Jan 26, 2026 •
edited
Loading

View all feedbacks in Devflow UI.

2026-01-26 16:14:50 UTC ℹ️ Start processing command /merge

2026-01-26 16:15:27 UTC ℹ️ MergeQueue: waiting for PR to be ready

This pull request is not mergeable according to GitHub. Common reasons include pending required checks, missing approvals, or merge conflicts — but it could also be blocked by other repository rules or settings.
It will be added to the queue as soon as checks pass and/or get approvals. View in MergeQueue UI.
Note: if you pushed new commits since the last approval, you may need additional approval.
You can remove it from the waiting list with /remove command.

2026-01-26 20:16:15 UTC ⚠️ MergeQueue: This merge request was unqueued

devflow unqueued this merge request: It did not become mergeable within the expected time

@codecov-commenter
Copy link
Copy Markdown

codecov-commenter commented Jan 26, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.14%. Comparing base (679cb4a) to head (f0d7d9a).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1475      +/-   ##
==========================================
- Coverage   71.16%   71.14%   -0.03%     
==========================================
  Files         419      419              
  Lines       67179    67179              
==========================================
- Hits        47807    47792      -15     
- Misses      19372    19387      +15
Components Coverage Δ
libdd-crashtracker 61.39% <ø> (-0.02%) ⬇️
libdd-crashtracker-ffi 16.50% <ø> (ø)
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 86.28% <ø> (ø)
libdd-data-pipeline-ffi 78.57% <ø> (ø)
libdd-common 80.84% <ø> (ø)
libdd-common-ffi 74.19% <ø> (ø)
libdd-telemetry 59.82% <ø> (ø)
libdd-telemetry-ffi 21.17% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.60% <ø> (ø)
libdd-profiling 80.65% <ø> (ø)
libdd-profiling-ffi 62.46% <ø> (ø)
datadog-sidecar 34.94% <ø> (ø)
datdog-sidecar-ffi 10.25% <ø> (ø)
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 93.43% <ø> (ø)
libdd-trace-normalization 82.33% <ø> (ø)
libdd-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 61.18% <ø> (ø)
libdd-trace-utils 89.45% <ø> (ø)
datadog-tracer-flare 63.49% <ø> (ø)
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Jan 26, 2026 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2026-01-26 16:28:28

Comparing candidate commit f0d7d9a in PR branch julio/versioning/fix-semver-baseline with baseline commit 679cb4a in branch main.

Found 0 performance improvements and 1 performance regressions! Performance is the same for 56 metrics, 2 unstable metrics.

scenario:normalization/normalize_trace/test_trace

  • 🟥 execution_time [+64.975ns; +72.547ns] or [+25.534%; +28.510%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f0d7d9a 1769443917 julio/versioning/fix-semver-baseline
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.355µs 2.377µs ± 0.017µs 2.372µs ± 0.009µs 2.384µs 2.414µs 2.423µs 2.425µs 2.24% 1.086 0.266 0.72% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.374µs; 2.379µs] or [-0.099%; +0.099%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f0d7d9a 1769443917 julio/versioning/fix-semver-baseline
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.990µs 5.068µs ± 0.047µs 5.067µs ± 0.048µs 5.100µs 5.138µs 5.145µs 5.148µs 1.59% 0.042 -1.275 0.92% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.061µs; 5.074µs] or [-0.128%; +0.128%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f0d7d9a 1769443917 julio/versioning/fix-semver-baseline
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 535.290µs 536.917µs ± 1.399µs 536.504µs ± 0.683µs 537.534µs 539.132µs 541.566µs 546.807µs 1.92% 2.556 12.153 0.26% 0.099µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1828799.810op/s 1862496.768op/s ± 4820.100op/s 1863920.534op/s ± 2372.506op/s 1865735.577op/s 1867135.218op/s 1867649.725op/s 1868146.649op/s 0.23% -2.498 11.603 0.26% 340.833op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 381.178µs 381.854µs ± 0.337µs 381.852µs ± 0.182µs 382.006µs 382.343µs 382.722µs 384.180µs 0.61% 2.030 11.280 0.09% 0.024µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2602946.535op/s 2618806.984op/s ± 2308.161op/s 2618817.307op/s ± 1246.109op/s 2620294.816op/s 2622070.043op/s 2622774.055op/s 2623448.059op/s 0.18% -2.006 11.089 0.09% 163.212op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 189.412µs 189.960µs ± 0.221µs 189.945µs ± 0.122µs 190.082µs 190.358µs 190.583µs 190.691µs 0.39% 0.234 0.736 0.12% 0.016µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5244085.277op/s 5264271.157op/s ± 6135.408op/s 5264693.608op/s ± 3392.186op/s 5267685.012op/s 5274233.048op/s 5279149.150op/s 5279502.979op/s 0.28% -0.225 0.729 0.12% 433.839op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.467µs 36.598µs ± 0.049µs 36.598µs ± 0.032µs 36.629µs 36.685µs 36.706µs 36.724µs 0.34% 0.022 0.010 0.13% 0.003µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 27229984.942op/s 27323933.579op/s ± 36386.418op/s 27323794.660op/s ± 23830.323op/s 27347601.194op/s 27382359.817op/s 27411882.635op/s 27422422.050op/s 0.36% -0.014 0.011 0.13% 2572.908op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.885µs 46.011µs ± 0.104µs 45.996µs ± 0.031µs 46.033µs 46.109µs 46.179µs 47.263µs 2.75% 8.846 103.254 0.23% 0.007µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21158090.325op/s 21733891.456op/s ± 48180.756op/s 21740905.305op/s ± 14607.172op/s 21753502.388op/s 21774507.715op/s 21783771.121op/s 21793735.738op/s 0.24% -8.664 100.301 0.22% 3406.894op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [536.723µs; 537.111µs] or [-0.036%; +0.036%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1861828.748op/s; 1863164.787op/s] or [-0.036%; +0.036%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [381.807µs; 381.900µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2618487.095op/s; 2619126.873op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [189.929µs; 189.991µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5263420.849op/s; 5265121.466op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.591µs; 36.605µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27318890.771op/s; 27328976.386op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.997µs; 46.026µs] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21727214.066op/s; 21740568.845op/s] or [-0.031%; +0.031%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f0d7d9a 1769443917 julio/versioning/fix-semver-baseline
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.894µs 3.912µs ± 0.003µs 3.912µs ± 0.001µs 3.914µs 3.917µs 3.919µs 3.921µs 0.22% -0.907 8.122 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 255043698.684op/s 255603706.040op/s ± 182096.498op/s 255600063.904op/s ± 93042.899op/s 255708004.675op/s 255836486.316op/s 255963640.126op/s 256785888.591op/s 0.46% 0.927 8.245 0.07% 12876.167op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 77.079µs 77.618µs ± 0.331µs 77.621µs ± 0.237µs 77.853µs 78.190µs 78.398µs 78.631µs 1.30% 0.395 -0.530 0.43% 0.023µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12717551.463op/s 12883894.015op/s ± 54873.940op/s 12883173.287op/s ± 39419.047op/s 12922970.272op/s 12963595.514op/s 12969110.170op/s 12973720.572op/s 0.70% -0.378 -0.555 0.42% 3880.174op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 70.651µs 71.115µs ± 0.337µs 71.033µs ± 0.178µs 71.243µs 71.771µs 72.433µs 72.909µs 2.64% 1.735 5.326 0.47% 0.024µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13715690.468op/s 14061999.710op/s ± 66178.099op/s 14077898.431op/s ± 35177.972op/s 14100486.114op/s 14145472.390op/s 14150303.056op/s 14154116.850op/s 0.54% -1.675 4.990 0.47% 4679.498op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.891µs 3.913µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.919µs 3.920µs 3.923µs 0.28% -0.760 8.778 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254913693.222op/s 255583947.287op/s ± 213263.275op/s 255615902.368op/s ± 110964.442op/s 255709729.755op/s 255815954.977op/s 255922220.642op/s 256993938.782op/s 0.54% 0.786 8.941 0.08% 15079.991op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 67.442µs 67.887µs ± 0.309µs 67.826µs ± 0.220µs 68.064µs 68.499µs 68.671µs 68.971µs 1.69% 0.769 0.293 0.45% 0.022µs 1 200
credit_card/is_card_number/378282246310005 throughput 14498801.890op/s 14730632.527op/s ± 66847.354op/s 14743675.482op/s ± 47909.660op/s 14783065.650op/s 14817543.527op/s 14823733.559op/s 14827527.304op/s 0.57% -0.746 0.236 0.45% 4726.822op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 44.683µs 45.167µs ± 0.173µs 45.178µs ± 0.119µs 45.285µs 45.445µs 45.486µs 45.577µs 0.88% -0.223 -0.362 0.38% 0.012µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21940791.489op/s 22140451.165op/s ± 84669.186op/s 22134569.165op/s ± 58165.822op/s 22197529.971op/s 22292799.463op/s 22329155.879op/s 22380103.886op/s 1.11% 0.241 -0.350 0.38% 5987.016op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.027µs 6.038µs ± 0.014µs 6.035µs ± 0.002µs 6.038µs 6.067µs 6.109µs 6.131µs 1.59% 4.020 17.564 0.24% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 163118294.135op/s 165609817.381op/s ± 388248.080op/s 165708732.851op/s ± 66529.118op/s 165763562.039op/s 165837923.289op/s 165885369.291op/s 165908314.480op/s 0.12% -3.997 17.343 0.23% 27453.285op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.894µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.917µs 3.919µs 3.923µs 0.27% -0.947 8.339 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254902383.158op/s 255594153.548op/s ± 189060.989op/s 255592511.144op/s ± 122591.446op/s 255715365.988op/s 255846351.909op/s 255912573.723op/s 256826552.248op/s 0.48% 0.968 8.465 0.07% 13368.631op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.264µs 65.352µs ± 0.360µs 65.525µs ± 0.127µs 65.607µs 65.699µs 65.742µs 65.758µs 0.36% -1.210 0.453 0.55% 0.025µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15207238.884op/s 15302266.121op/s ± 84847.594op/s 15261316.399op/s ± 29616.734op/s 15356062.441op/s 15486079.704op/s 15535664.686op/s 15560772.087op/s 1.96% 1.226 0.505 0.55% 5999.631op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 52.945µs 53.033µs ± 0.045µs 53.023µs ± 0.034µs 53.068µs 53.111µs 53.151µs 53.162µs 0.26% 0.487 -0.377 0.08% 0.003µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18810340.512op/s 18856202.633op/s ± 15856.443op/s 18859828.566op/s ± 12068.115op/s 18868404.385op/s 18877485.014op/s 18882482.853op/s 18887524.790op/s 0.15% -0.484 -0.383 0.08% 1121.220op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.894µs 3.913µs ± 0.003µs 3.914µs ± 0.002µs 3.915µs 3.918µs 3.919µs 3.921µs 0.18% -1.191 6.346 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255063372.171op/s 255550496.303op/s ± 203269.166op/s 255523636.765op/s ± 138069.759op/s 255694619.948op/s 255847568.341op/s 255904040.450op/s 256832590.971op/s 0.51% 1.208 6.464 0.08% 14373.301op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 49.743µs 49.812µs ± 0.034µs 49.809µs ± 0.024µs 49.836µs 49.866µs 49.887µs 49.919µs 0.22% 0.400 -0.266 0.07% 0.002µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 20032392.678op/s 20075367.791op/s ± 13592.157op/s 20076662.888op/s ± 9796.118op/s 20084779.755op/s 20094636.038op/s 20100007.900op/s 20103475.891op/s 0.13% -0.396 -0.271 0.07% 961.111op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 44.696µs 45.195µs ± 0.171µs 45.203µs ± 0.132µs 45.328µs 45.455µs 45.503µs 45.515µs 0.69% -0.234 -0.617 0.38% 0.012µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21970572.299op/s 22126727.705op/s ± 84031.015op/s 22122509.332op/s ± 64656.743op/s 22194588.418op/s 22261979.022op/s 22319654.629op/s 22373601.247op/s 1.14% 0.249 -0.600 0.38% 5941.890op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.028µs 6.038µs ± 0.011µs 6.035µs ± 0.003µs 6.039µs 6.046µs 6.101µs 6.110µs 1.24% 4.985 27.989 0.18% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 163659331.792op/s 165628915.060op/s ± 289375.574op/s 165693007.759op/s ± 69952.732op/s 165750301.073op/s 165819306.207op/s 165873446.902op/s 165897384.708op/s 0.12% -4.958 27.752 0.17% 20461.943op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255578469.217op/s; 255628942.863op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [77.572µs; 77.664µs] or [-0.059%; +0.059%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12876289.014op/s; 12891499.015op/s] or [-0.059%; +0.059%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [71.068µs; 71.162µs] or [-0.066%; +0.066%] None None None
credit_card/is_card_number/ 378282246310005 throughput [14052828.062op/s; 14071171.358op/s] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.913µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/37828224631 throughput [255554391.048op/s; 255613503.526op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/378282246310005 execution_time [67.844µs; 67.930µs] or [-0.063%; +0.063%] None None None
credit_card/is_card_number/378282246310005 throughput [14721368.126op/s; 14739896.927op/s] or [-0.063%; +0.063%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.143µs; 45.191µs] or [-0.053%; +0.053%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [22128716.831op/s; 22152185.500op/s] or [-0.053%; +0.053%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.036µs; 6.040µs] or [-0.033%; +0.033%] None None None
credit_card/is_card_number/x371413321323331 throughput [165556009.931op/s; 165663624.830op/s] or [-0.032%; +0.032%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255567951.514op/s; 255620355.583op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.302µs; 65.402µs] or [-0.076%; +0.076%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15290507.061op/s; 15314025.182op/s] or [-0.077%; +0.077%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.027µs; 53.039µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18854005.082op/s; 18858400.183op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.913µs; 3.914µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255522325.152op/s; 255578667.455op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [49.808µs; 49.817µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [20073484.048op/s; 20077251.533op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.171µs; 45.219µs] or [-0.053%; +0.053%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [22115081.815op/s; 22138373.596op/s] or [-0.053%; +0.053%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.036µs; 6.039µs] or [-0.024%; +0.024%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165588810.389op/s; 165669019.732op/s] or [-0.024%; +0.024%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f0d7d9a 1769443917 julio/versioning/fix-semver-baseline
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 48.174ms 48.649ms ± 1.403ms 48.465ms ± 0.083ms 48.554ms 48.724ms 58.790ms 60.729ms 25.30% 7.922 61.707 2.88% 0.099ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [48.454ms; 48.843ms] or [-0.400%; +0.400%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f0d7d9a 1769443917 julio/versioning/fix-semver-baseline
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.696µs 34.260µs ± 0.957µs 33.844µs ± 0.079µs 33.933µs 36.245µs 36.302µs 38.488µs 13.72% 1.850 2.071 2.79% 0.068µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.128µs; 34.393µs] or [-0.387%; +0.387%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f0d7d9a 1769443917 julio/versioning/fix-semver-baseline
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.950µs 25.584µs ± 9.864µs 18.104µs ± 0.102µs 34.856µs 43.688µs 45.192µs 73.639µs 306.75% 1.104 1.371 38.46% 0.698µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.217µs; 26.951µs] or [-5.344%; +5.344%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f0d7d9a 1769443917 julio/versioning/fix-semver-baseline
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 205.996µs 206.633µs ± 0.348µs 206.558µs ± 0.185µs 206.768µs 207.276µs 207.641µs 208.224µs 0.81% 1.383 3.401 0.17% 0.025µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4802530.336op/s 4839522.321op/s ± 8133.603op/s 4841260.942op/s ± 4337.258op/s 4844894.630op/s 4849655.821op/s 4852969.455op/s 4854461.920op/s 0.27% -1.366 3.321 0.17% 575.133op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.536µs 18.607µs ± 0.036µs 18.603µs ± 0.020µs 18.627µs 18.674µs 18.720µs 18.734µs 0.70% 0.760 1.015 0.19% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 53379293.810op/s 53742837.081op/s ± 104447.422op/s 53753472.907op/s ± 56611.696op/s 53807643.149op/s 53896948.033op/s 53933523.130op/s 53949664.049op/s 0.36% -0.746 0.982 0.19% 7385.548op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.764µs 10.845µs ± 0.039µs 10.839µs ± 0.024µs 10.867µs 10.918µs 10.952µs 10.975µs 1.26% 0.774 0.639 0.36% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 91114842.260op/s 92205408.274op/s ± 331369.119op/s 92262779.963op/s ± 200070.946op/s 92436408.522op/s 92678730.521op/s 92797126.860op/s 92900158.569op/s 0.69% -0.752 0.595 0.36% 23431.335op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [206.584µs; 206.681µs] or [-0.023%; +0.023%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4838395.082op/s; 4840649.560op/s] or [-0.023%; +0.023%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.602µs; 18.612µs] or [-0.027%; +0.027%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53728361.672op/s; 53757312.489op/s] or [-0.027%; +0.027%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.840µs; 10.851µs] or [-0.050%; +0.050%] None None None
normalization/normalize_name/normalize_name/good throughput [92159483.701op/s; 92251332.847op/s] or [-0.050%; +0.050%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f0d7d9a 1769443917 julio/versioning/fix-semver-baseline
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 88.965µs 89.174µs ± 0.157µs 89.133µs ± 0.065µs 89.258µs 89.353µs 89.583µs 90.626µs 1.67% 4.685 37.461 0.18% 0.011µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [89.152µs; 89.196µs] or [-0.024%; +0.024%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f0d7d9a 1769443917 julio/versioning/fix-semver-baseline
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.085µs 145.750µs ± 1.769µs 145.500µs ± 0.493µs 145.964µs 147.547µs 151.925µs 162.495µs 11.68% 5.758 45.058 1.21% 0.125µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [145.504µs; 145.995µs] or [-0.168%; +0.168%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f0d7d9a 1769443917 julio/versioning/fix-semver-baseline
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 188.713ns 191.079ns ± 1.910ns 190.813ns ± 1.482ns 192.285ns 194.617ns 196.169ns 197.001ns 3.24% 0.805 0.192 1.00% 0.135ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [190.814ns; 191.344ns] or [-0.139%; +0.139%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f0d7d9a 1769443917 julio/versioning/fix-semver-baseline
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 162.188µs 163.103µs ± 0.391µs 163.022µs ± 0.149µs 163.212µs 163.611µs 164.534µs 166.084µs 1.88% 3.286 18.900 0.24% 0.028µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [163.049µs; 163.157µs] or [-0.033%; +0.033%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f0d7d9a 1769443917 julio/versioning/fix-semver-baseline
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.582ms 14.651ms ± 0.032ms 14.646ms ± 0.017ms 14.664ms 14.707ms 14.761ms 14.779ms 0.91% 1.387 3.063 0.22% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.646ms; 14.655ms] or [-0.030%; +0.030%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f0d7d9a 1769443917 julio/versioning/fix-semver-baseline
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 3.903ms 3.917ms ± 0.008ms 3.916ms ± 0.003ms 3.919ms 3.923ms 3.929ms 4.007ms 2.32% 8.228 95.117 0.19% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [3.916ms; 3.918ms] or [-0.027%; +0.027%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f0d7d9a 1769443917 julio/versioning/fix-semver-baseline
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 527.068µs 527.651µs ± 0.378µs 527.607µs ± 0.197µs 527.806µs 528.219µs 528.902µs 530.008µs 0.46% 2.094 8.540 0.07% 0.027µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [527.598µs; 527.703µs] or [-0.010%; +0.010%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f0d7d9a 1769443917 julio/versioning/fix-semver-baseline
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.179µs 3.122µs ± 1.405µs 2.953µs ± 0.024µs 2.977µs 3.296µs 13.546µs 14.927µs 405.52% 7.519 57.100 44.88% 0.099µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.927µs; 3.316µs] or [-6.236%; +6.236%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f0d7d9a 1769443917 julio/versioning/fix-semver-baseline
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.618ms 10.645ms ± 0.013ms 10.645ms ± 0.009ms 10.653ms 10.665ms 10.683ms 10.708ms 0.59% 0.781 1.982 0.12% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.643ms; 10.647ms] or [-0.017%; +0.017%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f0d7d9a 1769443917 julio/versioning/fix-semver-baseline
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 12.747ms 13.125ms ± 0.076ms 13.131ms ± 0.034ms 13.163ms 13.214ms 13.323ms 13.386ms 1.95% -1.202 6.208 0.58% 0.005ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [13.114ms; 13.136ms] or [-0.081%; +0.081%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f0d7d9a 1769443917 julio/versioning/fix-semver-baseline
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 297.696ns 323.223ns ± 23.221ns 312.316ns ± 5.796ns 332.846ns 379.965ns 391.931ns 396.588ns 26.98% 1.576 1.716 7.17% 1.642ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [320.005ns; 326.441ns] or [-0.996%; +0.996%] None None None

Baseline

Omitted due to size.

@dd-octo-sts
Copy link
Copy Markdown
Contributor

dd-octo-sts Bot commented Jan 26, 2026

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 91.22 MB 91.22 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.38 MB 8.38 MB 0% (0 B) 👌
aarch64-apple-darwin
Artifact Baseline Commit Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a 62.36 MB 62.36 MB 0% (0 B) 👌
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib 9.41 MB 9.41 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 10.67 MB 10.67 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 105.54 MB 105.54 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 25.08 MB 25.08 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 73.49 KB 73.49 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 165.93 MB 165.92 MB -0% (-8.00 KB) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 827.93 MB 827.93 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 9.54 MB 9.54 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 73.49 KB 73.49 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 22.94 MB 22.94 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 47.90 MB 47.90 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 21.15 MB 21.15 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 74.62 KB 74.62 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 169.90 MB 169.88 MB -0% (-16.00 KB) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 814.90 MB 814.90 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 7.22 MB 7.22 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 74.62 KB 74.62 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 24.51 MB 24.51 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 43.62 MB 43.62 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 79.72 MB 79.72 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 9.85 MB 9.85 MB 0% (0 B) 👌
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 64.25 MB 64.25 MB 0% (0 B) 👌
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 10.44 MB 10.44 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 99.56 MB 99.56 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.41 MB 11.41 MB 0% (0 B) 👌

@hoolioh
Copy link
Copy Markdown
Contributor Author

hoolioh commented Jan 27, 2026

/merge

@gh-worker-devflow-routing-ef8351
Copy link
Copy Markdown

gh-worker-devflow-routing-ef8351 Bot commented Jan 27, 2026 •
edited
Loading

View all feedbacks in Devflow UI.

2026-01-27 08:53:28 UTC ℹ️ Start processing command /merge

2026-01-27 08:53:35 UTC ℹ️ MergeQueue: waiting for PR to be ready

This pull request is not mergeable according to GitHub. Common reasons include pending required checks, missing approvals, or merge conflicts — but it could also be blocked by other repository rules or settings.
It will be added to the queue as soon as checks pass and/or get approvals. View in MergeQueue UI.
Note: if you pushed new commits since the last approval, you may need additional approval.
You can remove it from the waiting list with /remove command.

2026-01-27 09:40:46 UTC ℹ️ MergeQueue: This merge request was already merged

This pull request was merged directly.

@hoolioh hoolioh merged commit f131aaa into main Jan 27, 2026
71 of 72 checks passed
@hoolioh hoolioh deleted the julio/versioning/fix-semver-baseline branch January 27, 2026 09:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@iunanua iunanua iunanua approved these changes

Assignees

No one assigned

Labels

mergequeue-status: done

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@hoolioh @codecov-commenter @iunanua