Skip to content

chore(ci): use a shared rust cache#1638

Open
iunanua wants to merge 4 commits intomainfrom
igor/ci/shared-cache
Open

chore(ci): use a shared rust cache#1638
iunanua wants to merge 4 commits intomainfrom
igor/ci/shared-cache

Conversation

@iunanua
Copy link
Copy Markdown
Contributor

@iunanua iunanua commented Mar 2, 2026 •
edited
Loading

What does this PR do?

Use a shared rust cache for all the jobs

Motivation

At this time, the cache size limit is small, and each job uses its own cache, often reaching the limit by clearing old caches and making the cache inefficient.

@codecov-commenter
Copy link
Copy Markdown

codecov-commenter commented Mar 2, 2026 •
edited
Loading

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.04%. Comparing base (3f3efef) to head (c56aaba).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1638      +/-   ##
==========================================
+ Coverage   71.03%   71.04%   +0.01%     
==========================================
  Files         427      427              
  Lines       62962    62962              
==========================================
+ Hits        44722    44734      +12     
+ Misses      18240    18228      -12
Components Coverage Δ
libdd-crashtracker 62.45% <ø> (+0.03%) ⬆️
libdd-crashtracker-ffi 17.49% <ø> (ø)
libdd-alloc 98.77% <ø> (ø)
libdd-data-pipeline 88.02% <ø> (ø)
libdd-data-pipeline-ffi 75.72% <ø> (ø)
libdd-common 79.73% <ø> (ø)
libdd-common-ffi 73.40% <ø> (ø)
libdd-telemetry 62.48% <ø> (ø)
libdd-telemetry-ffi 16.75% <ø> (ø)
libdd-dogstatsd-client 82.64% <ø> (ø)
datadog-ipc 80.47% <ø> (+0.11%) ⬆️
libdd-profiling 81.60% <ø> (ø)
libdd-profiling-ffi 63.65% <ø> (ø)
datadog-sidecar 32.47% <ø> (ø)
datdog-sidecar-ffi 7.73% <ø> (ø)
spawn-worker 54.69% <ø> (ø)
libdd-tinybytes 93.16% <ø> (ø)
libdd-trace-normalization 81.71% <ø> (ø)
libdd-trace-obfuscation 94.69% <ø> (ø)
libdd-trace-protobuf 68.25% <ø> (ø)
libdd-trace-utils 89.08% <ø> (ø)
datadog-tracer-flare 88.95% <ø> (ø)
libdd-log 74.69% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Mar 2, 2026 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2026-03-10 09:12:10

Comparing candidate commit c56aaba in PR branch igor/ci/shared-cache with baseline commit 3f3efef in branch main.

Found 0 performance improvements and 2 performance regressions! Performance is the same for 56 metrics, 2 unstable metrics.

Explanation

This is an A/B test comparing a candidate commit's performance against that of a baseline commit. Performance changes are noted in the tables below as:

  • 🟩 = significantly better candidate vs. baseline
  • 🟥 = significantly worse candidate vs. baseline

We compute a confidence interval (CI) over the relative difference of means between metrics from the candidate and baseline commits, considering the baseline as the reference.

If the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD), the change is considered significant.

Feel free to reach out to #apm-benchmarking-platform on Slack if you have any questions.

More details about the CI and significant changes

You can imagine this CI as a range of values that is likely to contain the true difference of means between the candidate and baseline commits.

CIs of the difference of means are often centered around 0%, because often changes are not that big:

---------------------------------(------|---^--------)-------------------------------->
                              -0.6%    0%  0.3%     +1.2%
                                 |          |        |
         lower bound of the CI --'          |        |
sample mean (center of the CI) -------------'        |
         upper bound of the CI ----------------------'

As described above, a change is considered significant if the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD).

For instance, for an execution time metric, this confidence interval indicates a significantly worse performance:

----------------------------------------|---------|---(---------^---------)---------->
                                       0%        1%  1.3%      2.2%      3.1%
                                                  |   |         |         |
       significant impact threshold --------------'   |         |         |
                      lower bound of CI --------------'         |         |
       sample mean (center of the CI) --------------------------'         |
                      upper bound of CI ----------------------------------'

scenario:credit_card/is_card_number/ 378282246310005

  • 🟥 execution_time [+10.640µs; +10.817µs] or [+14.618%; +14.861%]
  • 🟥 throughput [-1778224.850op/s; -1750991.235op/s] or [-12.943%; -12.745%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c56aaba 1773132914 igor/ci/shared-cache
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 187.951ns 190.294ns ± 1.905ns 190.206ns ± 1.570ns 191.466ns 193.615ns 195.582ns 198.503ns 4.36% 0.876 0.902 1.00% 0.135ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [190.030ns; 190.558ns] or [-0.139%; +0.139%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c56aaba 1773132914 igor/ci/shared-cache
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 32.945µs 33.689µs ± 1.017µs 33.080µs ± 0.066µs 34.638µs 35.479µs 36.054µs 37.592µs 13.64% 1.242 0.271 3.01% 0.072µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.548µs; 33.830µs] or [-0.418%; +0.418%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c56aaba 1773132914 igor/ci/shared-cache
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.646ms 10.676ms ± 0.014ms 10.674ms ± 0.008ms 10.683ms 10.699ms 10.714ms 10.764ms 0.84% 1.855 7.778 0.14% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.674ms; 10.678ms] or [-0.019%; +0.019%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c56aaba 1773132914 igor/ci/shared-cache
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2598 execution_time 3.419ms 3.444ms ± 0.018ms 3.439ms ± 0.011ms 3.452ms 3.478ms 3.504ms 3.512ms 2.11% 1.339 1.775 0.53% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2598 execution_time [3.441ms; 3.446ms] or [-0.074%; +0.074%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c56aaba 1773132914 igor/ci/shared-cache
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 717.710µs 719.037µs ± 1.118µs 718.847µs ± 0.316µs 719.162µs 720.028µs 724.939µs 725.601µs 0.94% 4.131 19.516 0.16% 0.079µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [718.882µs; 719.191µs] or [-0.022%; +0.022%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c56aaba 1773132914 igor/ci/shared-cache
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 185.354µs 186.076µs ± 0.444µs 186.019µs ± 0.273µs 186.296µs 186.769µs 187.545µs 188.459µs 1.31% 1.598 5.032 0.24% 0.031µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5306198.847op/s 5374192.022op/s ± 12781.254op/s 5375788.819op/s ± 7887.269op/s 5383543.491op/s 5390110.566op/s 5392106.453op/s 5395074.567op/s 0.36% -1.567 4.855 0.24% 903.771op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.869µs 17.973µs ± 0.043µs 17.978µs ± 0.028µs 17.997µs 18.041µs 18.055µs 18.074µs 0.53% -0.224 -0.350 0.24% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 55327529.677op/s 55640832.639op/s ± 131662.036op/s 55622876.897op/s ± 86482.657op/s 55724537.229op/s 55876153.466op/s 55937551.870op/s 55962366.954op/s 0.61% 0.236 -0.346 0.24% 9309.912op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.304µs 10.368µs ± 0.038µs 10.360µs ± 0.022µs 10.389µs 10.438µs 10.468µs 10.493µs 1.28% 0.821 0.274 0.36% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 95304588.411op/s 96453779.221op/s ± 351810.443op/s 96526508.227op/s ± 205170.189op/s 96716936.273op/s 96925109.647op/s 96983883.706op/s 97046835.391op/s 0.54% -0.803 0.233 0.36% 24876.755op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [186.014µs; 186.137µs] or [-0.033%; +0.033%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5372420.663op/s; 5375963.381op/s] or [-0.033%; +0.033%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.967µs; 17.978µs] or [-0.033%; +0.033%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [55622585.547op/s; 55659079.730op/s] or [-0.033%; +0.033%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.363µs; 10.373µs] or [-0.051%; +0.051%] None None None
normalization/normalize_name/normalize_name/good throughput [96405021.677op/s; 96502536.764op/s] or [-0.051%; +0.051%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c56aaba 1773132914 igor/ci/shared-cache
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.303µs 3.201µs ± 1.432µs 2.963µs ± 0.030µs 3.001µs 3.623µs 14.045µs 14.854µs 401.26% 7.326 54.935 44.63% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.003µs; 3.400µs] or [-6.200%; +6.200%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c56aaba 1773132914 igor/ci/shared-cache
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 161.593µs 162.429µs ± 0.316µs 162.402µs ± 0.130µs 162.555µs 162.812µs 163.132µs 165.400µs 1.85% 4.145 37.980 0.19% 0.022µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [162.386µs; 162.473µs] or [-0.027%; +0.027%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c56aaba 1773132914 igor/ci/shared-cache
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.015ms 14.064ms ± 0.029ms 14.060ms ± 0.012ms 14.073ms 14.095ms 14.179ms 14.231ms 1.22% 2.917 12.617 0.20% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.060ms; 14.068ms] or [-0.028%; +0.028%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c56aaba 1773132914 igor/ci/shared-cache
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 534.172µs 535.385µs ± 1.064µs 535.116µs ± 0.341µs 535.506µs 537.447µs 538.295µs 544.300µs 1.72% 3.939 24.813 0.20% 0.075µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1837223.311op/s 1867821.099op/s ± 3683.274op/s 1868754.512op/s ± 1190.136op/s 1869773.776op/s 1870838.066op/s 1871513.650op/s 1872054.955op/s 0.18% -3.873 24.010 0.20% 260.447op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 380.496µs 381.639µs ± 0.346µs 381.608µs ± 0.237µs 381.888µs 382.194µs 382.384µs 382.746µs 0.30% 0.061 0.001 0.09% 0.024µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2612696.090op/s 2620279.533op/s ± 2373.213op/s 2620489.092op/s ± 1624.159op/s 2621925.149op/s 2623665.683op/s 2625249.501op/s 2628150.924op/s 0.29% -0.056 0.002 0.09% 167.811op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 189.766µs 190.257µs ± 0.181µs 190.253µs ± 0.120µs 190.374µs 190.544µs 190.779µs 190.968µs 0.38% 0.318 0.860 0.09% 0.013µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5236476.598op/s 5256056.636op/s ± 4993.516op/s 5256156.426op/s ± 3314.548op/s 5259271.996op/s 5263991.715op/s 5266695.461op/s 5269658.563op/s 0.26% -0.311 0.846 0.09% 353.095op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.359µs 37.527µs ± 0.057µs 37.528µs ± 0.042µs 37.567µs 37.621µs 37.664µs 37.675µs 0.39% 0.125 -0.157 0.15% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26542695.427op/s 26647322.808op/s ± 40350.011op/s 26647066.275op/s ± 29822.626op/s 26677321.717op/s 26708024.043op/s 26719546.360op/s 26767375.731op/s 0.45% -0.116 -0.156 0.15% 2853.177op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.806µs 45.913µs ± 0.061µs 45.898µs ± 0.043µs 45.965µs 46.017µs 46.067µs 46.096µs 0.43% 0.530 -0.465 0.13% 0.004µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21694066.580op/s 21780540.291op/s ± 29025.193op/s 21787416.473op/s ± 20661.078op/s 21803658.979op/s 21818932.274op/s 21826791.554op/s 21831282.277op/s 0.20% -0.525 -0.474 0.13% 2052.391op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [535.238µs; 535.533µs] or [-0.028%; +0.028%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1867310.633op/s; 1868331.566op/s] or [-0.027%; +0.027%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [381.591µs; 381.687µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2619950.628op/s; 2620608.437op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [190.232µs; 190.282µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5255364.583op/s; 5256748.690op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.519µs; 37.535µs] or [-0.021%; +0.021%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26641730.685op/s; 26652914.931op/s] or [-0.021%; +0.021%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.904µs; 45.921µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21776517.678op/s; 21784562.903op/s] or [-0.018%; +0.018%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c56aaba 1773132914 igor/ci/shared-cache
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 4.223ms 4.230ms ± 0.008ms 4.230ms ± 0.001ms 4.231ms 4.234ms 4.236ms 4.332ms 2.42% 12.093 159.315 0.18% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [4.229ms; 4.231ms] or [-0.025%; +0.025%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c56aaba 1773132914 igor/ci/shared-cache
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.776µs 26.049µs ± 9.239µs 18.862µs ± 0.354µs 34.487µs 42.791µs 44.150µs 65.981µs 249.81% 0.902 0.253 35.38% 0.653µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.769µs; 27.330µs] or [-4.916%; +4.916%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c56aaba 1773132914 igor/ci/shared-cache
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 85.934µs 86.183µs ± 0.193µs 86.155µs ± 0.044µs 86.205µs 86.307µs 86.543µs 88.362µs 2.56% 8.421 86.060 0.22% 0.014µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [86.157µs; 86.210µs] or [-0.031%; +0.031%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c56aaba 1773132914 igor/ci/shared-cache
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 240.614ns 249.615ns ± 11.445ns 244.858ns ± 2.064ns 250.007ns 280.692ns 282.875ns 286.485ns 17.00% 1.956 2.476 4.57% 0.809ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [248.028ns; 251.201ns] or [-0.635%; +0.635%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c56aaba 1773132914 igor/ci/shared-cache
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.337µs 2.405µs ± 0.017µs 2.404µs ± 0.007µs 2.415µs 2.428µs 2.435µs 2.436µs 1.31% -1.379 3.390 0.70% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.403µs; 2.407µs] or [-0.097%; +0.097%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c56aaba 1773132914 igor/ci/shared-cache
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.891µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.919µs 3.921µs 3.922µs 0.24% -1.083 10.360 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 254955269.115op/s 255544562.741op/s ± 210825.407op/s 255578723.071op/s ± 107200.191op/s 255665961.836op/s 255782121.989op/s 255893254.840op/s 257003289.361op/s 0.56% 1.111 10.559 0.08% 14907.608op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 79.046µs 79.739µs ± 0.438µs 79.677µs ± 0.277µs 79.960µs 80.544µs 81.158µs 81.715µs 2.56% 1.264 2.578 0.55% 0.031µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12237607.723op/s 12541358.081op/s ± 68462.098op/s 12550624.594op/s ± 43818.259op/s 12587074.372op/s 12624450.739op/s 12638454.551op/s 12650818.337op/s 0.80% -1.215 2.375 0.54% 4841.001op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 82.592µs 83.515µs ± 0.559µs 83.447µs ± 0.369µs 83.857µs 84.633µs 84.817µs 84.968µs 1.82% 0.543 -0.385 0.67% 0.040µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 11769150.467op/s 11974402.741op/s ± 79872.930op/s 11983677.642op/s ± 53151.469op/s 12031130.552op/s 12087744.393op/s 12094403.949op/s 12107761.499op/s 1.04% -0.517 -0.418 0.67% 5647.869op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.898µs 3.913µs ± 0.003µs 3.913µs ± 0.001µs 3.914µs 3.917µs 3.921µs 3.922µs 0.24% -0.327 6.158 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254965645.474op/s 255558066.789op/s ± 171032.949op/s 255577330.293op/s ± 93085.919op/s 255664293.179op/s 255781651.013op/s 255815359.981op/s 256574160.774op/s 0.39% 0.343 6.231 0.07% 12093.856op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 69.162µs 69.799µs ± 0.398µs 69.756µs ± 0.280µs 70.013µs 70.525µs 70.981µs 71.430µs 2.40% 0.889 0.964 0.57% 0.028µs 1 200
credit_card/is_card_number/378282246310005 throughput 13999702.312op/s 14327237.276op/s ± 81321.567op/s 14335770.730op/s ± 57817.849op/s 14395659.736op/s 14429578.038op/s 14445847.091op/s 14458885.256op/s 0.86% -0.853 0.839 0.57% 5750.303op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.159µs 52.231µs ± 0.036µs 52.227µs ± 0.023µs 52.251µs 52.300µs 52.329µs 52.373µs 0.28% 0.809 1.015 0.07% 0.003µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19093959.785op/s 19145708.097op/s ± 13304.646op/s 19147030.697op/s ± 8515.092op/s 19154844.849op/s 19163912.151op/s 19169925.092op/s 19171985.894op/s 0.13% -0.804 1.002 0.07% 940.781op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.030µs 6.040µs ± 0.013µs 6.038µs ± 0.003µs 6.040µs 6.072µs 6.101µs 6.117µs 1.31% 3.471 13.460 0.21% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 163491466.901op/s 165552904.770op/s ± 350640.551op/s 165626243.480op/s ± 83389.360op/s 165721353.622op/s 165803183.517op/s 165822910.119op/s 165850351.105op/s 0.14% -3.449 13.280 0.21% 24794.031op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.893µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.914µs 3.917µs 3.919µs 3.921µs 0.20% -1.401 11.784 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255066477.449op/s 255576355.878op/s ± 183697.049op/s 255584626.587op/s ± 106821.460op/s 255684177.631op/s 255802643.018op/s 255875517.112op/s 256891134.844op/s 0.51% 1.427 11.982 0.07% 12989.343op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.067µs 64.438µs ± 0.142µs 64.412µs ± 0.084µs 64.524µs 64.682µs 64.805µs 64.961µs 0.85% 0.585 0.788 0.22% 0.010µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15393889.672op/s 15518753.599op/s ± 34212.935op/s 15525010.320op/s ± 20390.347op/s 15540551.950op/s 15572318.180op/s 15584701.268op/s 15608606.586op/s 0.54% -0.569 0.757 0.22% 2419.220op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.803µs 58.087µs ± 0.173µs 58.041µs ± 0.096µs 58.168µs 58.390µs 58.661µs 58.790µs 1.29% 1.254 1.829 0.30% 0.012µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17009613.578op/s 17215847.108op/s ± 51229.841op/s 17229266.110op/s ± 28429.791op/s 17251480.644op/s 17275543.876op/s 17285260.272op/s 17300200.682op/s 0.41% -1.234 1.752 0.30% 3622.497op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.894µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.917µs 3.919µs 3.931µs 0.47% -0.068 15.165 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254371202.352op/s 255556420.687op/s ± 190951.792op/s 255564657.861op/s ± 103990.508op/s 255663950.902op/s 255762830.885op/s 255853093.824op/s 256820932.786op/s 0.49% 0.106 15.207 0.07% 13502.331op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.589µs 55.017µs ± 0.323µs 54.994µs ± 0.222µs 55.204µs 55.583µs 56.115µs 56.654µs 3.02% 1.331 3.187 0.59% 0.023µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17651107.054op/s 18176872.561op/s ± 105987.950op/s 18183723.749op/s ± 73684.849op/s 18262772.355op/s 18301850.450op/s 18310623.159op/s 18318618.551op/s 0.74% -1.272 2.877 0.58% 7494.480op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.140µs 52.215µs ± 0.036µs 52.210µs ± 0.018µs 52.232µs 52.286µs 52.311µs 52.364µs 0.30% 0.797 1.425 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19097015.524op/s 19151675.760op/s ± 13048.314op/s 19153453.279op/s ± 6625.934op/s 19158870.216op/s 19172216.296op/s 19176230.872op/s 19179238.474op/s 0.13% -0.791 1.410 0.07% 922.655op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.029µs 6.038µs ± 0.009µs 6.036µs ± 0.002µs 6.038µs 6.051µs 6.074µs 6.078µs 0.70% 3.171 10.389 0.14% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 164539486.547op/s 165631349.198op/s ± 235445.991op/s 165685311.997op/s ± 61320.818op/s 165743893.133op/s 165816087.844op/s 165853643.830op/s 165858826.412op/s 0.10% -3.161 10.334 0.14% 16648.546op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.913µs; 3.914µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ throughput [255515344.367op/s; 255573781.115op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [79.678µs; 79.799µs] or [-0.076%; +0.076%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12531869.892op/s; 12550846.269op/s] or [-0.076%; +0.076%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [83.438µs; 83.593µs] or [-0.093%; +0.093%] None None None
credit_card/is_card_number/ 378282246310005 throughput [11963333.121op/s; 11985472.361op/s] or [-0.092%; +0.092%] None None None
credit_card/is_card_number/37828224631 execution_time [3.913µs; 3.913µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255534363.267op/s; 255581770.310op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [69.744µs; 69.855µs] or [-0.079%; +0.079%] None None None
credit_card/is_card_number/378282246310005 throughput [14315966.889op/s; 14338507.663op/s] or [-0.079%; +0.079%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.226µs; 52.236µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19143864.201op/s; 19147551.993op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.039µs; 6.042µs] or [-0.030%; +0.030%] None None None
credit_card/is_card_number/x371413321323331 throughput [165504309.362op/s; 165601500.178op/s] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255550897.234op/s; 255601814.522op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.419µs; 64.458µs] or [-0.031%; +0.031%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15514012.015op/s; 15523495.183op/s] or [-0.031%; +0.031%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.062µs; 58.111µs] or [-0.041%; +0.041%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17208747.144op/s; 17222947.071op/s] or [-0.041%; +0.041%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.913µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255529956.606op/s; 255582884.769op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.972µs; 55.062µs] or [-0.081%; +0.081%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18162183.651op/s; 18191561.472op/s] or [-0.081%; +0.081%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.210µs; 52.220µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19149867.389op/s; 19153484.131op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.036µs; 6.039µs] or [-0.020%; +0.020%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165598718.648op/s; 165663979.748op/s] or [-0.020%; +0.020%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c56aaba 1773132914 igor/ci/shared-cache
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.915µs 4.988µs ± 0.047µs 4.992µs ± 0.053µs 5.014µs 5.061µs 5.064µs 5.066µs 1.50% 0.078 -1.188 0.95% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [4.982µs; 4.995µs] or [-0.132%; +0.132%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c56aaba 1773132914 igor/ci/shared-cache
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 143.881µs 146.179µs ± 1.639µs 145.947µs ± 0.511µs 146.459µs 148.008µs 152.503µs 162.001µs 11.00% 5.678 46.316 1.12% 0.116µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [145.952µs; 146.406µs] or [-0.155%; +0.155%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c56aaba 1773132914 igor/ci/shared-cache
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 48.194ms 48.599ms ± 1.018ms 48.452ms ± 0.058ms 48.509ms 48.747ms 54.834ms 57.493ms 18.66% 7.798 61.855 2.09% 0.072ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [48.458ms; 48.740ms] or [-0.290%; +0.290%] None None None

Baseline

Omitted due to size.

@dd-octo-sts
Copy link
Copy Markdown
Contributor

dd-octo-sts bot commented Mar 2, 2026 •
edited
Loading

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.63 MB 8.63 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 100.28 MB 100.28 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.21 MB 11.21 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 116.94 MB 116.94 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 27.16 MB 27.16 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 76.26 KB 76.26 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 186.01 MB 186.03 MB +.01% (+24.00 KB) 🔍
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 917.14 MB 917.14 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 9.93 MB 9.93 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 76.26 KB 76.26 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 24.77 MB 24.77 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 51.43 MB 51.43 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 22.97 MB 22.97 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 77.44 KB 77.44 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 190.23 MB 190.25 MB +0% (+16.00 KB) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 900.80 MB 900.80 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 7.53 MB 7.53 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 77.44 KB 77.44 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 26.51 MB 26.51 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 47.05 MB 47.05 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 87.50 MB 87.50 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 10.21 MB 10.21 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 109.81 MB 109.81 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.95 MB 11.95 MB 0% (0 B) 👌

@iunanua iunanua force-pushed the igor/ci/shared-cache branch from 07d2311 to 9af709c Compare March 3, 2026 15:49
hoolioh
hoolioh approved these changes Mar 3, 2026
View reviewed changes
@iunanua iunanua marked this pull request as ready for review March 3, 2026 16:13
@iunanua iunanua requested a review from a team as a code owner March 3, 2026 16:13
ekump
ekump reviewed Mar 4, 2026
View reviewed changes
@iunanua iunanua mentioned this pull request Mar 10, 2026
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@ekump ekump ekump left review comments

@hoolioh hoolioh hoolioh approved these changes

Assignees

No one assigned

Labels

ci-build

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@iunanua @codecov-commenter @ekump @hoolioh