Skip to content

ci: switch to ephemeral branches#1731

Merged
hoolioh merged 2 commits intomainfrom
julio/publishing/switch-to-ephemeral-release-branches
Mar 18, 2026
Merged

ci: switch to ephemeral branches#1731
hoolioh merged 2 commits intomainfrom
julio/publishing/switch-to-ephemeral-release-branches

Conversation

@hoolioh
Copy link
Copy Markdown
Contributor

@hoolioh hoolioh commented Mar 16, 2026 •
edited
Loading

What does this PR do?

Use ephemeral branches rather than a lon lived release branch.

Motivation

Having a long lived branch for releases lead to several problems with very little benefits.

@codecov-commenter
Copy link
Copy Markdown

codecov-commenter commented Mar 16, 2026 •
edited
Loading

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.49%. Comparing base (4dd532f) to head (78bc9f7).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1731      +/-   ##
==========================================
- Coverage   71.51%   71.49%   -0.02%     
==========================================
  Files         430      430              
  Lines       64075    64075              
==========================================
- Hits        45821    45811      -10     
- Misses      18254    18264      +10
Components Coverage Δ
libdd-crashtracker 63.98% <ø> (+0.06%) ⬆️
libdd-crashtracker-ffi 18.19% <ø> (ø)
libdd-alloc 98.77% <ø> (ø)
libdd-data-pipeline 87.92% <ø> (ø)
libdd-data-pipeline-ffi 74.85% <ø> (ø)
libdd-common 79.73% <ø> (ø)
libdd-common-ffi 73.40% <ø> (ø)
libdd-telemetry 62.48% <ø> (ø)
libdd-telemetry-ffi 16.75% <ø> (ø)
libdd-dogstatsd-client 82.64% <ø> (ø)
datadog-ipc 80.35% <ø> (-0.12%) ⬇️
libdd-profiling 81.60% <ø> (ø)
libdd-profiling-ffi 63.65% <ø> (ø)
datadog-sidecar 33.10% <ø> (ø)
datdog-sidecar-ffi 10.79% <ø> (ø)
spawn-worker 54.69% <ø> (ø)
libdd-tinybytes 93.16% <ø> (ø)
libdd-trace-normalization 81.71% <ø> (ø)
libdd-trace-obfuscation 91.80% <ø> (ø)
libdd-trace-protobuf 68.25% <ø> (ø)
libdd-trace-utils 88.95% <ø> (ø)
datadog-tracer-flare 90.46% <ø> (ø)
libdd-log 74.69% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Mar 16, 2026 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2026-03-18 08:36:13

Comparing candidate commit 78bc9f7 in PR branch julio/publishing/switch-to-ephemeral-release-branches with baseline commit 4dd532f in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 2 unstable metrics.

Explanation

This is an A/B test comparing a candidate commit's performance against that of a baseline commit. Performance changes are noted in the tables below as:

  • 🟩 = significantly better candidate vs. baseline
  • 🟥 = significantly worse candidate vs. baseline

We compute a confidence interval (CI) over the relative difference of means between metrics from the candidate and baseline commits, considering the baseline as the reference.

If the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD), the change is considered significant.

Feel free to reach out to #apm-benchmarking-platform on Slack if you have any questions.

More details about the CI and significant changes

You can imagine this CI as a range of values that is likely to contain the true difference of means between the candidate and baseline commits.

CIs of the difference of means are often centered around 0%, because often changes are not that big:

---------------------------------(------|---^--------)-------------------------------->
                              -0.6%    0%  0.3%     +1.2%
                                 |          |        |
         lower bound of the CI --'          |        |
sample mean (center of the CI) -------------'        |
         upper bound of the CI ----------------------'

As described above, a change is considered significant if the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD).

For instance, for an execution time metric, this confidence interval indicates a significantly worse performance:

----------------------------------------|---------|---(---------^---------)---------->
                                       0%        1%  1.3%      2.2%      3.1%
                                                  |   |         |         |
       significant impact threshold --------------'   |         |         |
                      lower bound of CI --------------'         |         |
       sample mean (center of the CI) --------------------------'         |
                      upper bound of CI ----------------------------------'

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 78bc9f7 1773821887 julio/publishing/switch-to-ephemeral-release-branches
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 12.938ms 12.972ms ± 0.016ms 12.971ms ± 0.009ms 12.979ms 12.997ms 13.011ms 13.064ms 0.72% 1.435 5.649 0.13% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [12.970ms; 12.974ms] or [-0.017%; +0.017%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 78bc9f7 1773821887 julio/publishing/switch-to-ephemeral-release-branches
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.350µs 2.406µs ± 0.016µs 2.406µs ± 0.007µs 2.414µs 2.434µs 2.445µs 2.449µs 1.80% -0.680 2.701 0.67% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.404µs; 2.408µs] or [-0.094%; +0.094%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 78bc9f7 1773821887 julio/publishing/switch-to-ephemeral-release-branches
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.033µs 5.094µs ± 0.040µs 5.090µs ± 0.035µs 5.129µs 5.154µs 5.159µs 5.189µs 1.94% 0.334 -1.286 0.78% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.088µs; 5.099µs] or [-0.108%; +0.108%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 78bc9f7 1773821887 julio/publishing/switch-to-ephemeral-release-branches
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_timestamped_x1000 execution_time 4.199ms 4.205ms ± 0.009ms 4.204ms ± 0.002ms 4.206ms 4.210ms 4.214ms 4.320ms 2.76% 11.692 151.534 0.21% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_timestamped_x1000 execution_time [4.203ms; 4.206ms] or [-0.029%; +0.029%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 78bc9f7 1773821887 julio/publishing/switch-to-ephemeral-release-branches
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 190.724ns 193.087ns ± 1.899ns 192.794ns ± 1.470ns 194.254ns 196.972ns 197.693ns 198.528ns 2.97% 0.720 -0.260 0.98% 0.134ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [192.824ns; 193.350ns] or [-0.136%; +0.136%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 78bc9f7 1773821887 julio/publishing/switch-to-ephemeral-release-branches
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 186.258µs 186.587µs ± 0.182µs 186.541µs ± 0.116µs 186.698µs 186.926µs 187.113µs 187.245µs 0.38% 0.901 0.857 0.10% 0.013µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5340587.275op/s 5359424.380op/s ± 5221.754op/s 5360742.093op/s ± 3326.639op/s 5363177.630op/s 5366243.719op/s 5367765.186op/s 5368904.113op/s 0.15% -0.895 0.840 0.10% 369.234op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.890µs 17.975µs ± 0.096µs 17.968µs ± 0.021µs 17.990µs 18.024µs 18.060µs 19.243µs 7.10% 11.738 153.260 0.53% 0.007µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 51967402.901op/s 55633946.974op/s ± 278716.470op/s 55655551.069op/s ± 63819.976op/s 55713155.907op/s 55813887.631op/s 55881811.686op/s 55895967.740op/s 0.43% -11.456 148.310 0.50% 19708.231op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.366µs 10.540µs ± 0.076µs 10.545µs ± 0.051µs 10.589µs 10.669µs 10.704µs 10.748µs 1.93% 0.071 -0.274 0.72% 0.005µs 1 200
normalization/normalize_name/normalize_name/good throughput 93039122.951op/s 94877297.516op/s ± 682201.884op/s 94832968.294op/s ± 454526.977op/s 95359513.863op/s 96070861.894op/s 96288156.507op/s 96468168.793op/s 1.72% -0.035 -0.290 0.72% 48238.958op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [186.562µs; 186.613µs] or [-0.014%; +0.014%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5358700.695op/s; 5360148.065op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.962µs; 17.988µs] or [-0.074%; +0.074%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [55595319.552op/s; 55672574.396op/s] or [-0.069%; +0.069%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.530µs; 10.551µs] or [-0.100%; +0.100%] None None None
normalization/normalize_name/normalize_name/good throughput [94782750.896op/s; 94971844.136op/s] or [-0.100%; +0.100%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 78bc9f7 1773821887 julio/publishing/switch-to-ephemeral-release-branches
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 495.324µs 496.145µs ± 0.918µs 496.005µs ± 0.250µs 496.315µs 496.870µs 498.534µs 506.727µs 2.16% 8.242 88.263 0.18% 0.065µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1973448.132op/s 2015548.299op/s ± 3673.345op/s 2016109.047op/s ± 1016.226op/s 2016907.229op/s 2018073.451op/s 2018722.482op/s 2018881.024op/s 0.14% -8.119 86.229 0.18% 259.745op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 369.992µs 370.509µs ± 0.218µs 370.514µs ± 0.156µs 370.655µs 370.892µs 371.074µs 371.144µs 0.17% 0.317 -0.100 0.06% 0.015µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2694371.996op/s 2698987.188op/s ± 1584.616op/s 2698950.812op/s ± 1139.688op/s 2700211.987op/s 2701362.481op/s 2702192.712op/s 2702759.235op/s 0.14% -0.313 -0.104 0.06% 112.049op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 168.749µs 169.064µs ± 0.182µs 169.041µs ± 0.122µs 169.167µs 169.433µs 169.545µs 169.714µs 0.40% 0.742 0.445 0.11% 0.013µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5892276.308op/s 5914917.384op/s ± 6346.172op/s 5915712.787op/s ± 4262.734op/s 5919721.079op/s 5923634.434op/s 5925448.436op/s 5925961.043op/s 0.17% -0.735 0.431 0.11% 448.742op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.786µs 36.944µs ± 0.118µs 36.921µs ± 0.103µs 37.057µs 37.128µs 37.160µs 37.219µs 0.81% 0.316 -1.408 0.32% 0.008µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26868153.146op/s 27068538.825op/s ± 86556.521op/s 27085107.295op/s ± 75761.408op/s 27152514.577op/s 27166313.408op/s 27175056.941op/s 27184520.385op/s 0.37% -0.311 -1.414 0.32% 6120.470op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 46.171µs 46.279µs ± 0.049µs 46.280µs ± 0.029µs 46.308µs 46.354µs 46.410µs 46.568µs 0.62% 1.250 5.759 0.11% 0.003µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21474160.071op/s 21607903.737op/s ± 22736.043op/s 21607802.602op/s ± 13686.101op/s 21622135.090op/s 21640615.156op/s 21652245.861op/s 21658506.196op/s 0.23% -1.230 5.644 0.10% 1607.681op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [496.017µs; 496.272µs] or [-0.026%; +0.026%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [2015039.209op/s; 2016057.389op/s] or [-0.025%; +0.025%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [370.479µs; 370.540µs] or [-0.008%; +0.008%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2698767.575op/s; 2699206.800op/s] or [-0.008%; +0.008%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [169.039µs; 169.089µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5914037.866op/s; 5915796.902op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.927µs; 36.960µs] or [-0.044%; +0.044%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27056542.924op/s; 27080534.726op/s] or [-0.044%; +0.044%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [46.273µs; 46.286µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21604752.740op/s; 21611054.734op/s] or [-0.015%; +0.015%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 78bc9f7 1773821887 julio/publishing/switch-to-ephemeral-release-branches
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 4.218ms 4.222ms ± 0.003ms 4.221ms ± 0.001ms 4.223ms 4.228ms 4.231ms 4.238ms 0.40% 1.895 4.982 0.07% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [4.222ms; 4.223ms] or [-0.010%; +0.010%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 78bc9f7 1773821887 julio/publishing/switch-to-ephemeral-release-branches
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 236.699ns 249.204ns ± 15.300ns 243.265ns ± 5.035ns 250.658ns 283.401ns 293.939ns 295.764ns 21.58% 1.657 1.584 6.12% 1.082ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [247.084ns; 251.325ns] or [-0.851%; +0.851%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 78bc9f7 1773821887 julio/publishing/switch-to-ephemeral-release-branches
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.892µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.916µs 3.919µs 3.920µs 0.20% -1.539 14.566 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 255115937.573op/s 255605379.756op/s ± 176116.680op/s 255627235.708op/s ± 98886.232op/s 255701323.255op/s 255805036.107op/s 255846161.656op/s 256923882.607op/s 0.51% 1.568 14.801 0.07% 12453.330op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 80.162µs 80.726µs ± 0.253µs 80.681µs ± 0.151µs 80.849µs 81.230µs 81.428µs 81.641µs 1.19% 0.947 1.202 0.31% 0.018µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12248768.134op/s 12387682.210op/s ± 38685.064op/s 12394553.343op/s ± 23196.802op/s 12414825.797op/s 12437393.773op/s 12460687.778op/s 12474670.885op/s 0.65% -0.926 1.150 0.31% 2735.447op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 73.010µs 73.571µs ± 0.315µs 73.567µs ± 0.235µs 73.768µs 74.155µs 74.404µs 74.852µs 1.75% 0.727 0.860 0.43% 0.022µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13359679.407op/s 13592590.658op/s ± 58015.914op/s 13593095.404op/s ± 43339.240op/s 13639489.054op/s 13672985.920op/s 13687435.590op/s 13696666.966op/s 0.76% -0.698 0.768 0.43% 4102.345op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.896µs 3.913µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.919µs 3.921µs 3.922µs 0.25% 0.153 4.870 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254970045.509op/s 255579707.153op/s ± 202818.226op/s 255619708.280op/s ± 100773.800op/s 255711183.223op/s 255792894.736op/s 255873505.753op/s 256704625.675op/s 0.42% -0.136 4.935 0.08% 14341.414op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 70.032µs 70.577µs ± 0.261µs 70.540µs ± 0.157µs 70.717µs 71.025µs 71.377µs 71.800µs 1.79% 1.049 2.373 0.37% 0.018µs 1 200
credit_card/is_card_number/378282246310005 throughput 13927655.832op/s 14169107.823op/s ± 52252.031op/s 14176302.894op/s ± 31463.481op/s 14204738.709op/s 14236907.337op/s 14267111.351op/s 14279087.582op/s 0.73% -1.013 2.235 0.37% 3694.777op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 53.076µs 53.126µs ± 0.029µs 53.120µs ± 0.016µs 53.140µs 53.174µs 53.214µs 53.235µs 0.22% 1.090 1.355 0.05% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 18784777.929op/s 18823276.564op/s ± 10246.421op/s 18825371.521op/s ± 5735.002op/s 18829993.380op/s 18835681.985op/s 18840126.605op/s 18840860.423op/s 0.08% -1.086 1.343 0.05% 724.531op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.428µs 6.438µs ± 0.006µs 6.436µs ± 0.003µs 6.440µs 6.448µs 6.458µs 6.463µs 0.41% 1.487 3.223 0.09% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 154738878.143op/s 155332714.889op/s ± 133192.937op/s 155367194.318op/s ± 70654.799op/s 155426492.449op/s 155481776.430op/s 155510140.991op/s 155562703.031op/s 0.13% -1.479 3.185 0.09% 9418.163op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.897µs 3.912µs ± 0.003µs 3.912µs ± 0.001µs 3.913µs 3.915µs 3.921µs 3.926µs 0.37% 0.684 10.884 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254703396.550op/s 255640599.797op/s ± 166083.082op/s 255655784.332op/s ± 79097.906op/s 255734779.930op/s 255830913.801op/s 255896839.185op/s 256603784.188op/s 0.37% -0.660 10.896 0.06% 11743.847op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.778µs 65.162µs ± 0.134µs 65.133µs ± 0.073µs 65.215µs 65.452µs 65.542µs 65.698µs 0.87% 1.043 1.749 0.20% 0.009µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15221190.586op/s 15346517.589op/s ± 31448.282op/s 15353287.622op/s ± 17263.608op/s 15368583.925op/s 15382921.660op/s 15399028.887op/s 15437284.129op/s 0.55% -1.027 1.712 0.20% 2223.729op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 58.185µs 58.414µs ± 0.137µs 58.387µs ± 0.078µs 58.467µs 58.673µs 58.864µs 59.008µs 1.06% 1.309 2.277 0.23% 0.010µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 16946924.793op/s 17119168.887op/s ± 39988.272op/s 17127138.586op/s ± 22889.539op/s 17147656.785op/s 17167790.050op/s 17174132.522op/s 17186494.852op/s 0.35% -1.291 2.203 0.23% 2827.598op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.895µs 3.912µs ± 0.003µs 3.912µs ± 0.001µs 3.913µs 3.916µs 3.921µs 3.927µs 0.39% 0.483 10.731 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254644321.038op/s 255617343.454op/s ± 182859.778op/s 255647477.226op/s ± 91925.513op/s 255727011.168op/s 255807577.319op/s 255860464.685op/s 256713788.422op/s 0.42% -0.457 10.768 0.07% 12930.139op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 55.196µs 55.563µs ± 0.166µs 55.551µs ± 0.111µs 55.663µs 55.855µs 56.013µs 56.026µs 0.86% 0.358 -0.082 0.30% 0.012µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17848804.845op/s 17997705.230op/s ± 53868.157op/s 18001601.446op/s ± 35930.073op/s 18037330.648op/s 18080522.319op/s 18105048.047op/s 18117303.837op/s 0.64% -0.342 -0.098 0.30% 3809.054op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.769µs 52.965µs ± 0.107µs 52.941µs ± 0.061µs 53.024µs 53.153µs 53.235µs 53.254µs 0.59% 0.724 -0.338 0.20% 0.008µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 18777876.499op/s 18880516.119op/s ± 38021.991op/s 18889059.831op/s ± 21655.129op/s 18908199.278op/s 18927224.451op/s 18941154.871op/s 18950658.171op/s 0.33% -0.717 -0.347 0.20% 2688.561op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.430µs 6.440µs ± 0.006µs 6.438µs ± 0.003µs 6.442µs 6.452µs 6.457µs 6.471µs 0.51% 1.560 3.937 0.09% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 154531745.428op/s 155287165.543op/s ± 143895.976op/s 155315904.349op/s ± 69363.677op/s 155378318.442op/s 155460786.885op/s 155488431.306op/s 155513769.227op/s 0.13% -1.550 3.883 0.09% 10174.982op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255580971.677op/s; 255629787.834op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [80.691µs; 80.761µs] or [-0.043%; +0.043%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12382320.832op/s; 12393043.588op/s] or [-0.043%; +0.043%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [73.527µs; 73.614µs] or [-0.059%; +0.059%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13584550.210op/s; 13600631.106op/s] or [-0.059%; +0.059%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631 throughput [255551598.498op/s; 255607815.809op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [70.541µs; 70.613µs] or [-0.051%; +0.051%] None None None
credit_card/is_card_number/378282246310005 throughput [14161866.194op/s; 14176349.452op/s] or [-0.051%; +0.051%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [53.122µs; 53.130µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [18821856.509op/s; 18824696.619op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.437µs; 6.439µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/x371413321323331 throughput [155314255.629op/s; 155351174.149op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.911µs; 3.912µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ throughput [255617582.279op/s; 255663617.314op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.143µs; 65.180µs] or [-0.028%; +0.028%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15342159.160op/s; 15350876.018op/s] or [-0.028%; +0.028%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.395µs; 58.433µs] or [-0.032%; +0.032%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17113626.897op/s; 17124710.876op/s] or [-0.032%; +0.032%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.912µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255592000.847op/s; 255642686.060op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [55.540µs; 55.586µs] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [17990239.622op/s; 18005170.839op/s] or [-0.041%; +0.041%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.950µs; 52.980µs] or [-0.028%; +0.028%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [18875246.637op/s; 18885785.602op/s] or [-0.028%; +0.028%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.439µs; 6.441µs] or [-0.013%; +0.013%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [155267222.945op/s; 155307108.141op/s] or [-0.013%; +0.013%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 78bc9f7 1773821887 julio/publishing/switch-to-ephemeral-release-branches
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 159.530µs 160.280µs ± 0.336µs 160.242µs ± 0.155µs 160.394µs 160.801µs 161.158µs 163.012µs 1.73% 3.176 21.213 0.21% 0.024µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [160.233µs; 160.326µs] or [-0.029%; +0.029%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 78bc9f7 1773821887 julio/publishing/switch-to-ephemeral-release-branches
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.225µs 25.996µs ± 9.628µs 18.516µs ± 0.160µs 34.462µs 43.948µs 44.971µs 69.337µs 274.46% 0.961 0.549 36.95% 0.681µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.661µs; 27.330µs] or [-5.133%; +5.133%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 78bc9f7 1773821887 julio/publishing/switch-to-ephemeral-release-branches
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 86.813µs 86.965µs ± 0.261µs 86.931µs ± 0.043µs 86.981µs 87.095µs 87.270µs 90.422µs 4.02% 11.814 152.954 0.30% 0.018µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [86.929µs; 87.001µs] or [-0.042%; +0.042%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 78bc9f7 1773821887 julio/publishing/switch-to-ephemeral-release-branches
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.192µs 3.159µs ± 1.435µs 2.987µs ± 0.021µs 3.004µs 3.386µs 13.850µs 15.154µs 407.40% 7.518 57.037 45.32% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.960µs; 3.358µs] or [-6.297%; +6.297%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 78bc9f7 1773821887 julio/publishing/switch-to-ephemeral-release-branches
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2598 execution_time 3.411ms 3.444ms ± 0.020ms 3.439ms ± 0.008ms 3.453ms 3.486ms 3.511ms 3.557ms 3.44% 1.848 5.332 0.58% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2598 execution_time [3.442ms; 3.447ms] or [-0.081%; +0.081%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 78bc9f7 1773821887 julio/publishing/switch-to-ephemeral-release-branches
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.187ms 14.229ms ± 0.027ms 14.224ms ± 0.012ms 14.238ms 14.261ms 14.331ms 14.429ms 1.44% 3.229 17.704 0.19% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.225ms; 14.232ms] or [-0.026%; +0.026%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 78bc9f7 1773821887 julio/publishing/switch-to-ephemeral-release-branches
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 722.036µs 723.356µs ± 0.610µs 723.275µs ± 0.358µs 723.670µs 724.428µs 725.340µs 725.367µs 0.29% 0.796 1.001 0.08% 0.043µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [723.271µs; 723.440µs] or [-0.012%; +0.012%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 78bc9f7 1773821887 julio/publishing/switch-to-ephemeral-release-branches
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.083µs 33.953µs ± 1.136µs 33.255µs ± 0.102µs 35.475µs 35.863µs 36.186µs 36.988µs 11.22% 0.943 -0.978 3.34% 0.080µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.795µs; 34.110µs] or [-0.464%; +0.464%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 78bc9f7 1773821887 julio/publishing/switch-to-ephemeral-release-branches
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 49.472ms 50.089ms ± 2.552ms 49.649ms ± 0.064ms 49.787ms 49.930ms 64.230ms 75.589ms 52.25% 7.301 58.935 5.08% 0.180ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [49.735ms; 50.442ms] or [-0.706%; +0.706%] None None None

Group 20

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 78bc9f7 1773821887 julio/publishing/switch-to-ephemeral-release-branches
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.914µs 147.151µs ± 1.853µs 146.890µs ± 0.526µs 147.381µs 149.153µs 154.197µs 165.257µs 12.50% 6.055 50.217 1.26% 0.131µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.894µs; 147.408µs] or [-0.175%; +0.175%] None None None

Baseline

Omitted due to size.

@dd-octo-sts
Copy link
Copy Markdown
Contributor

dd-octo-sts bot commented Mar 16, 2026 •
edited
Loading

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 100.36 MB 100.36 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.70 MB 8.70 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.28 MB 11.28 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 117.03 MB 117.03 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 27.18 MB 27.18 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 76.61 KB 76.61 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 186.12 MB 186.09 MB --.01% (-24.00 KB) 💪
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 917.07 MB 917.07 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 9.94 MB 9.94 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 76.61 KB 76.61 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 24.78 MB 24.78 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 51.46 MB 51.46 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 22.98 MB 22.98 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 77.80 KB 77.80 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 190.31 MB 190.29 MB --.01% (-24.00 KB) 💪
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 900.75 MB 900.75 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 7.54 MB 7.54 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 77.80 KB 77.80 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 26.52 MB 26.52 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 47.09 MB 47.09 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 87.57 MB 87.57 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 10.22 MB 10.22 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 109.90 MB 109.90 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.97 MB 11.97 MB 0% (0 B) 👌

@hoolioh hoolioh changed the title [wip]: switch to ephemeral branches ci: switch to ephemeral branches Mar 18, 2026
@hoolioh hoolioh marked this pull request as ready for review March 18, 2026 08:02
@hoolioh hoolioh requested a review from a team as a code owner March 18, 2026 08:02
@hoolioh hoolioh force-pushed the julio/publishing/switch-to-ephemeral-release-branches branch from 569b060 to 2a871fa Compare March 18, 2026 08:02
@hoolioh hoolioh force-pushed the julio/publishing/switch-to-ephemeral-release-branches branch from 2a871fa to 78bc9f7 Compare March 18, 2026 08:18
@hoolioh hoolioh merged commit c219ca2 into main Mar 18, 2026
63 of 65 checks passed
@hoolioh hoolioh deleted the julio/publishing/switch-to-ephemeral-release-branches branch March 18, 2026 10:50
bwoebi added a commit that referenced this pull request Mar 20, 2026
@bwoebi
Merge branch 'main' of github.com:DataDog/libdatadog into bob/prevent…
5d5ae75 
…-unprocessed

* 'main' of github.com:DataDog/libdatadog:
  feat(sidecar): add thread mode as fallback connection for restricted environments (#1447)
  feat(profiling-ffi): ProfilesDictionary_insert_strs (#1764)
  chore(release): merge release branch to main (#1760)
  fix(libdd-crashtracker-ffi)!: add missing fields for endpoint configuration (#1758)
  ci: prevent running macos tests on release branches (#1765)
  chore(datadog-tracer-flare): remove unnecessary features/deps (#1761)
  fix(profiling-ffi): Windows extern statics need __declspec(dllimport) (#1468)
  feat(profiling): thread id/name as well-known strs (#1757)
  ci: switch to ephemeral branches (#1731)
  chore(crashtracker): use weaker mem ordering for OP_COUNTERS (#1744)
  refactor(trace-utils)!: change header name type to accept dynamic values (#1722)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@iunanua iunanua iunanua approved these changes

Assignees

No one assigned

Labels

ci-build

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@hoolioh @codecov-commenter @iunanua