Skip to content

chore(crashtracker): fix benchmark job#1664

Merged
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit intomainfrom
gleocadie/fix-libunwind-git-submodules
Mar 5, 2026
Merged

chore(crashtracker): fix benchmark job#1664
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit intomainfrom
gleocadie/fix-libunwind-git-submodules

Conversation

@gleocadie
Copy link
Copy Markdown
Contributor

@gleocadie gleocadie commented Mar 5, 2026

What does this PR do?

At build time, initialize libunwind submodule

Motivation

Fix benchmark (gitlab) job

@gleocadie gleocadie requested review from a team as code owners March 5, 2026 17:29
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Mar 5, 2026 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2026-03-05 18:08:16

Comparing candidate commit bd09bf2 in PR branch gleocadie/fix-libunwind-git-submodules with baseline commit 412ae10 in branch main.

Found 2 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number/ 378282246310005

  • 🟩 execution_time [-10.527µs; -10.375µs] or [-12.626%; -12.444%]
  • 🟩 throughput [+1706594.326op/s; +1731251.886op/s] or [+14.228%; +14.434%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bd09bf2 1772733081 gleocadie/fix-libunwind-git-submodules
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 188.910ns 192.502ns ± 2.940ns 191.921ns ± 1.785ns 193.729ns 198.548ns 201.872ns 205.134ns 6.88% 1.418 2.246 1.52% 0.208ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [192.095ns; 192.909ns] or [-0.212%; +0.212%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bd09bf2 1772733081 gleocadie/fix-libunwind-git-submodules
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 48.923ms 49.312ms ± 1.408ms 49.134ms ± 0.055ms 49.182ms 49.346ms 60.039ms 61.250ms 24.66% 7.914 61.224 2.85% 0.100ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [49.117ms; 49.507ms] or [-0.396%; +0.396%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bd09bf2 1772733081 gleocadie/fix-libunwind-git-submodules
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.193µs 3.152µs ± 1.409µs 2.987µs ± 0.029µs 3.011µs 3.324µs 13.608µs 14.908µs 399.09% 7.497 56.825 44.59% 0.100µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.957µs; 3.348µs] or [-6.195%; +6.195%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bd09bf2 1772733081 gleocadie/fix-libunwind-git-submodules
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.890µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.914µs 3.917µs 3.920µs 3.922µs 0.25% -1.828 16.065 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 254941842.140op/s 255574142.869op/s ± 196979.640op/s 255582709.830op/s ± 108738.217op/s 255685801.783op/s 255827394.765op/s 255917109.219op/s 257084560.503op/s 0.59% 1.862 16.349 0.08% 13928.564op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 78.902µs 79.734µs ± 0.421µs 79.672µs ± 0.257µs 79.938µs 80.432µs 80.915µs 82.050µs 2.98% 1.268 3.855 0.53% 0.030µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12187668.034op/s 12542111.671op/s ± 65827.398op/s 12551418.484op/s ± 40690.674op/s 12588123.127op/s 12622395.412op/s 12644599.398op/s 12674016.255op/s 0.98% -1.203 3.480 0.52% 4654.700op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 72.300µs 72.924µs ± 0.345µs 72.881µs ± 0.240µs 73.147µs 73.488µs 73.899µs 74.195µs 1.80% 0.597 0.395 0.47% 0.024µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13478020.864op/s 13713200.404op/s ± 64690.429op/s 13720914.775op/s ± 45182.611op/s 13760877.159op/s 13809130.045op/s 13826175.815op/s 13831219.829op/s 0.80% -0.569 0.325 0.47% 4574.304op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.892µs 3.912µs ± 0.003µs 3.912µs ± 0.001µs 3.913µs 3.917µs 3.921µs 3.925µs 0.34% -0.632 13.144 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254746509.290op/s 255612788.915op/s ± 189302.400op/s 255622086.389op/s ± 84429.461op/s 255712606.636op/s 255842317.407op/s 255891033.510op/s 256929897.727op/s 0.51% 0.665 13.306 0.07% 13385.701op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 69.246µs 69.723µs ± 0.315µs 69.680µs ± 0.201µs 69.914µs 70.300µs 70.630µs 70.896µs 1.75% 0.914 0.939 0.45% 0.022µs 1 200
credit_card/is_card_number/378282246310005 throughput 14105112.868op/s 14342695.259op/s ± 64575.614op/s 14351259.540op/s ± 41362.498op/s 14390590.353op/s 14430504.501op/s 14440462.233op/s 14441335.434op/s 0.63% -0.886 0.852 0.45% 4566.185op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.159µs 52.231µs ± 0.040µs 52.224µs ± 0.022µs 52.250µs 52.313µs 52.359µs 52.388µs 0.31% 1.051 1.822 0.08% 0.003µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19088395.876op/s 19145799.132op/s ± 14709.606op/s 19148422.766op/s ± 8240.620op/s 19154849.148op/s 19166906.515op/s 19171268.959op/s 19172307.519op/s 0.12% -1.045 1.802 0.08% 1040.126op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.028µs 6.040µs ± 0.012µs 6.036µs ± 0.003µs 6.040µs 6.073µs 6.080µs 6.114µs 1.29% 2.964 9.912 0.20% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 163557170.935op/s 165567503.200op/s ± 337681.996op/s 165662057.012op/s ± 91115.322op/s 165741190.780op/s 165809772.594op/s 165870499.788op/s 165888197.566op/s 0.14% -2.945 9.754 0.20% 23877.723op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.896µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.917µs 3.919µs 3.932µs 0.49% 0.294 8.884 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254297867.768op/s 255544315.466op/s ± 207829.830op/s 255550576.522op/s ± 137279.991op/s 255680232.458op/s 255837405.600op/s 255873803.398op/s 256671655.496op/s 0.44% -0.268 8.843 0.08% 14695.788op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.126µs 64.475µs ± 0.163µs 64.460µs ± 0.102µs 64.566µs 64.769µs 64.845µs 65.035µs 0.89% 0.443 0.052 0.25% 0.012µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15376407.052op/s 15510004.512op/s ± 39167.723op/s 15513502.913op/s ± 24643.560op/s 15537040.425op/s 15566081.515op/s 15584486.096op/s 15594205.193op/s 0.52% -0.429 0.031 0.25% 2769.576op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 58.128µs 58.406µs ± 0.154µs 58.385µs ± 0.097µs 58.487µs 58.710µs 58.882µs 58.980µs 1.02% 1.017 1.140 0.26% 0.011µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 16954863.197op/s 17121659.437op/s ± 45167.246op/s 17127723.578op/s ± 28361.993op/s 17155801.081op/s 17180255.164op/s 17191927.482op/s 17203509.516op/s 0.44% -1.001 1.093 0.26% 3193.807op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.893µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.919µs 3.921µs 3.922µs 0.22% -0.782 7.234 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254984111.377op/s 255540889.205op/s ± 213864.858op/s 255554715.704op/s ± 117486.127op/s 255668576.715op/s 255826081.183op/s 255931208.774op/s 256901282.064op/s 0.53% 0.804 7.369 0.08% 15122.529op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.574µs 55.028µs ± 0.295µs 54.993µs ± 0.179µs 55.157µs 55.637µs 55.880µs 56.005µs 1.84% 0.994 0.914 0.54% 0.021µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17855432.996op/s 18173237.257op/s ± 96988.059op/s 18184045.550op/s ± 59066.564op/s 18245966.618op/s 18298019.565op/s 18313779.661op/s 18323887.805op/s 0.77% -0.964 0.835 0.53% 6858.091op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.157µs 52.234µs ± 0.040µs 52.231µs ± 0.027µs 52.258µs 52.287µs 52.357µs 52.477µs 0.47% 1.347 5.985 0.08% 0.003µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19055806.617op/s 19144481.808op/s ± 14720.194op/s 19145787.745op/s ± 9852.287op/s 19155623.126op/s 19165596.034op/s 19170731.737op/s 19172879.961op/s 0.14% -1.333 5.892 0.08% 1040.875op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.028µs 6.039µs ± 0.014µs 6.035µs ± 0.002µs 6.038µs 6.072µs 6.080µs 6.148µs 1.86% 4.072 21.612 0.23% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 162663862.736op/s 165588914.121op/s ± 378933.366op/s 165686537.969op/s ± 58237.983op/s 165742997.878op/s 165817206.244op/s 165848912.093op/s 165884679.414op/s 0.12% -4.024 21.033 0.23% 26794.635op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ throughput [255546843.385op/s; 255601442.353op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [79.675µs; 79.792µs] or [-0.073%; +0.073%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12532988.627op/s; 12551234.716op/s] or [-0.073%; +0.073%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [72.876µs; 72.972µs] or [-0.066%; +0.066%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13704234.933op/s; 13722165.876op/s] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255586553.423op/s; 255639024.407op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 execution_time [69.680µs; 69.767µs] or [-0.063%; +0.063%] None None None
credit_card/is_card_number/378282246310005 throughput [14333745.700op/s; 14351644.818op/s] or [-0.062%; +0.062%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.225µs; 52.236µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19143760.522op/s; 19147837.742op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.038µs; 6.042µs] or [-0.028%; +0.028%] None None None
credit_card/is_card_number/x371413321323331 throughput [165520703.723op/s; 165614302.677op/s] or [-0.028%; +0.028%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.913µs; 3.914µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ throughput [255515512.250op/s; 255573118.682op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.452µs; 64.498µs] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15504576.243op/s; 15515432.782op/s] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.385µs; 58.427µs] or [-0.037%; +0.037%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17115399.691op/s; 17127919.183op/s] or [-0.037%; +0.037%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.913µs; 3.914µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255511249.593op/s; 255570528.818op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.987µs; 55.068µs] or [-0.074%; +0.074%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18159795.645op/s; 18186678.870op/s] or [-0.074%; +0.074%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.229µs; 52.240µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19142441.731op/s; 19146521.885op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.037µs; 6.041µs] or [-0.032%; +0.032%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165536397.601op/s; 165641430.641op/s] or [-0.032%; +0.032%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bd09bf2 1772733081 gleocadie/fix-libunwind-git-submodules
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 89.752µs 89.966µs ± 0.150µs 89.950µs ± 0.055µs 90.004µs 90.141µs 90.295µs 91.466µs 1.69% 5.720 51.231 0.17% 0.011µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [89.945µs; 89.986µs] or [-0.023%; +0.023%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bd09bf2 1772733081 gleocadie/fix-libunwind-git-submodules
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.392µs 2.417µs ± 0.017µs 2.413µs ± 0.006µs 2.419µs 2.459µs 2.469µs 2.493µs 3.29% 1.909 3.445 0.70% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.415µs; 2.420µs] or [-0.097%; +0.097%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bd09bf2 1772733081 gleocadie/fix-libunwind-git-submodules
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.851µs 34.354µs ± 0.827µs 33.983µs ± 0.080µs 34.126µs 36.075µs 36.153µs 37.740µs 11.06% 1.764 1.605 2.40% 0.058µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.240µs; 34.469µs] or [-0.334%; +0.334%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bd09bf2 1772733081 gleocadie/fix-libunwind-git-submodules
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.972µs 5.024µs ± 0.042µs 4.997µs ± 0.020µs 5.063µs 5.084µs 5.086µs 5.130µs 2.66% 0.371 -1.517 0.83% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.019µs; 5.030µs] or [-0.116%; +0.116%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bd09bf2 1772733081 gleocadie/fix-libunwind-git-submodules
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.958µs 25.647µs ± 9.602µs 18.086µs ± 0.108µs 34.291µs 43.236µs 43.728µs 69.939µs 286.70% 0.953 0.668 37.35% 0.679µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.316µs; 26.977µs] or [-5.189%; +5.189%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bd09bf2 1772733081 gleocadie/fix-libunwind-git-submodules
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.620ms 10.651ms ± 0.013ms 10.650ms ± 0.009ms 10.660ms 10.672ms 10.680ms 10.708ms 0.54% 0.581 1.327 0.12% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.650ms; 10.653ms] or [-0.017%; +0.017%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bd09bf2 1772733081 gleocadie/fix-libunwind-git-submodules
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 3.143ms 3.169ms ± 0.017ms 3.165ms ± 0.008ms 3.174ms 3.210ms 3.222ms 3.251ms 2.73% 1.719 3.531 0.55% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [3.166ms; 3.171ms] or [-0.076%; +0.076%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bd09bf2 1772733081 gleocadie/fix-libunwind-git-submodules
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 534.058µs 534.854µs ± 0.901µs 534.722µs ± 0.300µs 535.057µs 535.584µs 536.360µs 545.760µs 2.06% 9.051 105.650 0.17% 0.064µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1832308.031op/s 1869674.918op/s ± 3104.093op/s 1870132.190op/s ± 1048.424op/s 1871012.559op/s 1871942.578op/s 1872357.448op/s 1872455.182op/s 0.12% -8.922 103.505 0.17% 219.492op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 380.334µs 381.459µs ± 0.512µs 381.533µs ± 0.321µs 381.821µs 382.187µs 382.629µs 382.954µs 0.37% -0.018 -0.354 0.13% 0.036µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2611282.945op/s 2621516.891op/s ± 3519.162op/s 2621004.066op/s ± 2206.645op/s 2624215.985op/s 2627232.850op/s 2628572.654op/s 2629269.161op/s 0.32% 0.025 -0.360 0.13% 248.842op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 189.839µs 190.253µs ± 0.159µs 190.244µs ± 0.109µs 190.360µs 190.533µs 190.629µs 190.671µs 0.22% 0.326 -0.276 0.08% 0.011µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5244639.575op/s 5256168.134op/s ± 4380.408op/s 5256411.460op/s ± 3016.960op/s 5259393.808op/s 5263024.899op/s 5263801.180op/s 5267633.606op/s 0.21% -0.322 -0.279 0.08% 309.742op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.373µs 37.542µs ± 0.066µs 37.536µs ± 0.046µs 37.587µs 37.646µs 37.694µs 37.798µs 0.70% 0.370 0.443 0.17% 0.005µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26456534.591op/s 26637135.485op/s ± 46697.020op/s 26640939.131op/s ± 32955.738op/s 26668908.127op/s 26709556.279op/s 26737766.000op/s 26757288.932op/s 0.44% -0.358 0.420 0.17% 3301.978op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.788µs 45.917µs ± 0.055µs 45.912µs ± 0.033µs 45.947µs 46.007µs 46.075µs 46.107µs 0.42% 0.700 0.740 0.12% 0.004µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21688508.199op/s 21778473.047op/s ± 25915.456op/s 21780647.822op/s ± 15644.202op/s 21794940.487op/s 21812511.887op/s 21824494.907op/s 21839656.156op/s 0.27% -0.692 0.722 0.12% 1832.499op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [534.729µs; 534.979µs] or [-0.023%; +0.023%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1869244.720op/s; 1870105.115op/s] or [-0.023%; +0.023%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [381.388µs; 381.530µs] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2621029.169op/s; 2622004.613op/s] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [190.231µs; 190.275µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5255561.051op/s; 5256775.216op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.533µs; 37.551µs] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26630663.727op/s; 26643607.243op/s] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.909µs; 45.925µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21774881.415op/s; 21782064.680op/s] or [-0.016%; +0.016%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bd09bf2 1772733081 gleocadie/fix-libunwind-git-submodules
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 4.153ms 4.159ms ± 0.008ms 4.158ms ± 0.002ms 4.160ms 4.164ms 4.169ms 4.255ms 2.34% 10.714 134.319 0.18% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [4.158ms; 4.160ms] or [-0.025%; +0.025%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bd09bf2 1772733081 gleocadie/fix-libunwind-git-submodules
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 733.033µs 734.290µs ± 0.585µs 734.206µs ± 0.368µs 734.630µs 735.184µs 735.617µs 737.023µs 0.38% 0.800 1.951 0.08% 0.041µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [734.209µs; 734.371µs] or [-0.011%; +0.011%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bd09bf2 1772733081 gleocadie/fix-libunwind-git-submodules
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 239.009ns 248.338ns ± 12.468ns 242.873ns ± 2.618ns 248.903ns 281.255ns 285.954ns 289.211ns 19.08% 1.986 2.771 5.01% 0.882ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [246.610ns; 250.066ns] or [-0.696%; +0.696%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bd09bf2 1772733081 gleocadie/fix-libunwind-git-submodules
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 13.941ms 14.009ms ± 0.033ms 14.006ms ± 0.019ms 14.025ms 14.053ms 14.129ms 14.189ms 1.30% 1.618 5.446 0.24% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.005ms; 14.014ms] or [-0.033%; +0.033%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bd09bf2 1772733081 gleocadie/fix-libunwind-git-submodules
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 185.152µs 185.641µs ± 0.244µs 185.651µs ± 0.190µs 185.814µs 186.025µs 186.120µs 186.240µs 0.32% 0.061 -0.769 0.13% 0.017µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5369402.834op/s 5386760.705op/s ± 7080.135op/s 5386456.724op/s ± 5495.063op/s 5392272.492op/s 5398425.643op/s 5399998.423op/s 5400962.749op/s 0.27% -0.056 -0.771 0.13% 500.641op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.837µs 17.911µs ± 0.044µs 17.908µs ± 0.030µs 17.938µs 17.999µs 18.034µs 18.059µs 0.84% 0.675 0.497 0.24% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 55373381.783op/s 55831339.333op/s ± 135820.847op/s 55840624.290op/s ± 94814.117op/s 55936370.733op/s 56043030.499op/s 56056834.508op/s 56064639.231op/s 0.40% -0.660 0.466 0.24% 9603.984op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.291µs 10.366µs ± 0.040µs 10.361µs ± 0.023µs 10.387µs 10.430µs 10.485µs 10.548µs 1.80% 1.040 2.450 0.38% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 94807085.537op/s 96466528.173op/s ± 366408.958op/s 96515039.372op/s ± 212598.683op/s 96696814.908op/s 97013758.673op/s 97145072.650op/s 97168209.212op/s 0.68% -1.002 2.311 0.38% 25909.026op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [185.607µs; 185.674µs] or [-0.018%; +0.018%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5385779.467op/s; 5387741.944op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.905µs; 17.917µs] or [-0.034%; +0.034%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [55812515.870op/s; 55850162.796op/s] or [-0.034%; +0.034%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.361µs; 10.372µs] or [-0.053%; +0.053%] None None None
normalization/normalize_name/normalize_name/good throughput [96415747.416op/s; 96517308.931op/s] or [-0.053%; +0.053%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bd09bf2 1772733081 gleocadie/fix-libunwind-git-submodules
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.045µs 146.317µs ± 1.643µs 146.040µs ± 0.496µs 146.563µs 148.247µs 152.285µs 161.518µs 10.60% 5.356 40.417 1.12% 0.116µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.090µs; 146.545µs] or [-0.156%; +0.156%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz bd09bf2 1772733081 gleocadie/fix-libunwind-git-submodules
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 160.223µs 161.003µs ± 0.279µs 160.983µs ± 0.164µs 161.164µs 161.373µs 162.055µs 162.599µs 1.00% 1.464 6.586 0.17% 0.020µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [160.964µs; 161.042µs] or [-0.024%; +0.024%] None None None

Baseline

Omitted due to size.

@gleocadie gleocadie force-pushed the gleocadie/fix-libunwind-git-submodules branch from b75ec50 to bd09bf2 Compare March 5, 2026 17:51
@gleocadie gleocadie changed the title [crashtracker] Fix benchmark job chore(crashtracker): Fix benchmark job Mar 5, 2026
@github-actions
Copy link
Copy Markdown

github-actions bot commented Mar 5, 2026

Clippy Allow Annotation Report

Comparing clippy allow annotations between branches:

  • Base Branch: origin/main
  • PR Branch: origin/gleocadie/fix-libunwind-git-submodules

Summary by Rule

Rule Base Branch PR Branch Change

Annotation Counts by File

File Base Branch PR Branch Change

Annotation Stats by Crate

Crate Base Branch PR Branch Change
clippy-annotation-reporter 5 5 No change (0%)
datadog-ffe-ffi 1 1 No change (0%)
datadog-ipc 27 27 No change (0%)
datadog-live-debugger 6 6 No change (0%)
datadog-live-debugger-ffi 10 10 No change (0%)
datadog-profiling-replayer 4 4 No change (0%)
datadog-remote-config 3 3 No change (0%)
datadog-sidecar 59 59 No change (0%)
libdd-common 10 10 No change (0%)
libdd-common-ffi 12 12 No change (0%)
libdd-crashtracker 12 12 No change (0%)
libdd-data-pipeline 5 5 No change (0%)
libdd-ddsketch 2 2 No change (0%)
libdd-dogstatsd-client 1 1 No change (0%)
libdd-profiling 13 13 No change (0%)
libdd-telemetry 19 19 No change (0%)
libdd-tinybytes 4 4 No change (0%)
libdd-trace-normalization 2 2 No change (0%)
libdd-trace-obfuscation 9 9 No change (0%)
libdd-trace-utils 15 15 No change (0%)
Total 219 219 No change (0%)

About This Report

This report tracks Clippy allow annotations for specific rules, showing how they've changed in this PR. Decreasing the number of these annotations generally improves code quality.

@dd-octo-sts
Copy link
Copy Markdown
Contributor

dd-octo-sts bot commented Mar 5, 2026

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.70 MB 8.70 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 98.65 MB 98.65 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 114.30 MB 114.30 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.29 MB 11.29 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 27.16 MB 27.16 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 76.26 KB 76.26 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 185.97 MB 185.96 MB -0% (-8.00 KB) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 916.65 MB 916.65 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 9.93 MB 9.93 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 76.26 KB 76.26 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 24.76 MB 24.76 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 51.43 MB 51.43 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 22.97 MB 22.97 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 77.44 KB 77.44 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 190.15 MB 190.14 MB -0% (-8.00 KB) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 900.31 MB 900.31 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 7.53 MB 7.53 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 77.44 KB 77.44 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 26.52 MB 26.52 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 47.06 MB 47.06 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 86.54 MB 86.54 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 10.23 MB 10.23 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 107.16 MB 107.16 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.98 MB 11.98 MB 0% (0 B) 👌

@codecov-commenter
Copy link
Copy Markdown

codecov-commenter commented Mar 5, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.21%. Comparing base (959c0cd) to head (bd09bf2).
⚠️ Report is 2 commits behind head on main.

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1664      +/-   ##
==========================================
- Coverage   71.24%   71.21%   -0.04%     
==========================================
  Files         427      427              
  Lines       62805    62794      -11     
==========================================
- Hits        44748    44716      -32     
- Misses      18057    18078      +21
Components Coverage Δ
libdd-crashtracker 62.95% <ø> (+0.04%) ⬆️
libdd-crashtracker-ffi 16.71% <ø> (+1.08%) ⬆️
libdd-alloc 98.77% <ø> (ø)
libdd-data-pipeline 88.00% <ø> (+0.61%) ⬆️
libdd-data-pipeline-ffi 75.60% <ø> (+2.76%) ⬆️
libdd-common 79.73% <ø> (ø)
libdd-common-ffi 73.40% <ø> (ø)
libdd-telemetry 62.48% <ø> (ø)
libdd-telemetry-ffi 16.75% <ø> (ø)
libdd-dogstatsd-client 82.64% <ø> (ø)
datadog-ipc 80.74% <ø> (ø)
libdd-profiling 81.60% <ø> (ø)
libdd-profiling-ffi 63.65% <ø> (ø)
datadog-sidecar 32.35% <ø> (-1.02%) ⬇️
datdog-sidecar-ffi 7.96% <ø> (-4.45%) ⬇️
spawn-worker 54.69% <ø> (ø)
libdd-tinybytes 93.16% <ø> (ø)
libdd-trace-normalization 81.71% <ø> (ø)
libdd-trace-obfuscation 94.67% <ø> (ø)
libdd-trace-protobuf 68.00% <ø> (ø)
libdd-trace-utils 89.07% <ø> (+0.10%) ⬆️
datadog-tracer-flare 90.45% <ø> (ø)
libdd-log 74.69% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@gyuheon0h gyuheon0h changed the title chore(crashtracker): Fix benchmark job chore(crashtracker): fix benchmark job Mar 5, 2026
@gyuheon0h gyuheon0h mentioned this pull request Mar 5, 2026
Merged
@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d bot merged commit b715636 into main Mar 5, 2026
97 of 99 checks passed
@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d bot deleted the gleocadie/fix-libunwind-git-submodules branch March 5, 2026 20:09
gh-worker-dd-mergequeue-cf854d bot pushed a commit that referenced this pull request Mar 5, 2026
@gyuheon0h
chore(cargo): bump to 28.0.3 (#1660)
29b010a 
# What does this PR do?
[feat: process context publication](#1585)
[ci: pass macos label to downstream project](#1647)
[chore: implement otel process ctx update](#1640)
[chore(crashtracking): emit a best effort stacktrace for Mac](#1645)
[ci: remove depth so it can cause problems when getting the diffs](#1657)
[build(macOS): set the LC_ID_DYLIB for mac binaries to set correct name for linking](#1646)
[chore(ci): fix crashtracker receiver binary rpath setting](#1652)
[chore(deps): bump blazesym to 0.2.3 and blazesym-c to 0.1.7](#1654)
[feat: otel process ctxt protobuf encoding](#1651)
[chore(crashtracker): fix benchmark job](#1664)
# Motivation

What inspired you to submit this pull request?

# Additional Notes

Anything else we should know when reviewing?

# How to test the change?

Describe here in detail how the change can be validated.


Co-authored-by: gyuheon.oh <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@gyuheon0h gyuheon0h gyuheon0h approved these changes

Assignees

No one assigned

Labels

mergequeue-status: done

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@gleocadie @codecov-commenter @gyuheon0h