Skip to content

ci: add script to add file attribute to junit.xml#1487

Merged
gh-worker-dd-mergequeue-cf854d[bot] merged 3 commits intomainfrom
ekump/APMSP-2547-add-file-attribute-to-junit
Feb 3, 2026
Merged

ci: add script to add file attribute to junit.xml#1487
gh-worker-dd-mergequeue-cf854d[bot] merged 3 commits intomainfrom
ekump/APMSP-2547-add-file-attribute-to-junit

Conversation

@ekump
Copy link
Copy Markdown
Contributor

@ekump ekump commented Jan 28, 2026

What does this PR do?

cargo-nextest does not include the file path for test cases when generating junit.xml. This script runs after the junit.xml is generated by nextest and uses cargo-metadata to resolve the filename for tests.

Motivation

The Test Optimization tool uses the file attribute and the git CODEOWNERS file to map test failures to code owners to provide granular alerting capabilities.

Additional Notes

Comments in the code explain this but two things make this less trivial than expected:

  1. Unit tests and integration tests are reported differently in the junit.xml file.
  2. Some crates don't match on their package name and the target name. For example, libdd-profiling-ffi has a lib target of datadog_profiling_ffi. For unit tests we need to include a fallback to check the alias if it exists to properly resolve to the file name.

How to test the change?

Generate the Junit file locally with cargo nextest run --profile ci --workspace to target/nextest/ci/junit.xml
Run the script to add file attributes with cargo run --bin add_junit_file_attributes -- target/nextest/ci/junit.xml -o junit_with_files.xml

I verified all tests have codeowners in Test Optimization on my branch

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Jan 28, 2026

Benchmarks

Comparison

Benchmark execution time: 2026-02-03 18:47:09

Comparing candidate commit a72a900 in PR branch ekump/APMSP-2547-add-file-attribute-to-junit with baseline commit 8fe097c in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a72a900 1770143452 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 205.979µs 206.524µs ± 0.328µs 206.483µs ± 0.203µs 206.688µs 207.005µs 207.179µs 209.178µs 1.30% 2.756 19.610 0.16% 0.023µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4780628.583op/s 4842058.708op/s ± 7661.762op/s 4843014.662op/s ± 4764.774op/s 4847592.988op/s 4851201.713op/s 4854082.050op/s 4854853.016op/s 0.24% -2.691 18.924 0.16% 541.768op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.588µs 18.730µs ± 0.083µs 18.709µs ± 0.044µs 18.768µs 18.883µs 18.972µs 19.135µs 2.28% 1.433 3.135 0.44% 0.006µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 52259168.273op/s 53392218.156op/s ± 234441.541op/s 53448795.071op/s ± 124932.602op/s 53551022.780op/s 53663411.275op/s 53744389.725op/s 53799204.045op/s 0.66% -1.392 2.934 0.44% 16577.520op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.789µs 10.860µs ± 0.028µs 10.859µs ± 0.019µs 10.879µs 10.901µs 10.942µs 10.987µs 1.18% 0.617 1.840 0.26% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 91018553.194op/s 92082229.388op/s ± 239492.209op/s 92089381.547op/s ± 157112.344op/s 92242721.596op/s 92462359.145op/s 92577109.739op/s 92690471.844op/s 0.65% -0.590 1.758 0.26% 16934.657op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [206.479µs; 206.570µs] or [-0.022%; +0.022%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4840996.862op/s; 4843120.555op/s] or [-0.022%; +0.022%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.718µs; 18.741µs] or [-0.061%; +0.061%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53359726.814op/s; 53424709.499op/s] or [-0.061%; +0.061%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.856µs; 10.864µs] or [-0.036%; +0.036%] None None None
normalization/normalize_name/normalize_name/good throughput [92049038.071op/s; 92115420.705op/s] or [-0.036%; +0.036%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a72a900 1770143452 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.883µs 34.397µs ± 0.846µs 34.000µs ± 0.059µs 34.138µs 36.186µs 36.239µs 37.741µs 11.00% 1.759 1.488 2.45% 0.060µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.280µs; 34.514µs] or [-0.341%; +0.341%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a72a900 1770143452 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 88.931µs 89.145µs ± 0.140µs 89.120µs ± 0.044µs 89.181µs 89.252µs 89.455µs 90.698µs 1.77% 7.356 75.441 0.16% 0.010µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [89.126µs; 89.165µs] or [-0.022%; +0.022%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a72a900 1770143452 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.229µs 3.142µs ± 1.406µs 2.973µs ± 0.025µs 2.992µs 3.375µs 13.589µs 14.990µs 404.23% 7.522 57.145 44.63% 0.099µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.948µs; 3.337µs] or [-6.201%; +6.201%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a72a900 1770143452 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.464µs 146.059µs ± 1.710µs 145.722µs ± 0.516µs 146.326µs 147.765µs 152.283µs 161.876µs 11.09% 5.757 44.451 1.17% 0.121µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [145.822µs; 146.296µs] or [-0.162%; +0.162%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a72a900 1770143452 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 3.965ms 3.972ms ± 0.007ms 3.972ms ± 0.002ms 3.973ms 3.977ms 3.982ms 4.064ms 2.34% 10.500 130.604 0.18% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [3.971ms; 3.973ms] or [-0.025%; +0.025%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a72a900 1770143452 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 240.634ns 252.306ns ± 13.647ns 246.341ns ± 3.983ns 254.432ns 280.470ns 299.388ns 302.477ns 22.79% 1.939 3.477 5.40% 0.965ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [250.414ns; 254.197ns] or [-0.750%; +0.750%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a72a900 1770143452 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.629ms 10.652ms ± 0.013ms 10.650ms ± 0.008ms 10.658ms 10.672ms 10.680ms 10.743ms 0.87% 1.898 11.002 0.12% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.650ms; 10.654ms] or [-0.017%; +0.017%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a72a900 1770143452 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 534.872µs 536.863µs ± 1.482µs 536.292µs ± 0.616µs 537.584µs 540.083µs 541.212µs 542.364µs 1.13% 1.372 1.234 0.28% 0.105µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1843781.392op/s 1862686.925op/s ± 5122.542op/s 1864654.595op/s ± 2143.128op/s 1866364.360op/s 1867563.575op/s 1868325.778op/s 1869605.569op/s 0.27% -1.361 1.193 0.27% 362.218op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 381.605µs 382.224µs ± 0.281µs 382.221µs ± 0.203µs 382.426µs 382.668µs 382.898µs 383.253µs 0.27% 0.300 0.147 0.07% 0.020µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2609241.571op/s 2616269.908op/s ± 1924.444op/s 2616286.692op/s ± 1387.150op/s 2617630.183op/s 2619317.903op/s 2620028.603op/s 2620511.335op/s 0.16% -0.295 0.139 0.07% 136.079op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 189.614µs 189.936µs ± 0.147µs 189.919µs ± 0.103µs 190.037µs 190.198µs 190.262µs 190.312µs 0.21% 0.263 -0.418 0.08% 0.010µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5254532.236op/s 5264926.431op/s ± 4086.389op/s 5265393.378op/s ± 2844.595op/s 5267646.413op/s 5271077.565op/s 5273480.373op/s 5273884.306op/s 0.16% -0.259 -0.419 0.08% 288.951op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.449µs 36.546µs ± 0.050µs 36.536µs ± 0.025µs 36.566µs 36.629µs 36.684µs 36.861µs 0.89% 1.784 7.475 0.14% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 27129167.294op/s 27363181.035op/s ± 37200.589op/s 27370349.670op/s ± 19013.605op/s 27386477.854op/s 27409478.098op/s 27422236.419op/s 27435411.245op/s 0.24% -1.758 7.288 0.14% 2630.479op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.916µs 46.041µs ± 0.123µs 46.033µs ± 0.034µs 46.063µs 46.124µs 46.167µs 47.621µs 3.45% 10.716 135.417 0.27% 0.009µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20999168.433op/s 21719947.567op/s ± 56344.846op/s 21723380.984op/s ± 16277.923op/s 21740309.348op/s 21758446.320op/s 21771034.363op/s 21779069.250op/s 0.26% -10.535 132.330 0.26% 3984.182op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [536.658µs; 537.068µs] or [-0.038%; +0.038%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1861976.990op/s; 1863396.860op/s] or [-0.038%; +0.038%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [382.185µs; 382.263µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2616003.199op/s; 2616536.617op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [189.916µs; 189.957µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5264360.097op/s; 5265492.765op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.539µs; 36.552µs] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27358025.391op/s; 27368336.678op/s] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [46.024µs; 46.058µs] or [-0.037%; +0.037%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21712138.713op/s; 21727756.421op/s] or [-0.036%; +0.036%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a72a900 1770143452 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 189.050ns 191.782ns ± 2.172ns 191.634ns ± 1.680ns 192.881ns 195.649ns 197.791ns 200.539ns 4.65% 0.884 0.740 1.13% 0.154ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [191.480ns; 192.083ns] or [-0.157%; +0.157%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a72a900 1770143452 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.894µs 3.912µs ± 0.002µs 3.911µs ± 0.001µs 3.913µs 3.915µs 3.917µs 3.917µs 0.14% -1.523 11.663 0.06% 0.000µs 1 200
credit_card/is_card_number/ throughput 255311314.055op/s 255642072.108op/s ± 159974.554op/s 255659682.468op/s ± 92913.054op/s 255738360.755op/s 255829045.288op/s 255884873.194op/s 256792472.215op/s 0.44% 1.544 11.841 0.06% 11311.909op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 77.070µs 77.499µs ± 0.318µs 77.420µs ± 0.230µs 77.684µs 78.152µs 78.444µs 78.665µs 1.61% 0.995 0.994 0.41% 0.023µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12712074.855op/s 12903562.524op/s ± 52782.830op/s 12916582.309op/s ± 38390.140op/s 12949425.367op/s 12968945.250op/s 12973293.791op/s 12975159.911op/s 0.45% -0.970 0.919 0.41% 3732.310op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 70.636µs 71.110µs ± 0.303µs 71.033µs ± 0.234µs 71.328µs 71.643µs 71.802µs 71.947µs 1.29% 0.423 -0.581 0.42% 0.021µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13899195.542op/s 14062985.086op/s ± 59768.047op/s 14078057.237op/s ± 46309.759op/s 14105084.884op/s 14146281.187op/s 14153612.476op/s 14157143.896op/s 0.56% -0.407 -0.604 0.42% 4226.239op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.892µs 3.912µs ± 0.003µs 3.913µs ± 0.002µs 3.914µs 3.916µs 3.917µs 3.921µs 0.20% -2.233 17.563 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255064084.851op/s 255594662.640op/s ± 172756.136op/s 255580448.107op/s ± 107852.289op/s 255697798.026op/s 255810279.894op/s 255878872.714op/s 256955336.619op/s 0.54% 2.262 17.837 0.07% 12215.704op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 67.423µs 67.846µs ± 0.268µs 67.812µs ± 0.194µs 68.023µs 68.305µs 68.504µs 68.565µs 1.11% 0.386 -0.460 0.39% 0.019µs 1 200
credit_card/is_card_number/378282246310005 throughput 14584739.455op/s 14739482.828op/s ± 58231.778op/s 14746632.674op/s ± 41981.306op/s 14775848.980op/s 14822998.401op/s 14826341.072op/s 14831787.487op/s 0.58% -0.369 -0.482 0.39% 4117.609op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 44.682µs 45.140µs ± 0.169µs 45.154µs ± 0.113µs 45.257µs 45.407µs 45.481µs 45.527µs 0.83% -0.203 -0.391 0.37% 0.012µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21964853.069op/s 22153660.711op/s ± 83218.797op/s 22146336.127op/s ± 55332.281op/s 22204159.477op/s 22295219.317op/s 22339129.587op/s 22380291.149op/s 1.06% 0.221 -0.382 0.37% 5884.458op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.029µs 6.035µs ± 0.006µs 6.034µs ± 0.002µs 6.037µs 6.041µs 6.046µs 6.106µs 1.19% 8.119 91.308 0.10% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 163774082.302op/s 165699746.667op/s ± 165457.949op/s 165724651.542op/s ± 65231.451op/s 165780905.228op/s 165829414.935op/s 165869142.073op/s 165878003.686op/s 0.09% -8.036 90.001 0.10% 11699.644op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.892µs 3.912µs ± 0.003µs 3.911µs ± 0.001µs 3.913µs 3.917µs 3.920µs 3.922µs 0.26% -0.649 9.646 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254994684.702op/s 255623965.157op/s ± 199015.777op/s 255658902.838op/s ± 96150.404op/s 255744058.312op/s 255838404.742op/s 255920426.849op/s 256954761.491op/s 0.51% 0.676 9.807 0.08% 14072.541op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.234µs 65.507µs ± 0.222µs 65.559µs ± 0.074µs 65.624µs 65.716µs 65.766µs 65.782µs 0.34% -2.696 9.046 0.34% 0.016µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15201705.770op/s 15265682.611op/s ± 52243.338op/s 15253405.423op/s ± 17306.731op/s 15272247.654op/s 15370429.904op/s 15480364.299op/s 15568034.856op/s 2.06% 2.734 9.314 0.34% 3694.162op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 52.943µs 53.019µs ± 0.033µs 53.015µs ± 0.025µs 53.044µs 53.078µs 53.089µs 53.109µs 0.18% 0.297 -0.473 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18829369.153op/s 18861267.255op/s ± 11718.323op/s 18862672.660op/s ± 9067.853op/s 18870463.008op/s 18878711.233op/s 18884302.751op/s 18888100.497op/s 0.13% -0.294 -0.474 0.06% 828.611op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.900µs 3.913µs ± 0.003µs 3.912µs ± 0.002µs 3.915µs 3.919µs 3.920µs 3.921µs 0.22% 0.157 1.766 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255024999.830op/s 255564949.915op/s ± 189180.243op/s 255592702.184op/s ± 117252.327op/s 255695269.642op/s 255815601.847op/s 255910758.740op/s 256421441.726op/s 0.32% -0.149 1.784 0.07% 13377.063op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 49.754µs 49.896µs ± 0.085µs 49.905µs ± 0.077µs 49.968µs 50.016µs 50.036µs 50.068µs 0.33% -0.029 -1.445 0.17% 0.006µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19972799.234op/s 20041938.718op/s ± 34259.553op/s 20037972.471op/s ± 30915.735op/s 20071244.931op/s 20092065.143op/s 20097219.972op/s 20098904.610op/s 0.30% 0.032 -1.446 0.17% 2422.516op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 44.690µs 45.185µs ± 0.171µs 45.195µs ± 0.117µs 45.307µs 45.439µs 45.504µs 45.535µs 0.75% -0.337 -0.265 0.38% 0.012µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21961044.076op/s 22131497.259op/s ± 83979.594op/s 22126354.646op/s ± 57133.211op/s 22189519.337op/s 22287009.294op/s 22333034.297op/s 22376375.064op/s 1.13% 0.355 -0.244 0.38% 5938.254op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.028µs 6.039µs ± 0.014µs 6.036µs ± 0.003µs 6.039µs 6.049µs 6.103µs 6.170µs 2.20% 5.834 41.827 0.24% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 162085921.581op/s 165600411.215op/s ± 387165.229op/s 165659562.560op/s ± 93525.772op/s 165760610.368op/s 165830660.466op/s 165863100.321op/s 165900822.946op/s 0.15% -5.766 40.872 0.23% 27376.716op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.911µs; 3.912µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/ throughput [255619901.173op/s; 255664243.042op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [77.455µs; 77.543µs] or [-0.057%; +0.057%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12896247.332op/s; 12910877.717op/s] or [-0.057%; +0.057%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [71.068µs; 71.152µs] or [-0.059%; +0.059%] None None None
credit_card/is_card_number/ 378282246310005 throughput [14054701.809op/s; 14071268.362op/s] or [-0.059%; +0.059%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.913µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255570720.301op/s; 255618604.979op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [67.809µs; 67.883µs] or [-0.055%; +0.055%] None None None
credit_card/is_card_number/378282246310005 throughput [14731412.464op/s; 14747553.192op/s] or [-0.055%; +0.055%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.116µs; 45.163µs] or [-0.052%; +0.052%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [22142127.387op/s; 22165194.036op/s] or [-0.052%; +0.052%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.034µs; 6.036µs] or [-0.014%; +0.014%] None None None
credit_card/is_card_number/x371413321323331 throughput [165676815.787op/s; 165722677.548op/s] or [-0.014%; +0.014%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.912µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ throughput [255596383.484op/s; 255651546.829op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.476µs; 65.538µs] or [-0.047%; +0.047%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15258442.187op/s; 15272923.036op/s] or [-0.047%; +0.047%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.014µs; 53.023µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18859643.208op/s; 18862891.302op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.913µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255538731.352op/s; 255591168.477op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [49.884µs; 49.907µs] or [-0.024%; +0.024%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [20037190.673op/s; 20046686.762op/s] or [-0.024%; +0.024%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.161µs; 45.209µs] or [-0.053%; +0.053%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [22119858.495op/s; 22143136.023op/s] or [-0.053%; +0.053%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.037µs; 6.041µs] or [-0.033%; +0.033%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165546753.838op/s; 165654068.592op/s] or [-0.032%; +0.032%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a72a900 1770143452 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 47.871ms 48.165ms ± 1.150ms 48.016ms ± 0.062ms 48.078ms 48.177ms 55.599ms 58.935ms 22.74% 8.094 65.554 2.38% 0.081ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [48.005ms; 48.324ms] or [-0.331%; +0.331%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a72a900 1770143452 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.597µs 25.331µs ± 9.931µs 17.985µs ± 0.259µs 33.949µs 43.517µs 51.704µs 72.447µs 302.81% 1.170 1.457 39.10% 0.702µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [23.955µs; 26.708µs] or [-5.433%; +5.433%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a72a900 1770143452 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 12.637ms 12.952ms ± 0.096ms 12.972ms ± 0.043ms 13.009ms 13.078ms 13.114ms 13.177ms 1.58% -1.095 1.334 0.74% 0.007ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [12.939ms; 12.965ms] or [-0.102%; +0.102%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a72a900 1770143452 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 160.468µs 162.074µs ± 0.352µs 162.027µs ± 0.116µs 162.169µs 162.656µs 162.933µs 164.753µs 1.68% 2.225 18.494 0.22% 0.025µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [162.026µs; 162.123µs] or [-0.030%; +0.030%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a72a900 1770143452 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.975µs 5.052µs ± 0.041µs 5.036µs ± 0.024µs 5.088µs 5.124µs 5.127µs 5.128µs 1.84% 0.340 -1.077 0.82% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.046µs; 5.058µs] or [-0.113%; +0.113%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a72a900 1770143452 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.401µs 2.428µs ± 0.014µs 2.429µs ± 0.011µs 2.438µs 2.452µs 2.460µs 2.467µs 1.55% 0.174 -0.611 0.59% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.426µs; 2.430µs] or [-0.082%; +0.082%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a72a900 1770143452 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.574ms 14.641ms ± 0.031ms 14.638ms ± 0.015ms 14.654ms 14.680ms 14.771ms 14.813ms 1.20% 2.063 7.896 0.21% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.637ms; 14.646ms] or [-0.029%; +0.029%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a72a900 1770143452 ekump/APMSP-2547-add-file-attribute-to-junit
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 533.676µs 534.299µs ± 0.455µs 534.228µs ± 0.171µs 534.399µs 534.886µs 535.836µs 538.746µs 0.85% 5.295 45.346 0.08% 0.032µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [534.235µs; 534.362µs] or [-0.012%; +0.012%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link
Copy Markdown

codecov-commenter commented Jan 28, 2026

Codecov Report

❌ Patch coverage is 72.79152% with 77 lines in your changes missing coverage. Please review.
✅ Project coverage is 71.09%. Comparing base (8fe097c) to head (a72a900).

Additional details and impacted files
@@           Coverage Diff            @@
##             main    #1487    +/-   ##
========================================
  Coverage   71.09%   71.09%            
========================================
  Files         422      424     +2     
  Lines       68933    69216   +283     
========================================
+ Hits        49005    49207   +202     
- Misses      19928    20009    +81     
Components Coverage Δ
libdd-crashtracker 62.21% <ø> (ø)
libdd-crashtracker-ffi 16.21% <ø> (ø)
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 86.84% <ø> (ø)
libdd-data-pipeline-ffi 78.57% <ø> (ø)
libdd-common 80.97% <ø> (ø)
libdd-common-ffi 74.54% <ø> (ø)
libdd-telemetry 59.82% <ø> (+0.03%) ⬆️
libdd-telemetry-ffi 21.17% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.60% <ø> (-0.11%) ⬇️
libdd-profiling 81.49% <ø> (ø)
libdd-profiling-ffi 64.71% <ø> (ø)
datadog-sidecar 34.94% <ø> (ø)
datdog-sidecar-ffi 10.25% <ø> (ø)
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 93.43% <ø> (ø)
libdd-trace-normalization 82.33% <ø> (ø)
libdd-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 61.18% <ø> (ø)
libdd-trace-utils 89.45% <ø> (ø)
datadog-tracer-flare 63.49% <ø> (ø)
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@dd-octo-sts
Copy link
Copy Markdown
Contributor

dd-octo-sts Bot commented Jan 28, 2026

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 91.81 MB 91.81 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.44 MB 8.44 MB 0% (0 B) 👌
aarch64-apple-darwin
Artifact Baseline Commit Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a 62.80 MB 62.80 MB 0% (0 B) 👌
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib 9.48 MB 9.48 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 10.76 MB 10.76 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 106.15 MB 106.15 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 25.26 MB 25.26 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 75.59 KB 75.59 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 167.23 MB 167.20 MB --.01% (-24.00 KB) 💪
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 847.79 MB 847.79 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 9.61 MB 9.61 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 75.59 KB 75.59 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 23.10 MB 23.10 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 48.39 MB 48.39 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 21.33 MB 21.33 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 76.76 KB 76.76 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 171.34 MB 171.33 MB -0% (-16.00 KB) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 834.55 MB 834.55 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 7.27 MB 7.27 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 76.76 KB 76.76 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 24.71 MB 24.71 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 44.10 MB 44.10 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 80.27 MB 80.27 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 9.90 MB 9.90 MB 0% (0 B) 👌
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 64.68 MB 64.68 MB 0% (0 B) 👌
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 10.51 MB 10.51 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 100.11 MB 100.11 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.48 MB 11.48 MB 0% (0 B) 👌

@ekump ekump force-pushed the ekump/APMSP-2547-add-file-attribute-to-junit branch 2 times, most recently from 42d12e2 to 7dc428a Compare January 30, 2026 22:08
@ekump ekump changed the title WIP: add file attribute to junit.xml output ci: add script to add file attribute to junit.xml Jan 30, 2026
@ekump ekump force-pushed the ekump/APMSP-2547-add-file-attribute-to-junit branch from 7dc428a to 06d7e4f Compare January 30, 2026 22:32
@ekump ekump marked this pull request as ready for review January 30, 2026 22:32
@ekump ekump requested review from a team as code owners January 30, 2026 22:32
@ekump ekump added the run-macos-tests Run macos tests in gitlab label Jan 30, 2026
@ekump ekump force-pushed the ekump/APMSP-2547-add-file-attribute-to-junit branch from 06d7e4f to a72a900 Compare February 3, 2026 18:31
@ekump
Copy link
Copy Markdown
Contributor Author

ekump commented Feb 3, 2026

/merge

@gh-worker-devflow-routing-ef8351
Copy link
Copy Markdown

gh-worker-devflow-routing-ef8351 Bot commented Feb 3, 2026

View all feedbacks in Devflow UI.

2026-02-03 19:02:44 UTC ℹ️ Start processing command /merge


2026-02-03 19:02:50 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in main is approximately 33m (p90).


2026-02-03 19:31:36 UTC ℹ️ MergeQueue: This merge request was merged

@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d Bot merged commit 208ead3 into main Feb 3, 2026
67 checks passed
@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d Bot deleted the ekump/APMSP-2547-add-file-attribute-to-junit branch February 3, 2026 19:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants