chore(datadog-tracer-flare): remove unnecessary features/deps#1761
Conversation
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #1761 +/- ##
==========================================
- Coverage 71.47% 71.43% -0.04%
==========================================
Files 430 430
Lines 64132 64152 +20
==========================================
- Hits 45836 45830 -6
- Misses 18296 18322 +26
🚀 New features to boost your workflow:
|
BenchmarksComparisonBenchmark execution time: 2026-03-18 18:02:17 Comparing candidate commit 1510ec8 in PR branch Found 12 performance improvements and 0 performance regressions! Performance is the same for 47 metrics, 2 unstable metrics.
|
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 1510ec8 | 1773855880 | brettlangdon/reduce.tracer.flare.crate.size |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 17.672µs | 25.296µs ± 9.464µs | 18.060µs ± 0.279µs | 33.766µs | 42.668µs | 47.402µs | 67.857µs | 275.73% | 0.977 | 0.597 | 37.32% | 0.669µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [23.984µs; 26.607µs] or [-5.185%; +5.185%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 1510ec8 | 1773855880 | brettlangdon/reduce.tracer.flare.crate.size |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 86.142µs | 86.326µs ± 0.196µs | 86.299µs ± 0.044µs | 86.353µs | 86.439µs | 86.604µs | 88.233µs | 2.24% | 7.775 | 69.265 | 0.23% | 0.014µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [86.299µs; 86.353µs] or [-0.032%; +0.032%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 1510ec8 | 1773855880 | brettlangdon/reduce.tracer.flare.crate.size |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.296µs | 2.364µs ± 0.020µs | 2.364µs ± 0.010µs | 2.378µs | 2.387µs | 2.392µs | 2.397µs | 1.40% | -1.562 | 3.158 | 0.83% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.361µs; 2.366µs] or [-0.115%; +0.115%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 1510ec8 | 1773855880 | brettlangdon/reduce.tracer.flare.crate.size |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 33.593µs | 34.233µs ± 1.108µs | 33.716µs ± 0.049µs | 33.804µs | 36.535µs | 36.933µs | 37.745µs | 11.95% | 1.704 | 1.092 | 3.23% | 0.078µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [34.079µs; 34.386µs] or [-0.449%; +0.449%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 1510ec8 | 1773855880 | brettlangdon/reduce.tracer.flare.crate.size |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 237.333ns | 249.701ns ± 13.661ns | 243.925ns ± 4.964ns | 252.145ns | 283.847ns | 287.390ns | 288.798ns | 18.40% | 1.481 | 1.145 | 5.46% | 0.966ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [247.807ns; 251.594ns] or [-0.758%; +0.758%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 1510ec8 | 1773855880 | brettlangdon/reduce.tracer.flare.crate.size |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | 4.963µs | 5.037µs ± 0.041µs | 5.043µs ± 0.040µs | 5.064µs | 5.092µs | 5.095µs | 5.097µs | 1.07% | -0.320 | -1.211 | 0.82% | 0.003µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | [5.031µs; 5.043µs] or [-0.114%; +0.114%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 1510ec8 | 1773855880 | brettlangdon/reduce.tracer.flare.crate.size |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample_timestamped_x1000 | execution_time | 4.198ms | 4.205ms ± 0.009ms | 4.204ms ± 0.002ms | 4.206ms | 4.210ms | 4.217ms | 4.320ms | 2.77% | 11.086 | 140.386 | 0.21% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample_timestamped_x1000 | execution_time | [4.204ms; 4.206ms] or [-0.029%; +0.029%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 1510ec8 | 1773855880 | brettlangdon/reduce.tracer.flare.crate.size |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | 14.403ms | 14.475ms ± 0.034ms | 14.469ms ± 0.017ms | 14.486ms | 14.539ms | 14.611ms | 14.625ms | 1.07% | 1.743 | 4.618 | 0.23% | 0.002ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | [14.470ms; 14.479ms] or [-0.032%; +0.032%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 1510ec8 | 1773855880 | brettlangdon/reduce.tracer.flare.crate.size |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 3.897µs | 3.914µs ± 0.003µs | 3.914µs ± 0.002µs | 3.916µs | 3.919µs | 3.921µs | 3.921µs | 0.18% | -0.775 | 5.558 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 255009096.556op/s | 255469198.374op/s ± 192041.447op/s | 255479121.890op/s ± 128138.640op/s | 255606171.949op/s | 255712604.825op/s | 255771562.931op/s | 256638563.371op/s | 0.45% | 0.790 | 5.656 | 0.07% | 13579.381op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 79.383µs | 80.019µs ± 0.096µs | 80.015µs ± 0.058µs | 80.080µs | 80.150µs | 80.213µs | 80.422µs | 0.51% | -0.952 | 9.815 | 0.12% | 0.007µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 12434431.997op/s | 12497019.634op/s ± 14964.201op/s | 12497656.066op/s ± 9117.604op/s | 12505515.871op/s | 12517493.259op/s | 12524421.683op/s | 12597139.059op/s | 0.80% | 0.991 | 10.033 | 0.12% | 1058.129op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 67.828µs | 67.927µs ± 0.074µs | 67.917µs ± 0.030µs | 67.947µs | 68.041µs | 68.125µs | 68.630µs | 1.05% | 4.607 | 38.368 | 0.11% | 0.005µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 14570974.874op/s | 14721712.223op/s ± 16060.522op/s | 14723843.131op/s ± 6412.143op/s | 14730176.386op/s | 14738425.952op/s | 14740877.423op/s | 14743159.224op/s | 0.13% | -4.545 | 37.566 | 0.11% | 1135.650op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 3.902µs | 3.914µs ± 0.003µs | 3.914µs ± 0.002µs | 3.916µs | 3.919µs | 3.920µs | 3.934µs | 0.50% | 1.253 | 9.879 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 254206040.413op/s | 255475911.565op/s ± 191309.634op/s | 255489639.895op/s ± 118685.323op/s | 255602720.347op/s | 255722701.242op/s | 255776830.081op/s | 256307059.669op/s | 0.32% | -1.230 | 9.754 | 0.07% | 13527.634op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 64.615µs | 64.773µs ± 0.091µs | 64.763µs ± 0.068µs | 64.835µs | 64.929µs | 64.988µs | 65.027µs | 0.41% | 0.469 | -0.513 | 0.14% | 0.006µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 15378184.785op/s | 15438660.099op/s ± 21710.073op/s | 15440883.036op/s ± 16185.817op/s | 15455416.945op/s | 15469145.629op/s | 15474372.598op/s | 15476216.151op/s | 0.23% | -0.463 | -0.521 | 0.14% | 1535.134op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 45.475µs | 45.758µs ± 0.089µs | 45.772µs ± 0.059µs | 45.824µs | 45.887µs | 45.922µs | 45.941µs | 0.37% | -0.552 | 0.111 | 0.19% | 0.006µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 21767217.795op/s | 21854228.820op/s ± 42647.769op/s | 21847635.587op/s ± 28007.178op/s | 21882456.291op/s | 21933137.464op/s | 21968461.681op/s | 21990168.487op/s | 0.65% | 0.563 | 0.130 | 0.19% | 3015.653op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 6.550µs | 6.619µs ± 0.019µs | 6.622µs ± 0.013µs | 6.635µs | 6.642µs | 6.651µs | 6.656µs | 0.52% | -0.669 | 0.099 | 0.28% | 0.001µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 150237967.806op/s | 151079502.222op/s ± 428090.276op/s | 151012502.722op/s ± 299304.544op/s | 151335685.039op/s | 151831514.762op/s | 152153206.712op/s | 152668736.288op/s | 1.10% | 0.683 | 0.135 | 0.28% | 30270.554op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 3.896µs | 3.914µs ± 0.003µs | 3.914µs ± 0.001µs | 3.916µs | 3.920µs | 3.923µs | 3.923µs | 0.23% | -0.441 | 8.277 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 254889252.915op/s | 255461560.561op/s ± 192863.768op/s | 255471020.949op/s ± 93877.203op/s | 255574084.299op/s | 255682733.970op/s | 255746245.641op/s | 256694845.811op/s | 0.48% | 0.464 | 8.402 | 0.08% | 13637.528op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 65.167µs | 65.658µs ± 0.122µs | 65.690µs ± 0.059µs | 65.740µs | 65.798µs | 65.847µs | 65.897µs | 0.32% | -1.195 | 1.580 | 0.19% | 0.009µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 15175113.370op/s | 15230481.368op/s ± 28411.938op/s | 15223056.583op/s ± 13757.240op/s | 15244396.839op/s | 15287221.874op/s | 15313239.974op/s | 15345117.715op/s | 0.80% | 1.207 | 1.622 | 0.19% | 2009.027op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 53.349µs | 53.421µs ± 0.033µs | 53.419µs ± 0.021µs | 53.440µs | 53.481µs | 53.504µs | 53.537µs | 0.22% | 0.540 | 0.400 | 0.06% | 0.002µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 18678698.663op/s | 18719261.798op/s ± 11583.349op/s | 18719970.256op/s ± 7515.048op/s | 18727513.753op/s | 18737109.081op/s | 18740442.412op/s | 18744351.768op/s | 0.13% | -0.536 | 0.393 | 0.06% | 819.066op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 3.893µs | 3.915µs ± 0.003µs | 3.915µs ± 0.001µs | 3.916µs | 3.918µs | 3.920µs | 3.921µs | 0.16% | -2.790 | 24.572 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 255029419.715op/s | 255445146.072op/s ± 167754.575op/s | 255433076.535op/s ± 82124.885op/s | 255523163.179op/s | 255648444.827op/s | 255720560.287op/s | 256873166.888op/s | 0.56% | 2.827 | 24.943 | 0.07% | 11862.040op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 50.144µs | 50.223µs ± 0.035µs | 50.222µs ± 0.021µs | 50.243µs | 50.278µs | 50.308µs | 50.344µs | 0.24% | 0.336 | 0.256 | 0.07% | 0.002µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 19863182.400op/s | 19911374.595op/s ± 13713.444op/s | 19911611.362op/s ± 8454.760op/s | 19920798.891op/s | 19931863.622op/s | 19940105.805op/s | 19942473.940op/s | 0.15% | -0.332 | 0.249 | 0.07% | 969.687op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 45.541µs | 45.738µs ± 0.080µs | 45.743µs ± 0.057µs | 45.798µs | 45.865µs | 45.891µs | 45.951µs | 0.45% | -0.177 | -0.496 | 0.17% | 0.006µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 21762305.540op/s | 21863760.293op/s ± 38219.042op/s | 21861313.128op/s ± 27241.211op/s | 21888866.242op/s | 21930615.031op/s | 21942744.181op/s | 21958087.926op/s | 0.44% | 0.184 | -0.495 | 0.17% | 2702.494op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 6.566µs | 6.616µs ± 0.018µs | 6.617µs ± 0.014µs | 6.632µs | 6.639µs | 6.643µs | 6.654µs | 0.55% | -0.596 | -0.335 | 0.27% | 0.001µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 150293195.818op/s | 151138739.934op/s ± 405215.405op/s | 151118949.051op/s ± 317667.838op/s | 151380494.804op/s | 151947498.779op/s | 152099258.085op/s | 152306114.769op/s | 0.79% | 0.606 | -0.319 | 0.27% | 28653.056op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [3.914µs; 3.915µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/ | throughput | [255442583.276op/s; 255495813.471op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [80.006µs; 80.032µs] or [-0.017%; +0.017%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [12494945.739op/s; 12499093.528op/s] or [-0.017%; +0.017%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [67.917µs; 67.937µs] or [-0.015%; +0.015%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [14719486.389op/s; 14723938.057op/s] or [-0.015%; +0.015%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [3.914µs; 3.915µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [255449397.890op/s; 255502425.240op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [64.760µs; 64.785µs] or [-0.020%; +0.020%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [15435651.291op/s; 15441668.906op/s] or [-0.019%; +0.019%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [45.746µs; 45.770µs] or [-0.027%; +0.027%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [21848318.249op/s; 21860139.391op/s] or [-0.027%; +0.027%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [6.616µs; 6.622µs] or [-0.039%; +0.039%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [151020173.027op/s; 151138831.417op/s] or [-0.039%; +0.039%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [3.914µs; 3.915µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [255434831.498op/s; 255488289.625op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [65.641µs; 65.675µs] or [-0.026%; +0.026%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [15226543.747op/s; 15234418.989op/s] or [-0.026%; +0.026%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [53.416µs; 53.426µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [18717656.457op/s; 18720867.139op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [3.914µs; 3.915µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [255421896.901op/s; 255468395.243op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [50.218µs; 50.227µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [19909474.043op/s; 19913275.146op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [45.727µs; 45.749µs] or [-0.024%; +0.024%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [21858463.501op/s; 21869057.084op/s] or [-0.024%; +0.024%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [6.614µs; 6.619µs] or [-0.037%; +0.037%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [151082580.976op/s; 151194898.892op/s] or [-0.037%; +0.037%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 1510ec8 | 1773855880 | brettlangdon/reduce.tracer.flare.crate.size |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | 190.929ns | 193.317ns ± 1.802ns | 193.111ns ± 1.334ns | 194.239ns | 196.559ns | 198.742ns | 199.929ns | 3.53% | 0.854 | 0.471 | 0.93% | 0.127ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | [193.068ns; 193.567ns] or [-0.129%; +0.129%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 1510ec8 | 1773855880 | brettlangdon/reduce.tracer.flare.crate.size |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample2_frames_x1000 | execution_time | 746.999µs | 747.738µs ± 0.434µs | 747.687µs ± 0.286µs | 747.981µs | 748.522µs | 749.123µs | 749.236µs | 0.21% | 0.930 | 1.128 | 0.06% | 0.031µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample2_frames_x1000 | execution_time | [747.678µs; 747.798µs] or [-0.008%; +0.008%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 1510ec8 | 1773855880 | brettlangdon/reduce.tracer.flare.crate.size |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 186.037µs | 186.801µs ± 0.717µs | 186.625µs ± 0.251µs | 186.848µs | 188.576µs | 189.290µs | 190.352µs | 2.00% | 2.374 | 6.067 | 0.38% | 0.051µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 5253434.203op/s | 5353375.805op/s ± 20371.469op/s | 5358326.355op/s ± 7211.456op/s | 5365703.010op/s | 5371275.379op/s | 5372749.240op/s | 5375271.199op/s | 0.32% | -2.346 | 5.902 | 0.38% | 1440.480op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 17.819µs | 17.899µs ± 0.041µs | 17.895µs ± 0.026µs | 17.925µs | 17.956µs | 17.991µs | 18.174µs | 1.56% | 1.655 | 9.529 | 0.23% | 0.003µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 55022184.575op/s | 55870800.356op/s ± 126028.003op/s | 55882174.118op/s ± 81653.510op/s | 55954742.488op/s | 56047893.937op/s | 56102026.500op/s | 56118892.826op/s | 0.42% | -1.597 | 9.064 | 0.23% | 8911.526op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 10.190µs | 10.400µs ± 0.184µs | 10.305µs ± 0.043µs | 10.624µs | 10.723µs | 10.758µs | 10.793µs | 4.74% | 0.892 | -0.981 | 1.77% | 0.013µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 92654076.007op/s | 96186864.657op/s ± 1675871.347op/s | 97043838.978op/s ± 403448.271op/s | 97379872.903op/s | 97725375.492op/s | 97876580.274op/s | 98140096.475op/s | 1.13% | -0.881 | -1.000 | 1.74% | 118501.999op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [186.701µs; 186.900µs] or [-0.053%; +0.053%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [5350552.515op/s; 5356199.095op/s] or [-0.053%; +0.053%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [17.893µs; 17.904µs] or [-0.031%; +0.031%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [55853334.087op/s; 55888266.625op/s] or [-0.031%; +0.031%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [10.374µs; 10.425µs] or [-0.245%; +0.245%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [95954605.006op/s; 96419124.308op/s] or [-0.241%; +0.241%] | None | None | None |
Group 13
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 1510ec8 | 1773855880 | brettlangdon/reduce.tracer.flare.crate.size |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 48.129ms | 48.557ms ± 1.370ms | 48.362ms ± 0.063ms | 48.459ms | 48.628ms | 57.019ms | 60.996ms | 26.12% | 8.147 | 66.205 | 2.81% | 0.097ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [48.367ms; 48.747ms] or [-0.391%; +0.391%] | None | None | None |
Group 14
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 1510ec8 | 1773855880 | brettlangdon/reduce.tracer.flare.crate.size |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| receiver_entry_point/report/2598 | execution_time | 3.407ms | 3.445ms ± 0.032ms | 3.434ms ± 0.015ms | 3.460ms | 3.498ms | 3.526ms | 3.683ms | 7.23% | 2.650 | 14.388 | 0.92% | 0.002ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| receiver_entry_point/report/2598 | execution_time | [3.440ms; 3.449ms] or [-0.128%; +0.128%] | None | None | None |
Group 15
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 1510ec8 | 1773855880 | brettlangdon/reduce.tracer.flare.crate.size |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | 144.423µs | 146.516µs ± 1.712µs | 146.208µs ± 0.558µs | 146.869µs | 148.428µs | 154.086µs | 161.701µs | 10.60% | 5.229 | 37.841 | 1.17% | 0.121µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | [146.278µs; 146.753µs] or [-0.162%; +0.162%] | None | None | None |
Group 16
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 1510ec8 | 1773855880 | brettlangdon/reduce.tracer.flare.crate.size |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 12.930ms | 12.953ms ± 0.014ms | 12.951ms ± 0.009ms | 12.960ms | 12.978ms | 12.987ms | 13.042ms | 0.71% | 1.587 | 6.574 | 0.11% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [12.951ms; 12.955ms] or [-0.015%; +0.015%] | None | None | None |
Group 17
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 1510ec8 | 1773855880 | brettlangdon/reduce.tracer.flare.crate.size |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 161.715µs | 162.215µs ± 0.581µs | 162.135µs ± 0.117µs | 162.248µs | 162.635µs | 163.055µs | 169.630µs | 4.62% | 10.591 | 131.655 | 0.36% | 0.041µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [162.134µs; 162.295µs] or [-0.050%; +0.050%] | None | None | None |
Group 18
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 1510ec8 | 1773855880 | brettlangdon/reduce.tracer.flare.crate.size |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 1.178µs | 3.155µs ± 1.406µs | 2.986µs ± 0.024µs | 3.005µs | 3.401µs | 13.642µs | 14.928µs | 400.03% | 7.498 | 56.881 | 44.46% | 0.099µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [2.960µs; 3.350µs] or [-6.177%; +6.177%] | None | None | None |
Group 19
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 1510ec8 | 1773855880 | brettlangdon/reduce.tracer.flare.crate.size |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 495.265µs | 496.058µs ± 0.472µs | 496.004µs ± 0.264µs | 496.272µs | 496.718µs | 497.361µs | 499.591µs | 0.72% | 2.608 | 15.225 | 0.09% | 0.033µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 2001635.781op/s | 2015896.632op/s ± 1913.779op/s | 2016114.693op/s ± 1071.619op/s | 2017143.422op/s | 2018188.023op/s | 2018804.179op/s | 2019122.662op/s | 0.15% | -2.578 | 14.947 | 0.09% | 135.325op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 369.592µs | 370.355µs ± 0.292µs | 370.354µs ± 0.212µs | 370.564µs | 370.846µs | 370.908µs | 371.325µs | 0.26% | 0.023 | -0.205 | 0.08% | 0.021µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2693057.695op/s | 2700111.615op/s ± 2130.956op/s | 2700116.493op/s ± 1549.672op/s | 2701654.264op/s | 2703655.463op/s | 2704660.629op/s | 2705687.543op/s | 0.21% | -0.019 | -0.208 | 0.08% | 150.681op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 168.655µs | 168.906µs ± 0.126µs | 168.892µs ± 0.085µs | 168.984µs | 169.107µs | 169.268µs | 169.349µs | 0.27% | 0.543 | 0.487 | 0.07% | 0.009µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5904966.296op/s | 5920448.924op/s ± 4422.946op/s | 5920953.345op/s ± 2984.260op/s | 5923711.550op/s | 5926951.346op/s | 5928892.787op/s | 5929251.618op/s | 0.14% | -0.538 | 0.477 | 0.07% | 312.750op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 36.795µs | 36.976µs ± 0.090µs | 36.990µs ± 0.064µs | 37.047µs | 37.108µs | 37.132µs | 37.174µs | 0.50% | -0.230 | -0.936 | 0.24% | 0.006µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 26900807.862op/s | 27044972.577op/s ± 65966.895op/s | 27034138.863op/s ± 47054.934op/s | 27097030.335op/s | 27156868.861op/s | 27169801.032op/s | 27177733.917op/s | 0.53% | 0.237 | -0.935 | 0.24% | 4664.564op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 46.183µs | 46.303µs ± 0.079µs | 46.291µs ± 0.037µs | 46.333µs | 46.414µs | 46.481µs | 47.078µs | 1.70% | 5.017 | 45.018 | 0.17% | 0.006µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 21241138.174op/s | 21596913.176op/s ± 36508.867op/s | 21602458.643op/s ± 17260.458op/s | 21618570.638op/s | 21633947.380op/s | 21645465.617op/s | 21653193.046op/s | 0.23% | -4.907 | 43.556 | 0.17% | 2581.567op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [495.992µs; 496.123µs] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [2015631.401op/s; 2016161.864op/s] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [370.315µs; 370.396µs] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2699816.285op/s; 2700406.945op/s] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [168.889µs; 168.924µs] or [-0.010%; +0.010%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5919835.946op/s; 5921061.902op/s] or [-0.010%; +0.010%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [36.963µs; 36.988µs] or [-0.034%; +0.034%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [27035830.200op/s; 27054114.954op/s] or [-0.034%; +0.034%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [46.292µs; 46.314µs] or [-0.024%; +0.024%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [21591853.398op/s; 21601972.954op/s] or [-0.023%; +0.023%] | None | None | None |
Group 20
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 1510ec8 | 1773855880 | brettlangdon/reduce.tracer.flare.crate.size |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample_frames_x1000 | execution_time | 4.129ms | 4.134ms ± 0.002ms | 4.133ms ± 0.001ms | 4.135ms | 4.137ms | 4.139ms | 4.147ms | 0.33% | 1.558 | 7.246 | 0.05% | 0.000ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample_frames_x1000 | execution_time | [4.133ms; 4.134ms] or [-0.007%; +0.007%] | None | None | None |
Baseline
Omitted due to size.
Artifact Size Benchmark Reportaarch64-alpine-linux-musl
aarch64-unknown-linux-gnu
libdatadog-x64-windows
libdatadog-x86-windows
x86_64-alpine-linux-musl
x86_64-unknown-linux-gnu
|
…-unprocessed * 'main' of github.com:DataDog/libdatadog: feat(sidecar): add thread mode as fallback connection for restricted environments (#1447) feat(profiling-ffi): ProfilesDictionary_insert_strs (#1764) chore(release): merge release branch to main (#1760) fix(libdd-crashtracker-ffi)!: add missing fields for endpoint configuration (#1758) ci: prevent running macos tests on release branches (#1765) chore(datadog-tracer-flare): remove unnecessary features/deps (#1761) fix(profiling-ffi): Windows extern statics need __declspec(dllimport) (#1468) feat(profiling): thread id/name as well-known strs (#1757) ci: switch to ephemeral branches (#1731) chore(crashtracker): use weaker mem ordering for OP_COUNTERS (#1744) refactor(trace-utils)!: change header name type to accept dynamic values (#1722)
# What does this PR do? Only included the necessary compression features used by the crate. # Motivation We have determined that adding tracer flare to dd-trace-py was the primary cause that pushed the library size limit over what is acceptable for datadog-lambda-python. We found that `zip` was including all compression methods by default which take up a lot of space and are unused. ``` # Before ❯ ls -hal target/release/libdatadog_tracer_flare.* -rw-r--r--@ 1 brett.langdon staff 7.3K Mar 18 12:01 target/release/libdatadog_tracer_flare.d -rw-r--r--@ 1 brett.langdon staff 3.6M Mar 18 12:01 target/release/libdatadog_tracer_flare.rlib # After ❯ ls -hal target/release/libdatadog_tracer_flare.* -rw-r--r--@ 1 brett.langdon staff 7.3K Mar 18 12:02 target/release/libdatadog_tracer_flare.d -rw-r--r--@ 1 brett.langdon staff 3.3M Mar 18 12:00 target/release/libdatadog_tracer_flare.rlib ``` # Additional Notes Anything else we should know when reviewing? # How to test the change? Describe here in detail how the change can be validated. Co-authored-by: brett.langdon <[email protected]>
What does this PR do?
Only included the necessary compression features used by the crate.
Motivation
We have determined that adding tracer flare to dd-trace-py was the primary cause that pushed the library size limit over what is acceptable for datadog-lambda-python.
We found that
zipwas including all compression methods by default which take up a lot of space and are unused.Additional Notes
Anything else we should know when reviewing?
How to test the change?
Describe here in detail how the change can be validated.