Skip to content

Implement deadlock watchdog for sidecar#647

Merged
bwoebi merged 2 commits intomainfrom
bob/sidecar-watchdog
Sep 24, 2024
Merged

Implement deadlock watchdog for sidecar#647
bwoebi merged 2 commits intomainfrom
bob/sidecar-watchdog

Conversation

@bwoebi
Copy link
Copy Markdown
Contributor

@bwoebi bwoebi commented Sep 23, 2024

If the sidecar hangs, it can cause every process trying to write to it to be much slower.

Better kill it once in doubt.

@bwoebi bwoebi requested review from a team as code owners September 23, 2024 18:26
@bwoebi bwoebi force-pushed the bob/sidecar-watchdog branch from d0f2361 to 9115d18 Compare September 23, 2024 18:30
@codecov-commenter
Copy link
Copy Markdown

codecov-commenter commented Sep 23, 2024

Codecov Report

Attention: Patch coverage is 0% with 29 lines in your changes missing coverage. Please review.

Project coverage is 73.59%. Comparing base (af3199a) to head (fbdf3c4).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #647      +/-   ##
==========================================
- Coverage   73.64%   73.59%   -0.05%     
==========================================
  Files         255      255              
  Lines       36896    36924      +28     
==========================================
+ Hits        27171    27174       +3     
- Misses       9725     9750      +25     
Components Coverage Δ
crashtracker 20.53% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 91.64% <ø> (ø)
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 83.08% <ø> (ø)
ddcommon-ffi 69.52% <ø> (ø)
ddtelemetry 59.10% <ø> (ø)
ipc 83.58% <ø> (ø)
profiling 84.26% <ø> (ø)
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 39.85% <0.00%> (-0.25%) ⬇️
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 50.36% <ø> (ø)
tinybytes 94.77% <ø> (ø)
trace-mini-agent 72.47% <ø> (ø)
trace-normalization 98.25% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 93.41% <ø> (ø)

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Sep 23, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-09-24 13:42:13

Comparing candidate commit fbdf3c4 in PR branch bob/sidecar-watchdog with baseline commit af3199a in branch main.

Found 0 performance improvements and 2 performance regressions! Performance is the same for 49 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟥 execution_time [+10.802µs; +11.255µs] or [+12.299%; +12.815%]
  • 🟥 throughput [-1291186.486op/s; -1244033.764op/s] or [-11.340%; -10.926%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fbdf3c4 1727184705 bob/sidecar-watchdog
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 138.881µs 139.814µs ± 0.751µs 139.766µs ± 0.156µs 139.906µs 140.277µs 141.080µs 149.376µs 6.88% 10.475 130.378 0.54% 0.053µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [139.710µs; 139.918µs] or [-0.074%; +0.074%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fbdf3c4 1727184705 bob/sidecar-watchdog
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.504µs 3.207µs ± 1.606µs 3.050µs ± 0.026µs 3.075µs 3.145µs 13.778µs 18.953µs 521.33% 8.105 67.287 49.96% 0.114µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.985µs; 3.430µs] or [-6.941%; +6.941%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fbdf3c4 1727184705 bob/sidecar-watchdog
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.583µs 2.663µs ± 0.024µs 2.666µs ± 0.007µs 2.673µs 2.704µs 2.711µs 2.715µs 1.83% -1.158 2.721 0.90% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.660µs; 2.667µs] or [-0.125%; +0.125%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fbdf3c4 1727184705 bob/sidecar-watchdog
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 540.039µs 540.512µs ± 0.237µs 540.462µs ± 0.123µs 540.673µs 540.889µs 541.204µs 541.425µs 0.18% 0.611 0.974 0.04% 0.017µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1846976.603op/s 1850096.463op/s ± 809.716op/s 1850268.095op/s ± 420.459op/s 1850555.446op/s 1851382.310op/s 1851584.932op/s 1851719.402op/s 0.08% -0.608 0.966 0.04% 57.256op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 473.853µs 474.426µs ± 0.239µs 474.420µs ± 0.159µs 474.581µs 474.812µs 475.018µs 475.123µs 0.15% 0.182 -0.092 0.05% 0.017µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2104718.147op/s 2107810.774op/s ± 1059.720op/s 2107837.522op/s ± 706.080op/s 2108509.152op/s 2109508.974op/s 2109923.773op/s 2110359.120op/s 0.12% -0.179 -0.094 0.05% 74.934op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 194.050µs 195.132µs ± 0.215µs 195.192µs ± 0.075µs 195.254µs 195.380µs 195.475µs 195.539µs 0.18% -1.629 3.630 0.11% 0.015µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5114081.705op/s 5124731.835op/s ± 5663.284op/s 5123151.115op/s ± 1970.580op/s 5125526.159op/s 5136699.021op/s 5141675.639op/s 5153323.582op/s 0.59% 1.639 3.679 0.11% 400.455op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 44.611µs 44.924µs ± 0.113µs 44.915µs ± 0.070µs 44.992µs 45.111µs 45.223µs 45.254µs 0.76% 0.246 0.500 0.25% 0.008µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 22097569.267op/s 22259826.280op/s ± 55934.868op/s 22264420.825op/s ± 34458.238op/s 22295714.060op/s 22350282.572op/s 22378878.160op/s 22416224.456op/s 0.68% -0.228 0.489 0.25% 3955.192op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 50.183µs 50.524µs ± 0.177µs 50.506µs ± 0.094µs 50.601µs 50.775µs 50.840µs 51.999µs 2.95% 3.045 22.747 0.35% 0.012µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19231289.576op/s 19792883.564op/s ± 68485.374op/s 19799536.603op/s ± 36704.005op/s 19835342.453op/s 19882690.512op/s 19903945.784op/s 19926946.886op/s 0.64% -2.888 21.076 0.35% 4842.647op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [540.480µs; 540.545µs] or [-0.006%; +0.006%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1849984.245op/s; 1850208.682op/s] or [-0.006%; +0.006%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [474.393µs; 474.459µs] or [-0.007%; +0.007%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2107663.907op/s; 2107957.641op/s] or [-0.007%; +0.007%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [195.103µs; 195.162µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5123946.959op/s; 5125516.712op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [44.909µs; 44.940µs] or [-0.035%; +0.035%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [22252074.245op/s; 22267578.315op/s] or [-0.035%; +0.035%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [50.499µs; 50.548µs] or [-0.048%; +0.048%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [19783392.150op/s; 19802374.978op/s] or [-0.048%; +0.048%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fbdf3c4 1727184705 bob/sidecar-watchdog
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.749µs 23.644µs ± 10.543µs 18.750µs ± 0.224µs 19.315µs 43.131µs 45.909µs 100.246µs 434.66% 3.154 15.195 44.48% 0.745µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [22.183µs; 25.105µs] or [-6.180%; +6.180%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fbdf3c4 1727184705 bob/sidecar-watchdog
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 37.583µs 38.341µs ± 1.361µs 37.717µs ± 0.047µs 37.817µs 41.264µs 41.311µs 42.632µs 13.03% 1.726 1.062 3.54% 0.096µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [38.153µs; 38.530µs] or [-0.492%; +0.492%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fbdf3c4 1727184705 bob/sidecar-watchdog
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 251.341µs 257.322µs ± 5.251µs 256.530µs ± 4.386µs 261.473µs 266.977µs 268.707µs 269.334µs 4.99% 0.593 -0.904 2.04% 0.371µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3712858.095op/s 3887780.003op/s ± 78419.389op/s 3898186.895op/s ± 67813.479op/s 3965343.943op/s 3971713.484op/s 3974761.916op/s 3978659.497op/s 2.06% -0.548 -0.977 2.01% 5545.088op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 22.400µs 22.800µs ± 0.105µs 22.834µs ± 0.058µs 22.876µs 22.920µs 22.930µs 22.953µs 0.52% -1.128 0.838 0.46% 0.007µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 43566554.388op/s 43860498.842op/s ± 203683.245op/s 43793503.775op/s ± 110458.266op/s 43976445.722op/s 44292673.603op/s 44403988.317op/s 44642282.596op/s 1.94% 1.150 0.914 0.46% 14402.580op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 13.652µs 13.742µs ± 0.052µs 13.737µs ± 0.029µs 13.762µs 13.824µs 13.878µs 14.160µs 3.08% 2.969 19.665 0.38% 0.004µs 1 200
normalization/normalize_name/normalize_name/good throughput 70620090.325op/s 72772647.605op/s ± 272890.394op/s 72794611.779op/s ± 152104.747op/s 72951551.570op/s 73080483.198op/s 73158633.355op/s 73249776.975op/s 0.63% -2.828 18.190 0.37% 19296.265op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [256.594µs; 258.049µs] or [-0.283%; +0.283%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3876911.829op/s; 3898648.176op/s] or [-0.280%; +0.280%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [22.785µs; 22.815µs] or [-0.064%; +0.064%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [43832270.303op/s; 43888727.381op/s] or [-0.064%; +0.064%] None None None
normalization/normalize_name/normalize_name/good execution_time [13.734µs; 13.749µs] or [-0.053%; +0.053%] None None None
normalization/normalize_name/normalize_name/good throughput [72734827.621op/s; 72810467.589op/s] or [-0.052%; +0.052%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fbdf3c4 1727184705 bob/sidecar-watchdog
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 71.369µs 71.519µs ± 0.146µs 71.501µs ± 0.034µs 71.538µs 71.620µs 71.734µs 73.348µs 2.58% 10.077 122.261 0.20% 0.010µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [71.499µs; 71.539µs] or [-0.028%; +0.028%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fbdf3c4 1727184705 bob/sidecar-watchdog
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 276.771ns 288.550ns ± 13.190ns 283.372ns ± 5.112ns 290.641ns 322.806ns 324.773ns 325.958ns 15.03% 1.678 1.752 4.56% 0.933ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [286.722ns; 290.378ns] or [-0.633%; +0.633%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fbdf3c4 1727184705 bob/sidecar-watchdog
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 1.613µs 1.614µs ± 0.001µs 1.613µs ± 0.000µs 1.614µs 1.615µs 1.615µs 1.615µs 0.12% 0.863 0.082 0.04% 0.000µs 1 200
credit_card/is_card_number/ throughput 619053792.558op/s 619754064.690op/s ± 223014.430op/s 619784846.278op/s ± 161326.401op/s 619946989.431op/s 620002957.968op/s 620008257.054op/s 620046220.354op/s 0.04% -0.862 0.078 0.04% 15769.502op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 119.917µs 121.392µs ± 0.356µs 121.375µs ± 0.244µs 121.651µs 121.946µs 122.099µs 122.165µs 0.65% -0.353 0.698 0.29% 0.025µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 8185623.914op/s 8237859.408op/s ± 24154.819op/s 8238948.570op/s ± 16536.909op/s 8252711.557op/s 8275217.008op/s 8285606.125op/s 8339073.563op/s 1.22% 0.376 0.761 0.29% 1708.004op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 110.732µs 112.342µs ± 0.523µs 112.353µs ± 0.325µs 112.591µs 113.270µs 113.456µs 113.983µs 1.45% 0.058 0.461 0.46% 0.037µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 8773258.870op/s 8901566.765op/s ± 41434.449op/s 8900486.859op/s ± 25824.789op/s 8928669.066op/s 8963385.473op/s 9015190.496op/s 9030842.458op/s 1.46% -0.024 0.479 0.46% 2929.858op/s 1 200
credit_card/is_card_number/37828224631 execution_time 1.613µs 1.614µs ± 0.001µs 1.613µs ± 0.000µs 1.614µs 1.615µs 1.616µs 1.623µs 0.57% 5.449 50.624 0.06% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 616290349.716op/s 619742051.779op/s ± 342158.851op/s 619818749.533op/s ± 164399.286op/s 619940401.003op/s 620053899.671op/s 620093820.295op/s 620118182.640op/s 0.05% -5.411 50.098 0.06% 24194.284op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 105.767µs 108.404µs ± 0.506µs 108.414µs ± 0.342µs 108.776µs 109.141µs 109.424µs 109.473µs 0.98% -0.927 3.725 0.47% 0.036µs 1 200
credit_card/is_card_number/378282246310005 throughput 9134657.223op/s 9224954.585op/s ± 43255.663op/s 9223922.481op/s ± 29202.128op/s 9250060.578op/s 9280247.333op/s 9361856.109op/s 9454738.135op/s 2.50% 0.997 4.052 0.47% 3058.637op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 111.409µs 111.949µs ± 0.308µs 111.898µs ± 0.220µs 112.163µs 112.442µs 112.781µs 113.049µs 1.03% 0.696 0.132 0.27% 0.022µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 8845714.811op/s 8932695.383op/s ± 24565.410op/s 8936670.733op/s ± 17596.695op/s 8952393.187op/s 8964135.614op/s 8972645.634op/s 8975940.888op/s 0.44% -0.682 0.096 0.27% 1737.037op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 21.756µs 22.311µs ± 0.246µs 22.281µs ± 0.173µs 22.468µs 22.715µs 22.925µs 23.189µs 4.08% 0.519 0.231 1.10% 0.017µs 1 200
credit_card/is_card_number/x371413321323331 throughput 43123488.151op/s 44826678.469op/s ± 491723.174op/s 44881493.633op/s ± 348782.892op/s 45190717.900op/s 45582452.945op/s 45819712.316op/s 45964520.315op/s 2.41% -0.455 0.124 1.09% 34770.079op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 1.613µs 1.614µs ± 0.001µs 1.613µs ± 0.000µs 1.614µs 1.615µs 1.615µs 1.620µs 0.41% 3.965 25.498 0.05% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 617259729.310op/s 619740912.716op/s ± 325804.529op/s 619785249.111op/s ± 164363.444op/s 619954415.147op/s 620038172.163op/s 620081325.937op/s 620101493.346op/s 0.05% -3.947 25.313 0.05% 23037.859op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 95.415µs 96.246µs ± 0.306µs 96.275µs ± 0.240µs 96.444µs 96.738µs 96.862µs 96.933µs 0.68% -0.090 -0.361 0.32% 0.022µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 10316438.908op/s 10390200.554op/s ± 33089.506op/s 10386902.117op/s ± 25973.411op/s 10415679.765op/s 10443728.067op/s 10471914.074op/s 10480584.164op/s 0.90% 0.106 -0.352 0.32% 2339.781op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 95.797µs 98.854µs ± 1.618µs 99.746µs ± 0.722µs 100.142µs 100.593µs 100.690µs 100.912µs 1.17% -0.603 -1.245 1.63% 0.114µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 9909651.451op/s 10118624.935op/s ± 167304.813op/s 10025458.709op/s ± 72525.363op/s 10283888.895op/s 10406648.672op/s 10427807.413op/s 10438792.040op/s 4.12% 0.622 -1.220 1.65% 11830.237op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 1.613µs 1.613µs ± 0.001µs 1.614µs ± 0.000µs 1.614µs 1.614µs 1.615µs 1.615µs 0.09% 0.492 -0.154 0.03% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 619151748.120op/s 619771128.669op/s ± 200967.869op/s 619730528.208op/s ± 163993.460op/s 619961391.454op/s 620025000.873op/s 620086678.473op/s 620132453.008op/s 0.06% -0.490 -0.157 0.03% 14210.574op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 83.369µs 83.829µs ± 0.231µs 83.802µs ± 0.145µs 83.976µs 84.207µs 84.377µs 84.498µs 0.83% 0.366 -0.086 0.28% 0.016µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 11834550.615op/s 11929175.576op/s ± 32874.361op/s 11932854.425op/s ± 20670.672op/s 11950211.266op/s 11982364.310op/s 11992694.340op/s 11994842.218op/s 0.52% -0.351 -0.101 0.27% 2324.568op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 107.855µs 111.906µs ± 0.413µs 111.872µs ± 0.164µs 112.089µs 112.487µs 112.661µs 113.064µs 1.07% -4.479 44.836 0.37% 0.029µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 8844513.453op/s 8936170.624op/s ± 33589.741op/s 8938792.513op/s ± 13141.866op/s 8949763.635op/s 8965167.594op/s 9003252.250op/s 9271736.995op/s 3.72% 4.782 48.477 0.37% 2375.153op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 21.862µs 22.358µs ± 0.240µs 22.327µs ± 0.164µs 22.506µs 22.789µs 22.984µs 23.049µs 3.23% 0.464 -0.041 1.07% 0.017µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 43386527.670op/s 44731911.995op/s ± 478143.800op/s 44788292.341op/s ± 328740.572op/s 45072460.017op/s 45372680.608op/s 45705439.341op/s 45741903.555op/s 2.13% -0.409 -0.104 1.07% 33809.872op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [1.613µs; 1.614µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number/ throughput [619723157.035op/s; 619784972.345op/s] or [-0.005%; +0.005%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [121.343µs; 121.441µs] or [-0.041%; +0.041%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [8234511.783op/s; 8241207.034op/s] or [-0.041%; +0.041%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [112.270µs; 112.415µs] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/ 378282246310005 throughput [8895824.348op/s; 8907309.181op/s] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/37828224631 execution_time [1.613µs; 1.614µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/37828224631 throughput [619694631.853op/s; 619789471.705op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/378282246310005 execution_time [108.334µs; 108.474µs] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/378282246310005 throughput [9218959.766op/s; 9230949.404op/s] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [111.906µs; 111.992µs] or [-0.038%; +0.038%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [8929290.854op/s; 8936099.913op/s] or [-0.038%; +0.038%] None None None
credit_card/is_card_number/x371413321323331 execution_time [22.277µs; 22.345µs] or [-0.153%; +0.153%] None None None
credit_card/is_card_number/x371413321323331 throughput [44758530.367op/s; 44894826.572op/s] or [-0.152%; +0.152%] None None None
credit_card/is_card_number_no_luhn/ execution_time [1.613µs; 1.614µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/ throughput [619695759.342op/s; 619786066.090op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [96.203µs; 96.288µs] or [-0.044%; +0.044%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [10385614.667op/s; 10394786.441op/s] or [-0.044%; +0.044%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [98.630µs; 99.079µs] or [-0.227%; +0.227%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [10095438.097op/s; 10141811.773op/s] or [-0.229%; +0.229%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [1.613µs; 1.614µs] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [619743276.455op/s; 619798980.883op/s] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [83.797µs; 83.861µs] or [-0.038%; +0.038%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [11924619.505op/s; 11933731.646op/s] or [-0.038%; +0.038%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [111.849µs; 111.964µs] or [-0.051%; +0.051%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [8931515.409op/s; 8940825.839op/s] or [-0.052%; +0.052%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [22.325µs; 22.391µs] or [-0.149%; +0.149%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [44665645.863op/s; 44798178.127op/s] or [-0.148%; +0.148%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fbdf3c4 1727184705 bob/sidecar-watchdog
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.134µs 1.198µs ± 0.023µs 1.206µs ± 0.011µs 1.215µs 1.218µs 1.218µs 1.219µs 1.05% -1.501 1.413 1.90% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.195µs; 1.201µs] or [-0.263%; +0.263%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz fbdf3c4 1727184705 bob/sidecar-watchdog
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 9.032ms 9.059ms ± 0.010ms 9.058ms ± 0.006ms 9.065ms 9.074ms 9.080ms 9.096ms 0.42% 0.268 0.305 0.11% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [9.057ms; 9.060ms] or [-0.015%; +0.015%] None None None

Baseline

Omitted due to size.

Comment thread sidecar/src/watchdog.rs Outdated

let interval = self.interval.period();
std::thread::spawn(move || {
let mut repeats = false;
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can see what the code does and this variable is named after that, but maybe call it stuck or maybe_stuck?

Comment thread sidecar/src/watchdog.rs Outdated
std::thread::sleep(interval);
let current = still_alive_thread.load(Ordering::Relaxed);
if last != current {
if current == u32::MAX {
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A comment about this constant or naming it SHUTDOWN would make things clearer.

Comment thread sidecar/src/watchdog.rs
If the sidecar hangs, it can cause every process trying to write to it to be much slower.

Better kill it once in doubt.

Signed-off-by: Bob Weinand <[email protected]>
Signed-off-by: Bob Weinand <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants