@@ -97,6 +97,24 @@ R² gives the same ranking as squared loss.
9797Furthermore, the Brier score is just a different name for the squared error
9898in case of classification.
9999
100+ **Ficticious Example: **
101+ Let's make the above arguments more tangible. Consider a setting of reliability
102+ engineering of network connections, e.g. internet or wifi. As provider of the network,
103+ you have access to the dataset of log entries of network connection containing network
104+ load over time and many interesting features. Your goal is to improve the raliability
105+ of the connections. In fact, you promise your customors that at least on 99% of all
106+ days there are no connection discontinuities larger 1 minute.
107+ Therefore, you are interested in a prediction of the 99% quantile (of connections per
108+ day free of interruptions larger than 1 minute) in order to know in advance when to add
109+ more bandwidth and thereby satisfy your customers. So the *target functional * is the
110+ 99% quantile. From the table above, you choose the pinball loss as scoring function
111+ (fair enough, not much choice given), for model training (e.g.
112+ `HistGradientBoostingRegressor(loss="quantile", quantile=0.99) ` as well as model
113+ evaluation (`mean_pinball_loss(..., alpha=0.9) ` - we apoligize for the different
114+ argument names, `quantile ` and `alpha `) be it in grid search for finding
115+ hyperparameters or in comparing to other models like
116+ `QuantileRegressor(quantile=0.99) `.
117+
100118.. topic :: References:
101119
102120 .. [Gneiting2007 ] T. Gneiting and A. E. Raftery. :doi: `Strictly Proper
0 commit comments