Test test_prometheus_protocols is flaky #71237
Description
Evaluating query: up
Evaluation time: 1730226644.112345
Requesting http://172.16.2.3:9090/api/v1/query?query=up&time=1730226644.112345
...
> raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
E urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='172.16.2.3', port=9090): Max retries exceeded with url: /api/v1/query?query=up&time=1730226644.112345 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f76c366ae90>: Failed to establish a new connection: [Errno 111] Connection refused'))
/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py:515: MaxRetryError
In server log
2225:2024.10.29 18:31:07.344139 [ 10 ] {} <Debug> PROMETHEUS-Session: 600e28b2-df40-4c4f-b389-a3e8c501b2d0 Authenticating user 'default' from 172.16.2.3:40594
2226:2024.10.29 18:31:07.344226 [ 10 ] {} <Debug> PROMETHEUS-Session: 600e28b2-df40-4c4f-b389-a3e8c501b2d0 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db
2228:2024.10.29 18:31:07.353860 [ 10 ] {} <Debug> PROMETHEUS-Session: 600e28b2-df40-4c4f-b389-a3e8c501b2d0 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db
cc @vitlibar