Details
-
Improvement
-
Status: Resolved
-
Minor
-
Resolution: Won't Fix
-
2.2.0
-
None
Description
Currently the number of parallel fetches is hard-coded to 5. As a result the size of each fetch request is fixed at 1/5th of maxSizeInFlights. Since, chunks are requested in bursts of fetchRequests; the size of a burst to a single shuffle service can be high for large maxSizeInFlight