Building custom runtimes using mlserver build is fantastic but also leverages conda and some of our builds have been known to take up to 8 hours due to the conda standard resolver taking so long to resolve the environment. An improvement has already been developed by conda: the libmamba resolver.
Details can be found here: https://www.anaconda.com/blog/a-faster-conda-for-a-growing-community
But the highlights:
- make sure to be using conda 4.12.0 or higher; which might already be true in the current base image you use (
conda update -n base conda)
- install the new solver:
conda install -n base conda-libmamba-solver
- set as default:
conda config --set solver libmamba
Building custom runtimes using
mlserver buildis fantastic but also leverages conda and some of our builds have been known to take up to 8 hours due to the conda standard resolver taking so long to resolve the environment. An improvement has already been developed by conda: the libmamba resolver.Details can be found here: https://www.anaconda.com/blog/a-faster-conda-for-a-growing-community
But the highlights:
conda update -n base conda)conda install -n base conda-libmamba-solverconda config --set solver libmamba