Hi @myron , @mingxin-zheng ,

Should we revert or you already find a quick fix for the test issue?

Thanks.

Let me give a quick fix now

I think we should revert, my previous comments were also not addressed, looks like a mistake #5523 (comment) cc @Nic-Ma @mingxin-zheng

/build

I think we should revert, my previous comments were also not addressed, looks like a mistake #5523 (comment) cc @Nic-Ma @mingxin-zheng

--------------- Updated -----------------
After some thoughts, I created a new ticket (#5558) to describe the issue in the integration test.

The issue is not brought by PR #5523. Instead, it is triggered by using Auto3DSeg HPO and then ensemble the HPO experiments by AlgoEnsembleBestByFold.

Because it can be fixed separately, it shouldn't be mixed with PR #5523.

--------------- Original ------------------
I provided a quick fix in #5557.

@myron I am be totally wrong but I guess this AutoRunner needs to be updated as soon as possible so it doesn't block other works of yours. So I simply followed @wyli 's suggestion to make algos in the end of the argument list of AutoRunner init in my fix. If more discussion is needed, please disregard this quick fix #5557 and created yours. Thanks!

/build

I think we should revert, my previous comments were also not addressed, looks like a mistake #5523 (comment) cc @Nic-Ma @mingxin-zheng

I though I addressed those comments. I commented again to clarify. and it does not seem to be reason for this issue.
thank you.

I think we should revert, my previous comments were also not addressed, looks like a mistake #5523 (comment) cc @Nic-Ma @mingxin-zheng

--------------- Updated ----------------- After some thoughts, I created a new ticket (#5558) to describe the issue in the integration test.

The issue is not brought by PR #5523. Instead, it is triggered by using Auto3DSeg HPO and then ensemble the HPO experiments by AlgoEnsembleBestByFold.

Because it can be fixed separately, it shouldn't be mixed with PR #5523.

Thanks for the analysis. Let me work with you to fix it quickly. I did change the default ensemble method to AlgoEnsembleBestByFold, but the previous one was incorrect. Let me chat to you what the best way to fix quickly.