I want to evaluate_network() on two shuffles that have a different number of snapshots in their train folders. The differing number of snapshots saved is a result of exceptions or time-outs while training on colab. Both shuffles have a particular snapshot in common that I would like to use to compare the two. It is not currently intuitive to do this.

I could run evaluate_network() for each shuffle individually specifying the snapshotindex in the config file but doing this is not especially intuitive as one has to determine what the snapshotindex actually is. I wasn't able to find an explanation in the DLC documentation although from what I can see in the repo it can be determined by listing the snapshots in the order of increasing iterations and determining the index corresponding the desired snapshot. I believe there is a simpler alternative to this.

A parameter explicitly specifying the exact snapshot number (eg. 'snapshot-120000') in the evaluate_network() function would simplify this greatly.

Alternatively adding documentation clarifying how the snapshotindex is defined (beyond the values of '-1' and 'all') could be helpful.