For the Torchscript:

1. It's saying what the issue is, something of the form var: Type isn't allowed without assigning something to var because this needs to be translated into an equivalent C++ statement. You can safely assign x to it in this case since it will be set to something else immediately in the following loop.
2. Generated expressions like this aren't allowed so you'll have to define this with a explicit loop.
   sum(self.ops[idx.item()](x) * ops[idx.item()] * weight[idx.item()] for idx in (ops == 1).nonzero()) just becomes:

    ops_sum:float =0
    for idx in range(len(ops)):
        if ops[idx] == 1:
            ops_sum += self.ops[idx](x) * ops[idx.item()] * weight[idx.item()]

This is likely faster anyhow.

Hi @ericspod ,

Thanks very much for your help here.
I updated the code to:

ops_sum = 0
for i, o in enumerate(ops):
    if o == 1:
        ops_sum += self.ops[i](x) * o * weight[i]
return ops_sum

But still got the TorchScript error about index:

RuntimeError: 
Expected integer literal for index. ModuleList/Sequential indexing is only supported with integer literals. Enumeration is supported, e.g. 'for index, v in enumerate(self): ...':
  File "/workspace/data/medical/MONAI/monai/networks/nets/dints.py", line 132
        for i, o in enumerate(ops):
            if o == 1:
                ops_sum += self.ops[i](x) * o * weight[i]
                           ~~~~~~~~~~~ <--- HERE
        return ops_sum

I tried to change the index value but didn't solve it.. do you have any idea?

Thanks in advance.

/black

I'm getting some compatible modules for torchscript, still testing them

/build

@Nic-Ma,
Torchscript is finicky at times about what it will accept, it has to be compatible with C++ so it excludes many Python idioms like enumerate. You will have to loop through indices old school:

ops_sum = 0
for i in range(len(ops)):
    if ops[i] == 1:
        ops_sum += self.ops[i](x) * ops[i] * weight[i]
return ops_sum

Torchscript can understand what to do with for i in range(len(ops)) in terms of converting it to a construct like for(int i=0;i<ops.size();i++).

/build

/build