classification ViT have the final nn.Tanh() #4581
Description
Discussed in #4580
Originally posted by chris-clem June 24, 2022
I was wondering why does the Vision Transformer (ViT) with classification=True have nn.Tanh() in the end of the classification_head (https://github.com/Project-MONAI/MONAI/blob/dev/monai/networks/nets/vit.py#L100)? The other classification models output the raw logits.
the hard-coded activation function should be made optional and documented.