Signed-off-by: Yiheng Wang [email protected]

Fixes #3872 .

Description

This PR enhances the contrastive loss via:

1. Use torch.as_tensor to replace torch.tensor for temperature_tensor.
2. Remove some duplicate convert type manipulations for negatives_mask.

Status

Ready

Types of changes

• Non-breaking change (fix or new feature that would not break existing functionality).
• Breaking change (fix or new feature that would cause existing functionality to change).
• New tests added to cover the changes.
• Integration tests passed locally by running ./runtests.sh -f -u --net --coverage.
• Quick tests passed locally by running ./runtests.sh --quick --unittests --disttests.
• In-line docstrings updated.
• Documentation updated, tested make html command in the docs/ folder.