Skip to content

Enhance In-place Relative Position Bias in Swin UNETR #4485

@ahatamiz

Description

@ahatamiz

Is your feature request related to a problem? Please describe.
In Swin UNETR (see here), self.relative_position_index could be cloned since it is an in-place operation. This will address any potential issues with new versions of Pytorch DDP where cloning is required.

Describe the solution you'd like
Simply add self.relative_position_index.clone() to enhance it.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions