Skip to content

enhance swin_unetr relative position#4486

Merged
wyli merged 3 commits intoProject-MONAI:devfrom
ahatamiz:swin_unetr_v6
Jun 12, 2022
Merged

enhance swin_unetr relative position#4486
wyli merged 3 commits intoProject-MONAI:devfrom
ahatamiz:swin_unetr_v6

Conversation

@ahatamiz
Copy link
Copy Markdown
Contributor

Signed-off-by: ahatamizadeh [email protected]

Fixes #4485 .

Description

In Swin UNETR (see here), self.relative_position_index could be cloned since it is an in-place operation. This will address any potential issues with new versions of Pytorch DDP where cloning is required.

This PR adds the cloning operation.

Status

Ready

Types of changes

  • Non-breaking change (fix or new feature that would not break existing functionality).
  • Breaking change (fix or new feature that would cause existing functionality to change).
  • New tests added to cover the changes.
  • Integration tests passed locally by running ./runtests.sh -f -u --net --coverage.
  • Quick tests passed locally by running ./runtests.sh --quick --unittests --disttests.
  • In-line docstrings updated.
  • Documentation updated, tested make html command in the docs/ folder.

@wyli
Copy link
Copy Markdown
Contributor

wyli commented Jun 12, 2022

/build

@wyli wyli merged commit a23c7f5 into Project-MONAI:dev Jun 12, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Enhance In-place Relative Position Bias in Swin UNETR

2 participants