Skip to content

3765 Enhance create_multigpu_supervised_XXX for distributed#3768

Merged
Nic-Ma merged 8 commits intoProject-MONAI:devfrom
Nic-Ma:3765-fix-create-multigpu-trainer
Feb 4, 2022
Merged

3765 Enhance create_multigpu_supervised_XXX for distributed#3768
Nic-Ma merged 8 commits intoProject-MONAI:devfrom
Nic-Ma:3765-fix-create-multigpu-trainer

Conversation

@Nic-Ma
Copy link
Copy Markdown
Contributor

@Nic-Ma Nic-Ma commented Feb 4, 2022

Fixes #3765 .

Description

This PR enhanced create_multigpu_supervised_trainer for devices when distributed=True, and added distributed tests.

Status

Ready

Types of changes

  • Non-breaking change (fix or new feature that would not break existing functionality).
  • Breaking change (fix or new feature that would cause existing functionality to change).
  • New tests added to cover the changes.
  • Integration tests passed locally by running ./runtests.sh -f -u --net --coverage.
  • Quick tests passed locally by running ./runtests.sh --quick --unittests --disttests.
  • In-line docstrings updated.
  • Documentation updated, tested make html command in the docs/ folder.

@Nic-Ma Nic-Ma changed the title 3765 Enhance create_multigpu_supervised_trainer for distributed 3765 Enhance create_multigpu_supervised_XXX for distributed Feb 4, 2022
@Nic-Ma
Copy link
Copy Markdown
Contributor Author

Nic-Ma commented Feb 4, 2022

/black

@Nic-Ma
Copy link
Copy Markdown
Contributor Author

Nic-Ma commented Feb 4, 2022

/build

@Nic-Ma Nic-Ma requested review from ericspod, rijobro and wyli February 4, 2022 16:01
Copy link
Copy Markdown
Contributor

@wyli wyli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, it looks good to me.

@Nic-Ma
Copy link
Copy Markdown
Contributor Author

Nic-Ma commented Feb 4, 2022

/black

@Nic-Ma
Copy link
Copy Markdown
Contributor Author

Nic-Ma commented Feb 4, 2022

/build

@Nic-Ma Nic-Ma merged commit 62b3f6e into Project-MONAI:dev Feb 4, 2022
wyli pushed a commit to wyli/MONAI that referenced this pull request Feb 5, 2022
…t-MONAI#3768)

* [DLMED] add check for devices

Signed-off-by: Nic Ma <[email protected]>

* [DLMED] update according to comments

Signed-off-by: Nic Ma <[email protected]>
wyli added a commit that referenced this pull request Feb 7, 2022
* temp spatial_resample

Signed-off-by: Wenqi Li <[email protected]>

* fixes resampling

Signed-off-by: Wenqi Li <[email protected]>

* fixes precisions

Signed-off-by: Wenqi Li <[email protected]>

* update dict version

Signed-off-by: Wenqi Li <[email protected]>

* fixes unit tests

Signed-off-by: Wenqi Li <[email protected]>

* adds docs

Signed-off-by: Wenqi Li <[email protected]>

* copy grid for resampling

Signed-off-by: Wenqi Li <[email protected]>

* fixes unit tests

Signed-off-by: Wenqi Li <[email protected]>

* remove normalize coordinates

Signed-off-by: Wenqi Li <[email protected]>

* [MONAI] python code formatting

Signed-off-by: monai-bot <[email protected]>

* try to fix #3621 (#3673)

Signed-off-by: Wenqi Li <[email protected]>

* fixes typing

Signed-off-by: Wenqi Li <[email protected]>

* fixes grid_sample, interpolate URLs

Signed-off-by: Wenqi Li <[email protected]>

* simplify norm_coords

Signed-off-by: Wenqi Li <[email protected]>

* update docstring

Signed-off-by: Wenqi Li <[email protected]>

* update moveaxis

Signed-off-by: Wenqi Li <[email protected]>

* spatial sample tests

Signed-off-by: Wenqi Li <[email protected]>

* additional tests spatial resample

Signed-off-by: Wenqi Li <[email protected]>

* test invert saptial resample

Signed-off-by: Wenqi Li <[email protected]>

* adds a base writer and an itk writer

Signed-off-by: Wenqi Li <[email protected]>

* update docstrings

Signed-off-by: Wenqi Li <[email protected]>

* remove return self

Signed-off-by: Wenqi Li <[email protected]>

* adds reorient_spatial_axes

Signed-off-by: Wenqi Li <[email protected]>

* update based on comments

Signed-off-by: Wenqi Li <[email protected]>

* update based on comments

Signed-off-by: Wenqi Li <[email protected]>

* fixes unit tests

Signed-off-by: Wenqi Li <[email protected]>

* sync 3701

Signed-off-by: Wenqi Li <[email protected]>

* try to fix #3766

Signed-off-by: Wenqi Li <[email protected]>

* revise docstring to be concise

Signed-off-by: Wenqi Li <[email protected]>

* update based on comments

Signed-off-by: Wenqi Li <[email protected]>

* 3765 Enhance `create_multigpu_supervised_XXX` for distributed (#3768)

* [DLMED] add check for devices

Signed-off-by: Nic Ma <[email protected]>

* [DLMED] update according to comments

Signed-off-by: Nic Ma <[email protected]>

* update to support dynamic spatial_size

Signed-off-by: Wenqi Li <[email protected]>

* update based on comments

Signed-off-by: Wenqi Li <[email protected]>
wyli added a commit that referenced this pull request Feb 8, 2022
* temp spatial_resample

Signed-off-by: Wenqi Li <[email protected]>

* fixes resampling

Signed-off-by: Wenqi Li <[email protected]>

* fixes precisions

Signed-off-by: Wenqi Li <[email protected]>

* update dict version

Signed-off-by: Wenqi Li <[email protected]>

* fixes unit tests

Signed-off-by: Wenqi Li <[email protected]>

* adds docs

Signed-off-by: Wenqi Li <[email protected]>

* copy grid for resampling

Signed-off-by: Wenqi Li <[email protected]>

* fixes unit tests

Signed-off-by: Wenqi Li <[email protected]>

* remove normalize coordinates

Signed-off-by: Wenqi Li <[email protected]>

* [MONAI] python code formatting

Signed-off-by: monai-bot <[email protected]>

* try to fix #3621 (#3673)

Signed-off-by: Wenqi Li <[email protected]>

* fixes typing

Signed-off-by: Wenqi Li <[email protected]>

* fixes grid_sample, interpolate URLs

Signed-off-by: Wenqi Li <[email protected]>

* simplify norm_coords

Signed-off-by: Wenqi Li <[email protected]>

* update docstring

Signed-off-by: Wenqi Li <[email protected]>

* update moveaxis

Signed-off-by: Wenqi Li <[email protected]>

* spatial sample tests

Signed-off-by: Wenqi Li <[email protected]>

* additional tests spatial resample

Signed-off-by: Wenqi Li <[email protected]>

* test invert saptial resample

Signed-off-by: Wenqi Li <[email protected]>

* adds a base writer and an itk writer

Signed-off-by: Wenqi Li <[email protected]>

* update docstrings

Signed-off-by: Wenqi Li <[email protected]>

* remove return self

Signed-off-by: Wenqi Li <[email protected]>

* adds reorient_spatial_axes

Signed-off-by: Wenqi Li <[email protected]>

* update based on comments

Signed-off-by: Wenqi Li <[email protected]>

* update based on comments

Signed-off-by: Wenqi Li <[email protected]>

* fixes unit tests

Signed-off-by: Wenqi Li <[email protected]>

* sync 3701

Signed-off-by: Wenqi Li <[email protected]>

* try to fix #3766

Signed-off-by: Wenqi Li <[email protected]>

* revise docstring to be concise

Signed-off-by: Wenqi Li <[email protected]>

* update based on comments

Signed-off-by: Wenqi Li <[email protected]>

* 3765 Enhance `create_multigpu_supervised_XXX` for distributed (#3768)

* [DLMED] add check for devices

Signed-off-by: Nic Ma <[email protected]>

* [DLMED] update according to comments

Signed-off-by: Nic Ma <[email protected]>

* update to support dynamic spatial_size

Signed-off-by: Wenqi Li <[email protected]>

* adds nibabel pil writers

Signed-off-by: Wenqi Li <[email protected]>

* remove unused ignore

Signed-off-by: Wenqi Li <[email protected]>

* update based on comments

Signed-off-by: Wenqi Li <[email protected]>
wyli pushed a commit that referenced this pull request Feb 9, 2022
* [DLMED] add check for devices

Signed-off-by: Nic Ma <[email protected]>

* [DLMED] update according to comments

Signed-off-by: Nic Ma <[email protected]>
wyli pushed a commit that referenced this pull request Feb 9, 2022
* [DLMED] add check for devices

Signed-off-by: Nic Ma <[email protected]>

* [DLMED] update according to comments

Signed-off-by: Nic Ma <[email protected]>
wyli pushed a commit that referenced this pull request Feb 9, 2022
* [DLMED] add check for devices

Signed-off-by: Nic Ma <[email protected]>

* [DLMED] update according to comments

Signed-off-by: Nic Ma <[email protected]>
wyli pushed a commit that referenced this pull request Feb 9, 2022
* [DLMED] add check for devices

Signed-off-by: Nic Ma <[email protected]>

* [DLMED] update according to comments

Signed-off-by: Nic Ma <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

create_multigpu_supervised_trainer can't work with multiple devices

2 participants