Skip to content

MonaiAlgo FedStats#5240

Merged
wyli merged 19 commits intoProject-MONAI:devfrom
holgerroth:5196-fedstats
Oct 15, 2022
Merged

MonaiAlgo FedStats#5240
wyli merged 19 commits intoProject-MONAI:devfrom
holgerroth:5196-fedstats

Conversation

@holgerroth
Copy link
Copy Markdown
Collaborator

@holgerroth holgerroth commented Sep 30, 2022

Fixes #5196, fixes #5316.

Description

Add api function that allows FL systems to request summary statistics, i.e. get_data_stats in new ClientStats class. MonaiStats is added to provide implementation based on Monai bundle.

Utilizes DataAnalyzer functions from Auto3DSeg. Changes to DataAnalyzer are supposed to not change the behavior.

Types of changes

  • Non-breaking change (fix or new feature that would not break existing functionality).
  • Breaking change (fix or new feature that would cause existing functionality to change).
  • New tests added to cover the changes.
  • Integration tests passed locally by running ./runtests.sh -f -u --net --coverage.
  • Quick tests passed locally by running ./runtests.sh --quick --unittests --disttests.
  • In-line docstrings updated.
  • Documentation updated, tested make html command in the docs/ folder.

@holgerroth holgerroth changed the title WIP: MonaiAlgo FedStats [WIP] MonaiAlgo FedStats Oct 6, 2022
@holgerroth holgerroth linked an issue Oct 12, 2022 that may be closed by this pull request
@holgerroth holgerroth force-pushed the 5196-fedstats branch 2 times, most recently from 433ebcc to 70e203d Compare October 13, 2022 15:09
@holgerroth holgerroth changed the title [WIP] MonaiAlgo FedStats MonaiAlgo FedStats Oct 13, 2022
@holgerroth holgerroth marked this pull request as ready for review October 13, 2022 15:41
holgerroth and others added 15 commits October 14, 2022 19:17
Signed-off-by: Holger Roth <[email protected]>

make histogram configurable

Signed-off-by: Holger Roth <[email protected]>

formatting

[pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

refactor client api

Signed-off-by: Holger Roth <[email protected]>

add statistics filters

Signed-off-by: Holger Roth <[email protected]>

[pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

restore test configs

Signed-off-by: Holger Roth <[email protected]>

refactor total summary stats computation

restore test configs

use list of features

Signed-off-by: Holger Roth <[email protected]>

keep old filenames

Signed-off-by: Holger Roth <[email protected]>

update stats class names

Signed-off-by: Holger Roth <[email protected]>

save stats locally; make format configurable

Signed-off-by: Holger Roth <[email protected]>

support multi-channel images

Signed-off-by: Holger Roth <[email protected]>

reformatting

Signed-off-by: Holger Roth <[email protected]>
Signed-off-by: Holger Roth <[email protected]>
Signed-off-by: Holger Roth <[email protected]>
Signed-off-by: Holger Roth <[email protected]>
Signed-off-by: Holger Roth <[email protected]>
Signed-off-by: Holger Roth <[email protected]>
wyli added 3 commits October 15, 2022 09:37
Signed-off-by: Wenqi Li <[email protected]>
Signed-off-by: Wenqi Li <[email protected]>
@wyli
Copy link
Copy Markdown
Contributor

wyli commented Oct 15, 2022

/build

@wyli
Copy link
Copy Markdown
Contributor

wyli commented Oct 15, 2022

/build

@wyli wyli enabled auto-merge (squash) October 15, 2022 09:45
@wyli wyli merged commit d3f6e20 into Project-MONAI:dev Oct 15, 2022
wyli pushed a commit to wyli/MONAI that referenced this pull request Oct 15, 2022
Fixes Project-MONAI#5196, Project-MONAI#5316.

### Description

Add api function that allows FL systems to request summary statistics,
i.e. `get_data_stats` in new `ClientStats` class. `MonaiStats` is added
to provide implementation based on Monai bundle.

Utilizes DataAnalyzer functions from Auto3DSeg. Changes to DataAnalyzer
are supposed to not change the behavior.


### Types of changes
<!--- Put an `x` in all the boxes that apply, and remove the not
applicable items -->
- [x] Non-breaking change (fix or new feature that would not break
existing functionality).
- [ ] Breaking change (fix or new feature that would cause existing
functionality to change).
- [x] New tests added to cover the changes.
- [ ] Integration tests passed locally by running `./runtests.sh -f -u
--net --coverage`.
- [ ] Quick tests passed locally by running `./runtests.sh --quick
--unittests --disttests`.
- [ ] In-line docstrings updated.
- [ ] Documentation updated, tested `make html` command in the `docs/`
folder.

Signed-off-by: Holger Roth <[email protected]>
bhashemian pushed a commit to JHancox/MONAI that referenced this pull request Oct 20, 2022
Fixes Project-MONAI#5196, Project-MONAI#5316.

### Description

Add api function that allows FL systems to request summary statistics,
i.e. `get_data_stats` in new `ClientStats` class. `MonaiStats` is added
to provide implementation based on Monai bundle.

Utilizes DataAnalyzer functions from Auto3DSeg. Changes to DataAnalyzer
are supposed to not change the behavior.


### Types of changes
<!--- Put an `x` in all the boxes that apply, and remove the not
applicable items -->
- [x] Non-breaking change (fix or new feature that would not break
existing functionality).
- [ ] Breaking change (fix or new feature that would cause existing
functionality to change).
- [x] New tests added to cover the changes.
- [ ] Integration tests passed locally by running `./runtests.sh -f -u
--net --coverage`.
- [ ] Quick tests passed locally by running `./runtests.sh --quick
--unittests --disttests`.
- [ ] In-line docstrings updated.
- [ ] Documentation updated, tested `make html` command in the `docs/`
folder.

Signed-off-by: Holger Roth <[email protected]>
Signed-off-by: Behrooz <[email protected]>
KumoLiu pushed a commit that referenced this pull request Nov 2, 2022
Fixes #5196, #5316.

### Description

Add api function that allows FL systems to request summary statistics,
i.e. `get_data_stats` in new `ClientStats` class. `MonaiStats` is added
to provide implementation based on Monai bundle.

Utilizes DataAnalyzer functions from Auto3DSeg. Changes to DataAnalyzer
are supposed to not change the behavior.


### Types of changes
<!--- Put an `x` in all the boxes that apply, and remove the not
applicable items -->
- [x] Non-breaking change (fix or new feature that would not break
existing functionality).
- [ ] Breaking change (fix or new feature that would cause existing
functionality to change).
- [x] New tests added to cover the changes.
- [ ] Integration tests passed locally by running `./runtests.sh -f -u
--net --coverage`.
- [ ] Quick tests passed locally by running `./runtests.sh --quick
--unittests --disttests`.
- [ ] In-line docstrings updated.
- [ ] Documentation updated, tested `make html` command in the `docs/`
folder.

Signed-off-by: Holger Roth <[email protected]>
Signed-off-by: KumoLiu <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Make statistics export format configurable Add federated statistics support

4 participants