Implement FROC metric#1509
Conversation
Signed-off-by: yiheng-wang-nv <[email protected]>
|
Hi @behxyz , in this MR, I remove the part of compute evaluation mask and ITC, since they are only focusing on the challenge based data format, I'm not sure if they should be added into MONAI. Could you please help to review this MR and if needed, let's discuss about the next step for the implementation. Thanks! |
Signed-off-by: yiheng-wang-nv <[email protected]>
Signed-off-by: yiheng-wang-nv <[email protected]>
bhashemian
left a comment
There was a problem hiding this comment.
@yiheng-wang-nv Very neat code, I liked it! I proposed few changes. On the other hand, we should think of what else is needed to make this metric usable in MONAI, and maybe starting from the pathology use case. Any thought?
|
Hi @Nic-Ma @wyli , I met an error like this: The above part got the mypy error: The code is in here. |
2 points:
Thanks. |
Thanks Nic, My running environment is the latest MONAI docker, and the numpy version is 1.19.1, I upgraded it into 1.19.5 but still cannot get the same error. |
Signed-off-by: yiheng-wang-nv <[email protected]>
|
the latest numpy 1.20 doesn't support python 3.6 which is the default python of the docker image... |
wyli
left a comment
There was a problem hiding this comment.
thanks, I put some comments on the docstring and variable names
bhashemian
left a comment
There was a problem hiding this comment.
Most of the suggestions are related to name changing to make it more generic and not specific to pathology use cases. The general flow seems to be generic enough but I need to find a couple of use cases to verify. I will add my comments once I find the use cases to check.
Signed-off-by: Yiheng Wang <[email protected]>
bhashemian
left a comment
There was a problem hiding this comment.
It looks good to me. Well done, @yiheng-wang-nv!
After this PR, it's time to make this FROC work for pathology inference pipeline.
Signed-off-by: yiheng-wang-nv [email protected]
Implement FROC metric which is used in https://camelyon16.grand-challenge.org/Evaluation/.
Status
Hold
Types of changes
./runtests.sh --codeformat --coverage../runtests.sh --quick.make htmlcommand in thedocs/folder.