DOMAIN MIGRATION

Hello everyone! We are planning to transfer the domain name at https://fastmri.org/ from Meta to NYU ownership next week.

WHAT THIS MEANS

All of the leaderboards will stop working on the date of the transfer. Current information on the site will be archived (but can be deleted on request). No data will be transferred to NYU. If/when NYU creates a new leaderboard, you will have to create a new account.

The data website at https://fastmri.med.nyu.edu/ will be completely unaffected.

MITIGATIONS

• Evaluation on the brain test set: You can now download the fully-sampled brain test set from https://fastmri.med.nyu.edu/ and run evaluations yourself. The website essentially runs the same code as in evaluate.py You may want to log the current leaderboard information if you want to make comparisons to the other models there.
• Evaluation on knee test set (multicoil and single coil): This will no longer be possible until NYU rebuilds the leaderboard infrastructure on their version of the website. Instead, you will have to use the knee validation set. You can split the knee validation set into two and use half as "val" for improving your models and the other half as "test".
• Historic leaderboards can be accessed via the archive at https://web.archive.org/web/20230324102125mp_/https://fastmri.org/leaderboards.

QUESTIONS?

Please post them below.