Anonymous Submissions

Last Updated: April 06, 2026

To better support contemporary academic workflows, particularly the double-anonymous review requirements of many conferences and journals, ManipulationNet supports anonymous submissions across its benchmarks.

This mechanism enables researchers to evaluate systems and report verified benchmark results during peer review, while preserving anonymity and maintaining benchmark rigor, reproducibility, and fairness.

Motivation

Many leading robotics venues (e.g., TRO, RA-L, ICRA, IROS, RSS, CoRL) require double-anonymous submission, which can limit benchmark participation if attribution is mandatory. Anonymous submissions remove this barrier and allow teams to:

  • Evaluate systems during paper review
  • Include verified benchmark results in submissions
  • Participate without revealing institutional or author identity

Submission Modes

ManipulationNet supports two parallel submission modes:

  • Public Submission: Team name and affiliation are visible on the public leaderboard.
  • Anonymous Submission: Team identity is hidden and replaced by a system-generated Anonymous Team ID.

Both modes use identical task definitions, evaluation software, protocols, and metrics.

How to Make a Submission Anonymous

Default Visibility: Submissions are considered public by default.

Enable Anonymous Submissions: To enable anonymity, teams must set "anonymous_submission": "enable" in the configuration file config/team_config.json prior to submission.

Anonymity Duration and Changes: Anonymous status remains in effect indefinitely unless the team explicitly requests de-anonymization (by sending a request email to [email protected]). Submissions that are initially made public cannot be converted to anonymous afterwards.

Submission Videos: All submission videos will be publicly displayed on the corresponding leaderboard. Teams are solely responsible for ensuring that submitted videos do not contain identifying information if anonymity is desired.

Contact Information

For questions regarding the Code of Honor, please contact [email protected]