You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Apr 8, 2025. It is now read-only.
When using FARMs Evaluator for QA evaluation we only have EM and f1 across all input examples.
The official SQuAD eval script has both, an overall score and at the same time scores for text answers vs no_answer.
We should also have both inside the Evaluator Class.