This repository was archived by the owner on Apr 8, 2025. It is now read-only.
This repository was archived by the owner on Apr 8, 2025. It is now read-only.
List of metrics documented in Processor but not supported for evaluation. #776
Description
The documentation for TextClassificationProcessor states that the parameter metric can take a list of metrics, see
FARM/farm/data_handler/processor.py
Line 532 in 751b48f
However this is not actually supported at evaluation time in evaluation.metrics.compute_metrics (see
FARM/farm/evaluation/metrics.py
Line 74 in 751b48f
Since this is a nice and obvious feature, I think it should be implemented.
Once implemented, it may actually predefined metrics like "acc_f1" superfluous.