RAD Measure

This repository implements tools for general purpose RAD calculation. In particular, it contains specific VQA tools that integrate with our proposed dataset.

Please see our paper for more details: Are VQA systems RAD? Measuring robustness to augmented data with focused interventions.

Installation

pip install -U rad-measure

Our YesNoVQA Dataset

Please visit our website for downloads, examples, and usage instructions.

To download our dataset:

import rad_measure.vqa_utils as rad_vqa

questions, annotations = rad_vqa.get_questions_and_annotations(download=True)

Code

Additional tools coming soon...