Skip to content
This repository was archived by the owner on Apr 8, 2025. It is now read-only.

Fix removal of yes no answers#540

Merged
brandenchan merged 5 commits intomasterfrom
yes_no
Oct 27, 2020
Merged

Fix removal of yes no answers#540
brandenchan merged 5 commits intomasterfrom
yes_no

Conversation

@brandenchan
Copy link
Copy Markdown
Contributor

Previously, yes no answers in the Natural Questions dataset were being converted into span answers (#529). This PR fixes this problem.

@brandenchan brandenchan requested a review from tholor September 30, 2020 13:41
Copy link
Copy Markdown
Contributor

@Timoeller Timoeller left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lets remove hard coded answer types as suggested in comment.

@tholor tholor linked an issue Oct 21, 2020 that may be closed by this pull request
@tholor tholor added this to the #3 milestone Oct 21, 2020
@brandenchan brandenchan merged commit b33e17c into master Oct 27, 2020
@Timoeller
Copy link
Copy Markdown
Contributor

Hey sorry @brandenchan but this is not the best solution. We have an empty list as default arg which is an anti pattern, see https://docs.python-guide.org/writing/gotchas/

Otherwise the solution is ok with me.

tholor added a commit that referenced this pull request Oct 28, 2020
* DPRProcessor, BiAdaptiveModel modified for optional query/passage

* TextSimilarityProcessor, BiAdaptiveModel haystack inference compatibility added

* TextSimilarityProcessor query/passage features optional

* DPRProcessor, BiAdaptiveModel modified for optional query/passage

* TextSimilarityProcessor, BiAdaptiveModel haystack inference compatibility added

* TextSimilarityProcessor query/passage features optional

* prediction head modified

* bugfix in BiAdaptiveModel init

* Fix removal of yes no answers (#540)

* fix removal of yes no answers

* Make use of the answer_type linked to each answers.

* pin seqeval version

* remove hardcoded answer types list

Co-authored-by: Fabio Tesser <[email protected]>
Co-authored-by: Malte Pietsch <[email protected]>

* DPR test modified for max_seq_len_query/max_seq_len_context

* Infer model type from config (#600)

* Inference model and tokenizer type from config

* Infer type from model name as fallback

* BiAdaptive model output type modified to tuple from dict

* dpr tests reflect biadaptive model output type(tuple)

* DPRProcessor, BiAdaptiveModel modified for optional query/passage

* TextSimilarityProcessor, BiAdaptiveModel haystack inference compatibility added

* TextSimilarityProcessor query/passage features optional

* DPRProcessor, BiAdaptiveModel modified for optional query/passage

* TextSimilarityProcessor, BiAdaptiveModel haystack inference compatibility added

* prediction head modified

* bugfix in BiAdaptiveModel init

* DPR test modified for max_seq_len_query/max_seq_len_context

* BiAdaptive model output type modified to tuple from dict

* dpr tests reflect biadaptive model output type(tuple)

* renamed variables from 'context' to 'passage'

* DPR language model loading refactored

* DPR Language model comments fix

Co-authored-by: Branden Chan <[email protected]>
Co-authored-by: Fabio Tesser <[email protected]>
Co-authored-by: Malte Pietsch <[email protected]>
Co-authored-by: bogdankostic <[email protected]>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

examples/natural_questions.py evaluation not computed for yes/no classes

4 participants