Several methodologies have recently been proposed to evaluate the ability of Pretrained Language ... more Several methodologies have recently been proposed to evaluate the ability of Pretrained Language Models (PLMs) to interpret negation. In this article, we build on Gubelmann and , which studies the modification of PLMs' predictions as a function of the polarity of inputs, in English. Crucially, this test uses "self-contained" inputs ending with a masked position: depending on the polarity of a verb in the input, a particular token is either semantically ruled out or allowed at the masked position. By replicating Gubelmann and Handschuh ( ) experiments, we have uncovered flaws that weaken the conclusions that can be drawn from this test. We thus propose an improved version, the Self-Contained Neg Test, which is more controlled, more systematic, and entirely based on examples forming minimal pairs varying only in the presence or absence of verbal negation in English. When applying our test to the roberta and bert base and large models, we show that only roberta-large shows trends that match the expectations, while bert-base is mostly insensitive to negation. For all the tested models though, in a significant number of test instances the top-1 prediction remains the token that is semantically forbidden by the context, which shows how much room for improvement remains for a proper treatment of the negation phenomenon.
Findings of the Association for Computational Linguistics: ACL 2022, 2022
The biaffine parser of Dozat and Manning (2017) was successfully extended to semantic dependency ... more The biaffine parser of Dozat and Manning (2017) was successfully extended to semantic dependency parsing (SDP) (Dozat and Manning, 2018). Its performance on graphs is surprisingly high given that, without the constraint of producing a tree, all arcs for a given sentence are predicted independently from each other (modulo a shared representation of tokens). To circumvent such an independence of decision, while retaining the O(n 2) complexity and highly parallelizable architecture, we propose to use simple auxiliary tasks that introduce some form of interdependence between arcs. Experiments on the three English acyclic datasets of SemEval 2015 task 18 (Oepen et al., 2015), and on French deep syntactic cyclic graphs (Ribeyre et al., 2014) show modest but systematic performance gains on a near state-ofthe-art baseline using transformer-based contextualized representations. This provides a simple and robust method to boost SDP performance.
This multilingual resource contains corpora for 14 languages, gathered at the occasion of the 1.2... more This multilingual resource contains corpora for 14 languages, gathered at the occasion of the 1.2 edition of the PARSEME Shared Task on semi-supervised Identification of Verbal MWEs (2020). These corpora were meant to serve as additional "raw" corpora, to help discovering unseen verbal MWEs. The corpora are provided in CONLL-U (https://universaldependencies.org/format.html) format. They contain morphosyntactic annotations (parts of speech, lemmas, morphological features, and syntactic dependencies). Depending on the language, the information comes from treebanks (mostly Universal Dependencies v2.x) or from automatic parsers trained on UD v2.x treebanks (e.g., UDPipe). VMWEs include idioms (let the cat out of the bag), light-verb constructions (make a decision), verb-particle constructions (give up), inherently reflexive verbs (help oneself), and multi-verb constructions (make do). For the 1.2 shared task edition, the data covers 14 languages, for which VMWEs were annotated...
We introduce the French Social Media Bank, the first user-generated content treebank for French. ... more We introduce the French Social Media Bank, the first user-generated content treebank for French. Its first release contains 1,700 sentences from various Web 2.0 and social media sources (FACEBOOK, TWITTER, web forums), including data specifically chosen for their high noisiness.
Universal dependencies (UD) is a framework for morphosyntactic annotation of human language, whic... more Universal dependencies (UD) is a framework for morphosyntactic annotation of human language, which to date has been used to create treebanks for more than 100 languages. In this article, we outline the linguistic theory of the UD framework, which draws on a long tradition of typologically oriented grammatical theories. Grammatical relations between words are centrally used to explain how predicate–argument structures are encoded morphosyntactically in different languages while morphological features and part-of-speech classes give the properties of words. We argue that this theory is a good basis for crosslinguistically consistent annotation of typologically diverse languages in a way that supports computational natural language understanding as well as broader linguistic studies.
We present edition 1.2 of the PARSEME shared task on identification of verbal multiword expressio... more We present edition 1.2 of the PARSEME shared task on identification of verbal multiword expressions (VMWEs). Lessons learned from previous editions indicate that VMWEs have low ambiguity, and that the major challenge lies in identifying test instances never seen in the training data. Therefore, this edition focuses on unseen VMWEs. We have split annotated corpora so that the test corpora contain around 300 unseen VMWEs, and we provide non-annotated raw corpora to be used by complementary discovery methods. We released annotated and raw corpora in 14 languages, and this semi-supervised challenge attracted 7 teams who submitted 9 system results. This paper describes the effort of corpus creation, the task design, and the results obtained by the participating systems, especially their performance on unseen expressions.
Nous présentons le French QuestionBank, un corpus arboré composé de 2600 questions annotées en dé... more Nous présentons le French QuestionBank, un corpus arboré composé de 2600 questions annotées en dépendances et en constituants. Les deux tiers étant alignés avec le QuestionBank de l'anglais (Judge et al., 2006), libre de droits, ce corpus saura prouver son utilité pour construire des systèmes d'analyse robuste. Nous discutons aussi des coûts de développement de tels corpus.
β-caryophyllene (BCP), a natural sesquiterpene present in plants, is a selective agonist of canna... more β-caryophyllene (BCP), a natural sesquiterpene present in plants, is a selective agonist of cannabinoid receptor type-2 (CB2) of the endocannabinoid system. In this study, we have prepared an extract from Piper nigrum (black pepper) seeds using supercritical fluid extraction, standardized to contain 30% BCP (ViphyllinTM ). The beneficial effects of prophylactic treatment with Viphyllin on cognitive functions were demonstrated in Scopolamine-induced dementia model mice. Male Swiss albino mice (25-30 g) were administered with Viphyllin (50 mg and 100 mg/kg body weight p.o.) or donepezil (1.60 mg/kg) for 14 days. Subsequently, cognitive deficits were induced by treating the animals intraperitoneally with Scopolamine (0.75 mg/kg). The cognitive behavior of mice was evaluated using a novel object recognition test (NORT) and Morris water maze (MWM) test. The brain homogenates were studied for biochemical parameters including cholinesterase activities and antioxidant status. Western blot analysis was performed to investigate the mechanism of action. Viphyllin dose dependently improved the recognition and spatial memory and cholinergic functions in Scop-treated mice. The extract was found protective against Scop-induced oxidative damage and histopathologic changes in the brain. At 100 mg/kg Viphyllin markedly reduced the proBDNF/mBDNF ratio (p < .05) and augmented the TrkB expression (p < .01). Viphyllin (100 mg/kg) was found to be neuroprotective by reducing the Scop-induced upregulation of p-JNK and p-p38 MAPK proteins, Bax/Bcl-2 ratio, and caspase activation in the brain. Viphyllin also exerted anti-inflammatory effects by downregulating Cox-2, TNF-α, and NOS-2 in Scop-induced mice (p < .05). To summarize, our data encourage Viphyllin as a functional ingredient/dietary supplement for brain health and cognition. PRACTICAL APPLICATIONS: Black pepper is a culinary spice having several medicinal attributes. Essential oils in the seeds of the plant give aroma and flavor to it. Here we have prepared an extract from the seeds of black pepper using supercritical fluid extraction, characterized for the presence of β-caryophyllene (not <30%). This research work further validates the neuroprotective mechanism of the extract in Scopolamine-induced cognitive impairment model mice. The findings from this study strongly suggest the beneficial neuroactive properties of black pepper seed extract having the presence of BCP, a CB2 receptor agonist. It can thus be used potentially as a functional food ingredient for cognition and brain function.
Several methodologies have recently been proposed to evaluate the ability of Pretrained Language ... more Several methodologies have recently been proposed to evaluate the ability of Pretrained Language Models (PLMs) to interpret negation. In this article, we build on Gubelmann and , which studies the modification of PLMs' predictions as a function of the polarity of inputs, in English. Crucially, this test uses "self-contained" inputs ending with a masked position: depending on the polarity of a verb in the input, a particular token is either semantically ruled out or allowed at the masked position. By replicating Gubelmann and Handschuh ( ) experiments, we have uncovered flaws that weaken the conclusions that can be drawn from this test. We thus propose an improved version, the Self-Contained Neg Test, which is more controlled, more systematic, and entirely based on examples forming minimal pairs varying only in the presence or absence of verbal negation in English. When applying our test to the roberta and bert base and large models, we show that only roberta-large shows trends that match the expectations, while bert-base is mostly insensitive to negation. For all the tested models though, in a significant number of test instances the top-1 prediction remains the token that is semantically forbidden by the context, which shows how much room for improvement remains for a proper treatment of the negation phenomenon.
Findings of the Association for Computational Linguistics: ACL 2022, 2022
The biaffine parser of Dozat and Manning (2017) was successfully extended to semantic dependency ... more The biaffine parser of Dozat and Manning (2017) was successfully extended to semantic dependency parsing (SDP) (Dozat and Manning, 2018). Its performance on graphs is surprisingly high given that, without the constraint of producing a tree, all arcs for a given sentence are predicted independently from each other (modulo a shared representation of tokens). To circumvent such an independence of decision, while retaining the O(n 2) complexity and highly parallelizable architecture, we propose to use simple auxiliary tasks that introduce some form of interdependence between arcs. Experiments on the three English acyclic datasets of SemEval 2015 task 18 (Oepen et al., 2015), and on French deep syntactic cyclic graphs (Ribeyre et al., 2014) show modest but systematic performance gains on a near state-ofthe-art baseline using transformer-based contextualized representations. This provides a simple and robust method to boost SDP performance.
This multilingual resource contains corpora for 14 languages, gathered at the occasion of the 1.2... more This multilingual resource contains corpora for 14 languages, gathered at the occasion of the 1.2 edition of the PARSEME Shared Task on semi-supervised Identification of Verbal MWEs (2020). These corpora were meant to serve as additional "raw" corpora, to help discovering unseen verbal MWEs. The corpora are provided in CONLL-U (https://universaldependencies.org/format.html) format. They contain morphosyntactic annotations (parts of speech, lemmas, morphological features, and syntactic dependencies). Depending on the language, the information comes from treebanks (mostly Universal Dependencies v2.x) or from automatic parsers trained on UD v2.x treebanks (e.g., UDPipe). VMWEs include idioms (let the cat out of the bag), light-verb constructions (make a decision), verb-particle constructions (give up), inherently reflexive verbs (help oneself), and multi-verb constructions (make do). For the 1.2 shared task edition, the data covers 14 languages, for which VMWEs were annotated...
We introduce the French Social Media Bank, the first user-generated content treebank for French. ... more We introduce the French Social Media Bank, the first user-generated content treebank for French. Its first release contains 1,700 sentences from various Web 2.0 and social media sources (FACEBOOK, TWITTER, web forums), including data specifically chosen for their high noisiness.
Universal dependencies (UD) is a framework for morphosyntactic annotation of human language, whic... more Universal dependencies (UD) is a framework for morphosyntactic annotation of human language, which to date has been used to create treebanks for more than 100 languages. In this article, we outline the linguistic theory of the UD framework, which draws on a long tradition of typologically oriented grammatical theories. Grammatical relations between words are centrally used to explain how predicate–argument structures are encoded morphosyntactically in different languages while morphological features and part-of-speech classes give the properties of words. We argue that this theory is a good basis for crosslinguistically consistent annotation of typologically diverse languages in a way that supports computational natural language understanding as well as broader linguistic studies.
We present edition 1.2 of the PARSEME shared task on identification of verbal multiword expressio... more We present edition 1.2 of the PARSEME shared task on identification of verbal multiword expressions (VMWEs). Lessons learned from previous editions indicate that VMWEs have low ambiguity, and that the major challenge lies in identifying test instances never seen in the training data. Therefore, this edition focuses on unseen VMWEs. We have split annotated corpora so that the test corpora contain around 300 unseen VMWEs, and we provide non-annotated raw corpora to be used by complementary discovery methods. We released annotated and raw corpora in 14 languages, and this semi-supervised challenge attracted 7 teams who submitted 9 system results. This paper describes the effort of corpus creation, the task design, and the results obtained by the participating systems, especially their performance on unseen expressions.
Nous présentons le French QuestionBank, un corpus arboré composé de 2600 questions annotées en dé... more Nous présentons le French QuestionBank, un corpus arboré composé de 2600 questions annotées en dépendances et en constituants. Les deux tiers étant alignés avec le QuestionBank de l'anglais (Judge et al., 2006), libre de droits, ce corpus saura prouver son utilité pour construire des systèmes d'analyse robuste. Nous discutons aussi des coûts de développement de tels corpus.
β-caryophyllene (BCP), a natural sesquiterpene present in plants, is a selective agonist of canna... more β-caryophyllene (BCP), a natural sesquiterpene present in plants, is a selective agonist of cannabinoid receptor type-2 (CB2) of the endocannabinoid system. In this study, we have prepared an extract from Piper nigrum (black pepper) seeds using supercritical fluid extraction, standardized to contain 30% BCP (ViphyllinTM ). The beneficial effects of prophylactic treatment with Viphyllin on cognitive functions were demonstrated in Scopolamine-induced dementia model mice. Male Swiss albino mice (25-30 g) were administered with Viphyllin (50 mg and 100 mg/kg body weight p.o.) or donepezil (1.60 mg/kg) for 14 days. Subsequently, cognitive deficits were induced by treating the animals intraperitoneally with Scopolamine (0.75 mg/kg). The cognitive behavior of mice was evaluated using a novel object recognition test (NORT) and Morris water maze (MWM) test. The brain homogenates were studied for biochemical parameters including cholinesterase activities and antioxidant status. Western blot analysis was performed to investigate the mechanism of action. Viphyllin dose dependently improved the recognition and spatial memory and cholinergic functions in Scop-treated mice. The extract was found protective against Scop-induced oxidative damage and histopathologic changes in the brain. At 100 mg/kg Viphyllin markedly reduced the proBDNF/mBDNF ratio (p < .05) and augmented the TrkB expression (p < .01). Viphyllin (100 mg/kg) was found to be neuroprotective by reducing the Scop-induced upregulation of p-JNK and p-p38 MAPK proteins, Bax/Bcl-2 ratio, and caspase activation in the brain. Viphyllin also exerted anti-inflammatory effects by downregulating Cox-2, TNF-α, and NOS-2 in Scop-induced mice (p < .05). To summarize, our data encourage Viphyllin as a functional ingredient/dietary supplement for brain health and cognition. PRACTICAL APPLICATIONS: Black pepper is a culinary spice having several medicinal attributes. Essential oils in the seeds of the plant give aroma and flavor to it. Here we have prepared an extract from the seeds of black pepper using supercritical fluid extraction, characterized for the presence of β-caryophyllene (not <30%). This research work further validates the neuroprotective mechanism of the extract in Scopolamine-induced cognitive impairment model mice. The findings from this study strongly suggest the beneficial neuroactive properties of black pepper seed extract having the presence of BCP, a CB2 receptor agonist. It can thus be used potentially as a functional food ingredient for cognition and brain function.
Uploads
Papers by Marie Candito