The development and use of language resources often involve the processing of personal data. The ... more The development and use of language resources often involve the processing of personal data. The General Data Protection Regulation (GDPR) establishes an EU-wide framework for the processing of personal data for research purposes while at the same time it allows for some flexibility on the part of the Member States. The paper discusses the legal framework for language research following the entry into force of the GDPR. To this goal, we first present some fundamental concepts of data protection relevant for language research and then focus on the models that certain EU member states use to regulate data processing for research purposes.
Towards a general lexical infrastructure: Karp Thanks to the various interlinked projects of the ... more Towards a general lexical infrastructure: Karp Thanks to the various interlinked projects of the SweFN++ initiative, Språkbanken Text has had the opportunity to develop a generalized lexical infrastructure, referred to as
Technical documentation is riddled with domain specific terminology which needs to be detected an... more Technical documentation is riddled with domain specific terminology which needs to be detected and properly organized in order to be meaningfully used. In this paper we describe how we coped with the problem of terminology detection for a specific type of document and how the extracted terminology was used within the context of our Answer Extraction System. 1.
Digitalisation of cultural heritage in Estonia has been in progress during recent years, and we w... more Digitalisation of cultural heritage in Estonia has been in progress during recent years, and we will see expansive mass digitalisation of printed books and handwritten documents in the very near future. This situation and potential actualises questions of the usage of the literary heritage. In our paper, we consider benefits for digital literary research that arise from representing a literary text collection as an annotated language resource. We discuss the pilot project of creating a text corpus based on private letters between two Estonian avantgarde writers in the beginning of the 20th century. The advantages and possibilities of corpus query system KORP that we have chosen for representing and searching literary heritage DH corpora as a language resource are described. Challenges that the application of Natural Language Processing and Text and Data Mining imposes on the preparation and representation of texts are discussed along with benefits for the research.
Since 2016, the tour de CLARIN initiative has been periodically highlighting prominent user invol... more Since 2016, the tour de CLARIN initiative has been periodically highlighting prominent user involvement activities in the CLARIN network in order to increase the visibility of its members, reveal the richness of the CLARIN landscape, and display the full range of activities that show what CLARIN has to offer to researchers, teachers, students, professionals and the general public interested in using and processing language data in various forms. the initiative was initially conceived as a series of blog posts published on the CLARIN webpage and disseminated through the CLARIN newsflash and social media channels. In 2018, the results of the initiative were published in<br> a printed volume. Gradually, Tour de CLARIN has proven to be one of the flagship user involvement initiatives by CLARIN ERIC, is highly valuable for our network and incredibly popular with our readers. that is why the initiative has since been expanded from presentations of the work carried out by national co...
Language researchers are usually aware of intellectual property and personal data (PD) requiremen... more Language researchers are usually aware of intellectual property and personal data (PD) requirements. The problem, however, arises when these two legal regimes have conflicting requirements. For instance, when copyright law requires the acknowledgement of the author, but personal data law enshrines the data minimisation principle. It is a practical question for a language researcher whether he should name the author of the text used for, e.g., building a language model, or follow the data minimisation principle not to name the author. The access right that a data subject has introduces similar conflicts. The question is what the scope of the access right is. Does it cover only processed personal data, or does it extend to data derived from PD?
The article aims to increase legal clarity concerning the impact of data containing copyrighted c... more The article aims to increase legal clarity concerning the impact of data containing copyrighted content and personal data on the development of language technologies. The question is whether legal rights covering data affect language models.
Sometimes legal scholars get relevant but baffling questions from laypersons like: "The reference... more Sometimes legal scholars get relevant but baffling questions from laypersons like: "The reference to a work is personal data, so does the GDPR actually require me to anonymise it? Or, as my voice data is personal data, does the GDPR automatically give me access to a speech recognizer using my voice sample? Or, can I say anything about myself without the GDPR requiring the web host to anonymise or remove the post? What can I say about others like politicians? And, what can researchers say about patients in a research report?" Based on these questions, the authors address the interaction of intellectual property and data protection law in the context of data minimisation and attribution rights, access rights, trade secret protection, and freedom of expression.
WN is an on-line lexical reference system whose design is inspired by current psycholinguistic th... more WN is an on-line lexical reference system whose design is inspired by current psycholinguistic theories of human lexical memory. Nouns, verbs, adjectives and adverbs are organised into synonym sets, each representing one underlying lexical concept. Different kinds of semantic relations link the synonym sets (synsets). WN is based on word meaning; all of the words that can express a given sense are grouped together in a SYNONYM SET, or SYNSET (see also Vider K., Orav H. 1996. WORDNET: An On-line Lexical Database. Papers of the First Swiss-Estonian Student Workshop on Computational and Theoretical Linguistics: 64-68).
In this paper, we study KM-arcs of type t, i.e. point sets of size q + t in PG(2, q) such that ev... more In this paper, we study KM-arcs of type t, i.e. point sets of size q + t in PG(2, q) such that every line contains 0, 2 or t of its points. We use field reduction to give a different point of view on the class of translation arcs. Starting from a particular F 2-linear set, called an i-club, we reconstruct the projective triads, the translation hyperovals as well as the translation arcs constructed by Korchmáros-Mazzocca, Gács-Weiner and Limbupasiriporn. We show the KM-arcs of type q/4 recently constructed by Vandendriessche are translation arcs and fit in this family. Finally, we construct a family of KM-arcs of type q/4. We show that this family, apart from new examples that are not translation KM-arcs, contains all translation KM-arcs of type q/4.
The authors address the legal issues relating to the creation and use of language models. The art... more The authors address the legal issues relating to the creation and use of language models. The article begins with an explanation of the development of language technologies. The authors analyse the technological process within the framework copyright, related rights and personal data protection law. The authors also cover commercial use of language models. The authors' main argument is that legal restrictions applicable to language data containing copyrighted material and personal data usually do not apply to language models. Language models are generally not considered derivative works. Due to a wide range of language models, this position is not absolute.
It is well known that one of the greatest hurdles in automatically processing technical documenta... more It is well known that one of the greatest hurdles in automatically processing technical documentation is the large amount of specific terminology that characterizes these domains. Terminology poses two major challenges to the developers of NLP applications: how to identify domain specific terms in the documents and how to efficiently process them. In this paper we will present methodologies that we have used to extract and bootstrap a terminological database and its usage in an answer extraction system.
One source of Estonian WordNet have been corpora of Estonian. On the other hand, we get intereste... more One source of Estonian WordNet have been corpora of Estonian. On the other hand, we get interested in word sense disambiguation, and about 100,000 words in corpora are manually disambiguated according to Estonian WordNet senses. The aim of this paper is to explain some theoretical problems that "do not work well in practice". These include the differentiation of word senses, metaphors, and conceptual word combinations.
The purpose of this article is to explain the extent to which the legal regime applicable to lang... more The purpose of this article is to explain the extent to which the legal regime applicable to language data affects the development and use of language technology (LT). The main focus of the paper is on EU law. The article also maps possible text and data mining (TDM) issues. The authors focus on TDM for research purposes outlined in the Digital Copyright Directive 2019/790. The authors follow a process approach of LT development, which starts from raw data collection and leads to LT products such as a refrigerator with a speech interface. Particular attention is given to language models. The raw data used in LT often include copyright-protected works, objects of related rights (e.g., performances) and personal data in the form of person's voice or other information stored in non-annotated and annotated databases. The authors' main argument is that the legal regime of language data does not usually affect the use of language models since copyrighted works are not likely to remain in models. In the process of developing a language technology application, language models are the first intermediate result that can be free from legal restrictions affecting language data. 1 The article draws on and develops further the authors' previous research.
... a) jutustamine tuntud pildiraamatu või juturaamatu (&amp;quot;Naksitrallid&amp;quot;,... more ... a) jutustamine tuntud pildiraamatu või juturaamatu (&amp;quot;Naksitrallid&amp;quot;, &amp;quot;Väike merineitsi&amp;quot;, &amp;quot;AB mudilastele&amp;quot;, &amp;quot;Triinu ja Taavi lood&amp;quot;) järgi - neis tekstides esineb ... Martin 3.6 114 182 402 PM REILI9 joonistamine vesivärvidega Anni 3.6 101 130 239 TA RENNA1 &amp;quot;Triinu ja Taavi lood&amp;quot; ...
Selected Papers from the CLARIN Annual Conference 2020, 2021
The article focuses on determining responsible parties and the division of potential liability ar... more The article focuses on determining responsible parties and the division of potential liability arising from sharing language data (LD) containing personal data (PD). A key issue here is to identify who has to make sure and guarantee the GDPR compliance. The authors aim to answer 1) whether an individual researcher is a controller and 2) whether sharing LD results in joint controllership or separate controllership (whether the data's transferee becomes the controller, the joint controller or the processor). The article also analyses the legal relations of parties involved in data sharing and potential liability. The final section outlines data sharing in the CLARIN context. The analysis serves as a preliminary analytical background for redesigning the CLARIN contractual framework for sharing data.
The development and use of language resources often involve the processing of personal data. The ... more The development and use of language resources often involve the processing of personal data. The General Data Protection Regulation (GDPR) establishes an EU-wide framework for the processing of personal data for research purposes while at the same time allowing for some flexibility on the part of the Member States. The paper discusses the legal framework for language research following the entry into force of the GDPR. In the first section, we present some fundamental concepts of data protection relevant to language research. In the second section, the general framework of processing personal data for research purposes is discussed. In the last section, we focus on the models that certain EU Member States use to regulate data processing for research purposes.
The development and use of language resources often involve the processing of personal data. The ... more The development and use of language resources often involve the processing of personal data. The General Data Protection Regulation (GDPR) establishes an EU-wide framework for the processing of personal data for research purposes while at the same time it allows for some flexibility on the part of the Member States. The paper discusses the legal framework for language research following the entry into force of the GDPR. To this goal, we first present some fundamental concepts of data protection relevant for language research and then focus on the models that certain EU member states use to regulate data processing for research purposes.
Towards a general lexical infrastructure: Karp Thanks to the various interlinked projects of the ... more Towards a general lexical infrastructure: Karp Thanks to the various interlinked projects of the SweFN++ initiative, Språkbanken Text has had the opportunity to develop a generalized lexical infrastructure, referred to as
Technical documentation is riddled with domain specific terminology which needs to be detected an... more Technical documentation is riddled with domain specific terminology which needs to be detected and properly organized in order to be meaningfully used. In this paper we describe how we coped with the problem of terminology detection for a specific type of document and how the extracted terminology was used within the context of our Answer Extraction System. 1.
Digitalisation of cultural heritage in Estonia has been in progress during recent years, and we w... more Digitalisation of cultural heritage in Estonia has been in progress during recent years, and we will see expansive mass digitalisation of printed books and handwritten documents in the very near future. This situation and potential actualises questions of the usage of the literary heritage. In our paper, we consider benefits for digital literary research that arise from representing a literary text collection as an annotated language resource. We discuss the pilot project of creating a text corpus based on private letters between two Estonian avantgarde writers in the beginning of the 20th century. The advantages and possibilities of corpus query system KORP that we have chosen for representing and searching literary heritage DH corpora as a language resource are described. Challenges that the application of Natural Language Processing and Text and Data Mining imposes on the preparation and representation of texts are discussed along with benefits for the research.
Since 2016, the tour de CLARIN initiative has been periodically highlighting prominent user invol... more Since 2016, the tour de CLARIN initiative has been periodically highlighting prominent user involvement activities in the CLARIN network in order to increase the visibility of its members, reveal the richness of the CLARIN landscape, and display the full range of activities that show what CLARIN has to offer to researchers, teachers, students, professionals and the general public interested in using and processing language data in various forms. the initiative was initially conceived as a series of blog posts published on the CLARIN webpage and disseminated through the CLARIN newsflash and social media channels. In 2018, the results of the initiative were published in<br> a printed volume. Gradually, Tour de CLARIN has proven to be one of the flagship user involvement initiatives by CLARIN ERIC, is highly valuable for our network and incredibly popular with our readers. that is why the initiative has since been expanded from presentations of the work carried out by national co...
Language researchers are usually aware of intellectual property and personal data (PD) requiremen... more Language researchers are usually aware of intellectual property and personal data (PD) requirements. The problem, however, arises when these two legal regimes have conflicting requirements. For instance, when copyright law requires the acknowledgement of the author, but personal data law enshrines the data minimisation principle. It is a practical question for a language researcher whether he should name the author of the text used for, e.g., building a language model, or follow the data minimisation principle not to name the author. The access right that a data subject has introduces similar conflicts. The question is what the scope of the access right is. Does it cover only processed personal data, or does it extend to data derived from PD?
The article aims to increase legal clarity concerning the impact of data containing copyrighted c... more The article aims to increase legal clarity concerning the impact of data containing copyrighted content and personal data on the development of language technologies. The question is whether legal rights covering data affect language models.
Sometimes legal scholars get relevant but baffling questions from laypersons like: "The reference... more Sometimes legal scholars get relevant but baffling questions from laypersons like: "The reference to a work is personal data, so does the GDPR actually require me to anonymise it? Or, as my voice data is personal data, does the GDPR automatically give me access to a speech recognizer using my voice sample? Or, can I say anything about myself without the GDPR requiring the web host to anonymise or remove the post? What can I say about others like politicians? And, what can researchers say about patients in a research report?" Based on these questions, the authors address the interaction of intellectual property and data protection law in the context of data minimisation and attribution rights, access rights, trade secret protection, and freedom of expression.
WN is an on-line lexical reference system whose design is inspired by current psycholinguistic th... more WN is an on-line lexical reference system whose design is inspired by current psycholinguistic theories of human lexical memory. Nouns, verbs, adjectives and adverbs are organised into synonym sets, each representing one underlying lexical concept. Different kinds of semantic relations link the synonym sets (synsets). WN is based on word meaning; all of the words that can express a given sense are grouped together in a SYNONYM SET, or SYNSET (see also Vider K., Orav H. 1996. WORDNET: An On-line Lexical Database. Papers of the First Swiss-Estonian Student Workshop on Computational and Theoretical Linguistics: 64-68).
In this paper, we study KM-arcs of type t, i.e. point sets of size q + t in PG(2, q) such that ev... more In this paper, we study KM-arcs of type t, i.e. point sets of size q + t in PG(2, q) such that every line contains 0, 2 or t of its points. We use field reduction to give a different point of view on the class of translation arcs. Starting from a particular F 2-linear set, called an i-club, we reconstruct the projective triads, the translation hyperovals as well as the translation arcs constructed by Korchmáros-Mazzocca, Gács-Weiner and Limbupasiriporn. We show the KM-arcs of type q/4 recently constructed by Vandendriessche are translation arcs and fit in this family. Finally, we construct a family of KM-arcs of type q/4. We show that this family, apart from new examples that are not translation KM-arcs, contains all translation KM-arcs of type q/4.
The authors address the legal issues relating to the creation and use of language models. The art... more The authors address the legal issues relating to the creation and use of language models. The article begins with an explanation of the development of language technologies. The authors analyse the technological process within the framework copyright, related rights and personal data protection law. The authors also cover commercial use of language models. The authors' main argument is that legal restrictions applicable to language data containing copyrighted material and personal data usually do not apply to language models. Language models are generally not considered derivative works. Due to a wide range of language models, this position is not absolute.
It is well known that one of the greatest hurdles in automatically processing technical documenta... more It is well known that one of the greatest hurdles in automatically processing technical documentation is the large amount of specific terminology that characterizes these domains. Terminology poses two major challenges to the developers of NLP applications: how to identify domain specific terms in the documents and how to efficiently process them. In this paper we will present methodologies that we have used to extract and bootstrap a terminological database and its usage in an answer extraction system.
One source of Estonian WordNet have been corpora of Estonian. On the other hand, we get intereste... more One source of Estonian WordNet have been corpora of Estonian. On the other hand, we get interested in word sense disambiguation, and about 100,000 words in corpora are manually disambiguated according to Estonian WordNet senses. The aim of this paper is to explain some theoretical problems that "do not work well in practice". These include the differentiation of word senses, metaphors, and conceptual word combinations.
The purpose of this article is to explain the extent to which the legal regime applicable to lang... more The purpose of this article is to explain the extent to which the legal regime applicable to language data affects the development and use of language technology (LT). The main focus of the paper is on EU law. The article also maps possible text and data mining (TDM) issues. The authors focus on TDM for research purposes outlined in the Digital Copyright Directive 2019/790. The authors follow a process approach of LT development, which starts from raw data collection and leads to LT products such as a refrigerator with a speech interface. Particular attention is given to language models. The raw data used in LT often include copyright-protected works, objects of related rights (e.g., performances) and personal data in the form of person's voice or other information stored in non-annotated and annotated databases. The authors' main argument is that the legal regime of language data does not usually affect the use of language models since copyrighted works are not likely to remain in models. In the process of developing a language technology application, language models are the first intermediate result that can be free from legal restrictions affecting language data. 1 The article draws on and develops further the authors' previous research.
... a) jutustamine tuntud pildiraamatu või juturaamatu (&amp;quot;Naksitrallid&amp;quot;,... more ... a) jutustamine tuntud pildiraamatu või juturaamatu (&amp;quot;Naksitrallid&amp;quot;, &amp;quot;Väike merineitsi&amp;quot;, &amp;quot;AB mudilastele&amp;quot;, &amp;quot;Triinu ja Taavi lood&amp;quot;) järgi - neis tekstides esineb ... Martin 3.6 114 182 402 PM REILI9 joonistamine vesivärvidega Anni 3.6 101 130 239 TA RENNA1 &amp;quot;Triinu ja Taavi lood&amp;quot; ...
Selected Papers from the CLARIN Annual Conference 2020, 2021
The article focuses on determining responsible parties and the division of potential liability ar... more The article focuses on determining responsible parties and the division of potential liability arising from sharing language data (LD) containing personal data (PD). A key issue here is to identify who has to make sure and guarantee the GDPR compliance. The authors aim to answer 1) whether an individual researcher is a controller and 2) whether sharing LD results in joint controllership or separate controllership (whether the data's transferee becomes the controller, the joint controller or the processor). The article also analyses the legal relations of parties involved in data sharing and potential liability. The final section outlines data sharing in the CLARIN context. The analysis serves as a preliminary analytical background for redesigning the CLARIN contractual framework for sharing data.
The development and use of language resources often involve the processing of personal data. The ... more The development and use of language resources often involve the processing of personal data. The General Data Protection Regulation (GDPR) establishes an EU-wide framework for the processing of personal data for research purposes while at the same time allowing for some flexibility on the part of the Member States. The paper discusses the legal framework for language research following the entry into force of the GDPR. In the first section, we present some fundamental concepts of data protection relevant to language research. In the second section, the general framework of processing personal data for research purposes is discussed. In the last section, we focus on the models that certain EU Member States use to regulate data processing for research purposes.
Uploads
Papers by Kadri Vider