Lexicometric methods in the study of lifelong learning

I was recently asked to provide a foreword to a new study of the troubled relationship between lifelong learning research and European education policy. The author, Lisa Breyer, was formerly a colleague at the University of Cologne, and is now a head of department at the Volkshochschule Rhein-Erft. While her book is in German, she has published lexicometric analyses in English on approaches to social justice in adult education and on comparisons of national adult education policies.

Given the widespread use of ‘critical discourse analysis’ in Anglophone research in our field, I was delighted to read and recommend a rather different and – as I see it – more grounded method of analysing the languages of lifelong learning policy. If you want to read more of Lisa’s own work in English then take a look at the two papers I mentioned above. What follows here is an expanded and slightly reworked English language version of my foreword.

Adult education research has to position itself in a field rich with tensions, which is influenced by scholarly theory, educational policy, and practical pedagogic demands. Unlike most academic disciplines, the study of adult education developed out of the field of practice, and was also shaped by policy measures. At the same time, policy actors increasingly support their decisions with reference to research findings and recommendations, all in the name of evidence-based policy. Relatively few studies so far have been concerned with the relationship between and form of the communication process between research and policy.

In our field at least, this book presents a new approach to policy research. Lisa Breyer has gone beyond standard approaches, contributing both to our understanding of policy influence and to our methodological repertoire, as well as provoking reflection on the much-debated relationship between policy and research, by subjecting a corpus of 288 texts from adult education research and education policy covering a 20-year period to lexicometric analysis. Her findings force us to think again about the relations between policy and research.

While much discourse analysis tends to be based on the researcher’s reading of a relatively small number of texts, Dr Breyer uses lexicometric techniques to examine and compare the ways in which the core concepts of „Lebenslanges Lernen“ (lifelong learning) und „Kompetenz“ (skill) feature in systematically selected papers from the European Commission as well as in journal articles by adult education researchers. Her analysis of the findings sheds light on relations between research and policy in adult education, as well as on the differing ways in which researchers and policy-makers understand, use, and contextualise the basic concepts in the field. Indeed, even where there is a shared use of terms like lebenslanges Lernen and Kompetenz, Breyer’s findings show that the very notion of a field of adult education is often understood very differently by policy actors and researchers.

Although some of these patterns will seem familiar to readers, as in the divergence between the economic and employment focus of policy as against the emancipatory and critical values of researchers, the book provides a rich variety of evidence and  a refined analysis of the complexities and nuances that can be found. She also examines the attention that each party pays to the other: while researchers refer explicitly to the European level of policy, policy-makers implicitly privilege comparative survey data as their main source of research evidence while turning to researchers as a source of evidence-based policy. This evolving relationship, Breyer contends, means that it is necessary to redefine the relationship between research and policy.

These reflections complement other research and publications of the DIE, particularly in respect to system and policy. However, the book also serves as a case study in a relatively new method. Breyer has adapted her lexicometric approach to the discipline of adult education research and applied it to a corpus of 288 texts, and concludes that the method allows us to identify patterns and relationships that cannot be shown by analysing a handful of texts. This seems to me to have wider methodological ramifications for comparative educational research in general, as well as for adult education research in particular. I am not aware of any other lexicometric study in adult education of such scale and ambition; and personally I am convinced that she has abundantly demonstrated the potential of this approach, and thus makes an important contribution to our methodological debates.

Comparative and international research in adult and lifelong learning

I’m currently working with some German colleagues on a paper about comparative adult education research. Our starting point is our impression that this area of study is not in great shape. And this is in spite of the funding available through European Commission sources to support international and comparative activities.

As a quick way into this area, I carried out a simple search of article titles in three journals. First, I looked for the word “comparative” in titles in the International Journal of Lifelong Education and Adult Education Quarterly; then I searched for “lifelong learning” and “adult education” in titles in Comparative Education and Compare. I confined the search to articles published between 1999 and 2015, and excluded book reviews and short notes.

The first thing to say is that this is a very rough and ready measure. Even though I think these are decent journals, there are many others that I could have chosen. And my search terms meant that I missed some important contributions, including an analysis of the OECD’s PIAAC survey of adult skill, while the dates excluded a European comparative study using fresh survey data. But this was only ever meant to provide a starting point, as well as a simple test of whether our hunch about the poor health of the area is accurate.

Second, there are many more papers on adult learning in the two comparative education journals (42) than papers on comparative studies in the adult education journals (9). Compare came out top with 27 papers, thanks partly to special issues on lifelong learning in 2006 and 2009; Comparative Education also had a special issue on lifelong learning, in 1999. AEQ came bottom, with 2, and neither of the adult education journals published a special comparative issue. I’m not sure what to make of that, other than to find it an interesting pattern.

New Picture

Annual totals of relevant titles in all four journals

Third, if the trend data don’t show a decline, neither do they suggest an area in rude health.  What they do show is the importance of special issues devoted to research on adult learning; and it is worth bearing in mind that as well as the direct boost of a special issue, the articles that feature in it will then generate furthe debate and in turn stimulate more papers. Given this, it is a bit worrying that the last special issue in  these four journals appeared in 2009.

It’s wise not to over-generalise on the basis of limited data and a simplistic analysis, but let me hazard some informed suppositions. I think the special issues were probably largely a response to the rise of policy interest in lifelong learning. It strikes me that the adult education journals aren’t as open to comparative research as the comparative education journals are to studies of adult learning. There is little evidence here of a European effect, though some of the papers may well have drawn on evidence that was provided through EC funding.

All in all, people who care about comparative adult education research have a bit of a challenge on their hands. Or perhaps this is something that we are happy to leave to the OECD and European Commission, who will then undertake surveys that we can contentedly critique, without actually doing much comparative research ourselves?