Detailed Programme
All listed times are in British Summer Time. To convert to your time zone, use the links.
Programme subject to change.
Wednesday October 5, 2022
Time
Description
Welcome
from Robyn Price, LIS-Bibliometrics Committee co-chair
Opening Keynote Address
Deborah Stone, Brandeis University:
“A number is a snake eating its tail: some thoughts on measurement for bibliometricians”
Professor Stone wrote the book Counting: How We Use Numbers to Decide What Matters (2020). During her talk, she will draw on this and other work to challenge the perceived objectivity of numbers when used to measure research and people.
Break
Panel discussion: Developing practices that matter: from local to global
Julia Robinson & Aimee Watson-Cook, Newcastle University, UK
Cesar Orlando Pallares Delgado, Colombian Association of Research Managers (COREMA), Lai Ma, University College Dublin
Chair: Liam Bullingham, LIS-Bibliometrics Committee
Our panellists will each share a different perspective for five minutes – a community of practice for connecting and sharing information at a UK university, a national association comprised of different organisatons using responsible metrics as a conceptual source, and an approach to equality, diversity and inclusion and research culture.
After this, the Chair will address questions on ‘developing practices that matter’ to the panel.
Break
Breakout sessions
• You can’t measure what you can’t define. Why do we get research impact so wrong? Jorge Gomez Magenti, Alzheimers Research UK
The pervasiveness of “impact measurement” platforms like Researchfish are both symptom and cause of the over- metricization of research, and lead to the loss of nuance when thinking about research impact. In this talk we will discuss alternatives for a healthier, more responsible research evaluation.
• A practitioner’s guide to measuring what matters: introducing the INORMS SCOPE Framework. Elizabeth Gadd, Loughborough University
An introduction to the simple five-step SCOPE framework being used all over the world to design and deliver responsible research evaluations. This will include a discussion around engaging senior leaders with responsible research evaluation
Poster presentations
Bilal Hayat Butt, D.H.A. Suffa University, Aiman Fatima, Hatim Khuzema, and Muhammad Azmi Umer, Codex LLC: Karachi
‘Categorising in-text Citations’
– The use of citation as a metric for research evaluation without considering its context can be a problem. Normally, citations present neutral, supporting, or contrasting evidence to a paper. Therefore, treating them equally can affect the quality of research evaluation We have proposed a categorization method for in-text citations. The proposed method uses syntactic, semantic, and IMRaD / zone analysis of citations.
Domenic Rosati, scite.ai and Philippe Mongeon, Dalhousie University
‘Impact of in-text citations on journal rankings’
– Traditional citations are links between publications that lack context. In-text citations measure how many times a publication was cited in text providing additional context on how much that publication was used.
How would ranking change if in-text citations were used?
William H Mischo and Mary C. Schlembach, University of Illinois at Urbana–Champaign (UIUC) Library
‘Bibliometric and Research Impact activities at the University of Illinois at Urbana–Champaign’
– A report of activities from the Library at UIUC including using data vizualizations.
These activities enhance the role of the library in supporting knowledge management and scholarly communication and in fostering campus partnerships.
Break
Lightning Talks
Conference quality: How is it measured now and how else could it be measured? Julian Franken, Leibniz Information Center for Technology and Natural Sciences and University Library
Demonstrating Librarian Research Impact through Bibliometrics, Janice Kung, University of Alberta
Discovering what matters: reflections from new starters in bibliometrics, Beth Norgrove, John Hynes & Mikey Tang, The University of Manchester
Wrap Up
LIS-Bibliometrics Committee co-chair Robyn Price summarises Day 1.
Wednesday October 12, 2022
Welcome
from Zosia Beckles, LIS-Bibliometrics Committee co-chair
Keynote Address
Bianca Kramer, Sesame Open Science: ‘Measuring what matters – open to interpretation?’
In this presentation, Bianca Kramer will address several aspects of openness in research assessment, as well as developments that either facilitate or limit that openness.
This ranges from the freedom researchers, institutions and funders have to decide what is important in assessment, to the availability of data, infrastructure and services to make such assessments possible. Measuring what matters, and how to do that, is open to interpretation – and there are important choices to make!
Break
Lightning talks
Research to be e-visible or invisible? Leslie Adriaanse, University of South Africa
“Counting Back”: What kind of bibliodiversity does the Impact Factor brand reflect ? A case study of IF journals included in the 2021 Journal Citations Report. Christophe Dony & Marjorie Bardiau, University of Liège
Break
Breakout sessions
• Bibliometric competencies and the promotion of responsible use of metrics at Stellenbosch University Library. Marié Roux, Stellenbosch University
The presentation will include an overview of how the Competency Model for Bibliometric Work was applied at Stellenbosch University’s Library and Information Service to improve bibliometric skills and services over a period of 3-4 years. Participation from the audience will be in the form of two polls to get feedback on similar approaches on how to improve bibliometric skills at their own institutions. The outcome of the polls will be discussed at the end of the session.
• Developing an institutional toolkit for implementing responsible research assessment recognising Open Research. Thomas Evans, UK Reproducibility Network (UKRN)
Implementing effective and responsible research assessment to recognise open research practices requires structure and support. This session from UKRN will provide the first major opportunity for experts and stakeholders in metrics and research assessment to engage with, inform, and steer the development of a new suite of tools to enhance implementation consistency and quality.
• Assessing Research Impact – what does it mean in today’s dynamic world? Gali Halevi, Clarivate
Research assessment ‘metrics’ that use publication and citations at their center have accelerated development of grade-like scores across authorships, articles, and journals. There’s a distinct drawback: these scores fail to capture the complexity of the research endeavor and the breadth of the researchers’ contributions, which has led to calls for reform and an exploration of new perspectives and analytics.
In this presentation, we will review traditional assessment tools and share some innovative ideas for moving from ‘metrics’ to ‘indicators’ that are relative, consider specific disciplines and institutional goals, and address the societal impact of research.
Networking
During this session, we will set up six breakout rooms for discussion. This will done in a spontaneous ‘unconference’ style, whereby we will ask for topics at the start then quickly set up the rooms based on these.
Break
Lightning talks, poster award and wrap up
Unsub Extender: a Python-based web application for visualizing Unsub data.
Eric Schares, Iowa State University
‘Introducing The Responsible Research Assessment Tracker – an online tool to advance assessment reform’.
Alex Rushforth, CWTS, Leiden University
Poster award:
We will be asking delegates to vote for the best poster from Day 1 and will award the winner at the end of this session.
Wrap Up
LIS-Bibliometrics Committee co-chair Zosia Beckles summarises Day 2 and closes the Conference.
LIS-B Conference 