We argue that statistical practice in the social and behavioral sciences benefits from transparen... more We argue that statistical practice in the social and behavioral sciences benefits from transparency, a fair acknowledgement of uncertainty, and openness to alternative interpretations. To promote such a practice, we recommend seven concrete statistical procedures: (1) visualizing data; (2) quantifying inferential uncertainty; (3) assessing data preprocessing choices; (4) reporting multiple models; (5) involving multiple analysts; (6) interpreting results modestly; and (7) sharing data and code. We discuss their benefits and limitations, and provide guidelines for adoption. Each of the seven procedures finds inspiration in Merton's ethos of science as reflected in the norms of communalism, universalism, disinterestedness, and organized skepticism. We believe that these ethical considerations --and their statistical consequences-- establish common ground among data analysts, despite continuing disagreements about the foundations of statistical inference.
Psychology researchers are rapidly adopting open science practices, yet clear guidelines on how t... more Psychology researchers are rapidly adopting open science practices, yet clear guidelines on how to apply these practices to meta-analysis remain lacking. In this tutorial, we describe why open science is important in the context of meta-analysis in psychology, and suggest how to adopt the three main components of open science: preregistration, open materials, and open data. We first describe how to make the preregistration as thorough as possible—and how to handle deviations from the plan. We then focus on creating easy-to-read materials (e.g., search syntax, R scripts) to facilitate reproducibility and bolster the impact of a meta-analysis. Finally, we suggest how to organize data (e.g., literature search results, data extracted from studies) that are easy to share, interpret, and update as new studies emerge. For each step of the meta-analysis, we provide example templates, accompanied by brief video tutorials, and show how to integrate these practices into the Open Science Framew...
The purpose of this study is to investigate whether individuals learn more effectively when given... more The purpose of this study is to investigate whether individuals learn more effectively when given incremental or variable problem-solving experience, relative to consistent problem-solving experience.
This a second study that aims to examine whether the prosocial simulation effect can be generaliz... more This a second study that aims to examine whether the prosocial simulation effect can be generalized across helping targets and situations
This study w as designed to compare the relevance of self-report questionnaires and performance-b... more This study w as designed to compare the relevance of self-report questionnaires and performance-based tests to assess movement imagery ability in sports. Participants included elite and novice athletes, from fencing, judo and wrestling, who completed a self-report, the Movement I magery Questionnaire-Revised (MIQ-R; Hall & Martin, 1997), and tw o performance-based tests, the Movement I magery Specific Test (MI ST), and the Mental Rotation Test (MRT; Vandenberg & Kuse, 1978). There was no significant effect of the expertise v ariable on the MIQ-R performance, although the results yielded a positive effect of expertise on the MIST and on the MRT. Besides, results showed no correlations between the MIQ-R and the MIST, or between the MIQ-R and the MRT. However, we found a correlation between the MIST and the MRT. These findings are in line with research dissociating imagery measured by self-reports and spatial ability assessed through performance-based tests, and are discussed in terms of their implication in using self-report questionnaires in experimental psychology in general, and to assess movement imagery ability in sports in particular.
Psychological constructs are necessary abstractions to operationalize otherwise intractable entit... more Psychological constructs are necessary abstractions to operationalize otherwise intractable entities. However, the way constructs are defined and refined over time introduces notable bias into models of behaviour, which prevents effective knowledge building within and across subfields.
Supplemental material, Gamble_Supplemental_Materials for Specificity of Future Thinking in Depres... more Supplemental material, Gamble_Supplemental_Materials for Specificity of Future Thinking in Depression: A Meta-Analysis by Beau Gamble, David Moreau, Lynette J. Tippett and Donna Rose Addis in Perspectives on Psychological Science
Advances in Methods and Practices in Psychological Science
Containers have become increasingly popular in computing and software engineering and are gaining... more Containers have become increasingly popular in computing and software engineering and are gaining traction in scientific research. They allow packaging up all code and dependencies to ensure that analyses run reliably across a range of operating systems and software versions. Despite being a crucial component for reproducible science, containerization has yet to become mainstream in psychology. In this tutorial, we describe the logic behind containers, what they are, and the practical problems they can solve. We walk the reader through the implementation of containerization within a research workflow with examples using Docker and R. Specifically, we describe how to use existing containers, build personalized containers, and share containers alongside publications. We provide a worked example that includes all steps required to set up a container for a research project and can easily be adapted and extended. We conclude with a discussion of the possibilities afforded by the large-sc...
Individual differences in mental rotation are well-documented but poorly understood. In fact, how... more Individual differences in mental rotation are well-documented but poorly understood. In fact, how they evolve across lifespan still remains to be specified. To that purpose, we assessed mental rotation ability in Bachelor of Sciences and Bachelor of Arts American students, during their freshman year. They took the Mental Rotation Test twice, at the beginning and the end of the academic year. Results show significant effects of Academic Program (BS>BA) and gender (males>females) in both sessions, as expected from previous research. However, the Academic Program effect increased significantly from one session to another, with exposure to program-specific learning contents, whereas gender differences remained stable. These findings highlight the developmental effect on mental rotation in a single study, providing further evidence for the plasticity of spatial abilities in early adulthood and the need to reflect on the learning materials used in higher education institutions.
Advances in Methods and Practices in Psychological Science, 2021
Containers have become increasingly popular in computing and software engineering and are gaining... more Containers have become increasingly popular in computing and software engineering and are gaining traction in scientific research. They allow packaging up all code and dependencies to ensure that analyses run reliably across a range of operating systems and software versions. Despite being a crucial component for reproducible science, containerization has yet to become mainstream in psychology. In this tutorial, we describe the logic behind containers, what they are, and the practical problems they can solve. We walk the reader through the implementation of containerization within a research workflow with examples using Docker and R. Specifically, we describe how to use existing containers, build personalized containers, and share containers alongside publications. We provide a worked example that includes all steps required to set up a container for a research project and can easily be adapted and extended. We conclude with a discussion of the possibilities afforded by the large-sc...
Recently, numerous studies have demonstrated the significant effect of exercising on human cognit... more Recently, numerous studies have demonstrated the significant effect of exercising on human cognition and brain’s plasticity, in children as well as adults. While providing the latest development and findings in a fast-growing area, this paper offers several original ideas on how the relevant research in connected fields such as cognitive sciences, neuropsychology and neuroanatomy can be applied to sports practice, in order to optimize its cognitive outcomes. The authors provide the reader with practical situations in a sport context, easy to apply in any kind of environment, and targeting cognitive functioning. Overall, it shows how sport can constitute a viable alternative to more traditional computerized tasks when it comes to enhancing general cognitive abilities at all ages.
A common challenge in developmental research is the amount of incomplete and missing data that oc... more A common challenge in developmental research is the amount of incomplete and missing data that occurs from respondents failing to complete tasks or questionnaires, as well as from disengaging from the study (i.e., attrition). This missingness can lead to biases in parameter estimates and, hence, in the interpretation of findings. These biases can be addressed through statistical techniques that adjust for missing data, such as multiple imputation. Although this technique is highly effective, it has not been widely adopted by developmental scientists given barriers such as lack of training or misconceptions about imputation methods and instead utilizing default methods within software like listwise deletion. This manuscript is intended to provide practical guidelines for developmental researchers to follow when examining their data for missingness, making decisions about how to handle that missingness, and reporting the extent of missing data biases and specific multiple imputation p...
Physical exercise has been shown to relate to cognitive performance in a diverse range of populat... more Physical exercise has been shown to relate to cognitive performance in a diverse range of populations, including children. Evidence has also indicated that the link is at least partly causal, with exercise interventions bringing a myriad of benefits to cognitive development. However, not all types of exercise regimens appear to be created equal—recent findings suggest that although ubiquitous, aerobic exercise might benefit from added components, either in terms of training modalities or cognitive demands. Here, I briefly review evidence for the general impact of physical exercise on cognitive development, before focusing in more detail on recent trends in exercise-induced cognitive enhancement. In particular, I emphasize the importance of exercise intensity, and argue that, given time constraints, aerobic exercise might not always be an optimal way to target the brain. I then discuss the potential for including additional components within exercise regimens, to enable more general,...
In scientific communication, figures are typically rendered as static displays. This often preven... more In scientific communication, figures are typically rendered as static displays. This often prevents active exploration of the underlying data, for example to gauge the influence of particular data points or of particular analytic choices. Yet modern data visualization tools, from animated plots to interactive notebooks and reactive web applications, allow psychologists to share and present their findings in dynamic and transparent ways. In this tutorial, we present a number of recent developments to build interactivity and animations into scientific communication and publications, using examples and illustrations in the R language. In particular, we discuss when and how to build dynamic figures, with step-by-step reproducible code that can easily be extended to the reader’s own projects. We illustrate how interactivity and animations can facilitate insight and communication across a project lifecycle—from initial exchanges and discussions within a team to peer-review and final publi...
Recently, there has been a growing emphasis on embedding open and reproducible approaches into re... more Recently, there has been a growing emphasis on embedding open and reproducible approaches into research. One essential step in accomplishing this larger goal is to embed such practices into undergraduate and postgraduate research training. However, this often requires substantial time and resources to implement. Also, while many pedagogical resources are regularly developed for this purpose, they are not often openly and actively shared with the wider community. The creation and public sharing of open educational resources is useful for educators who wish to embed open scholarship and reproducibility into their teaching and learning. In this article, we describe and openly share a bank of teaching resources and lesson plans on the broad topics of open scholarship, open science, replication, and reproducibility that can be integrated into taught courses, to support educators and instructors. These resources were created as part of the Society for the Improvement of Psychological Scie...
We argue that statistical practice in the social and behavioral sciences benefits from transparen... more We argue that statistical practice in the social and behavioral sciences benefits from transparency, a fair acknowledgement of uncertainty, and openness to alternative interpretations. To promote such a practice, we recommend seven concrete statistical procedures: (1) visualizing data; (2) quantifying inferential uncertainty; (3) assessing data preprocessing choices; (4) reporting multiple models; (5) involving multiple analysts; (6) interpreting results modestly; and (7) sharing data and code. We discuss their benefits and limitations, and provide guidelines for adoption. Each of the seven procedures finds inspiration in Merton's ethos of science as reflected in the norms of communalism, universalism, disinterestedness, and organized skepticism. We believe that these ethical considerations --and their statistical consequences-- establish common ground among data analysts, despite continuing disagreements about the foundations of statistical inference.
Psychology researchers are rapidly adopting open science practices, yet clear guidelines on how t... more Psychology researchers are rapidly adopting open science practices, yet clear guidelines on how to apply these practices to meta-analysis remain lacking. In this tutorial, we describe why open science is important in the context of meta-analysis in psychology, and suggest how to adopt the three main components of open science: preregistration, open materials, and open data. We first describe how to make the preregistration as thorough as possible—and how to handle deviations from the plan. We then focus on creating easy-to-read materials (e.g., search syntax, R scripts) to facilitate reproducibility and bolster the impact of a meta-analysis. Finally, we suggest how to organize data (e.g., literature search results, data extracted from studies) that are easy to share, interpret, and update as new studies emerge. For each step of the meta-analysis, we provide example templates, accompanied by brief video tutorials, and show how to integrate these practices into the Open Science Framew...
The purpose of this study is to investigate whether individuals learn more effectively when given... more The purpose of this study is to investigate whether individuals learn more effectively when given incremental or variable problem-solving experience, relative to consistent problem-solving experience.
This a second study that aims to examine whether the prosocial simulation effect can be generaliz... more This a second study that aims to examine whether the prosocial simulation effect can be generalized across helping targets and situations
This study w as designed to compare the relevance of self-report questionnaires and performance-b... more This study w as designed to compare the relevance of self-report questionnaires and performance-based tests to assess movement imagery ability in sports. Participants included elite and novice athletes, from fencing, judo and wrestling, who completed a self-report, the Movement I magery Questionnaire-Revised (MIQ-R; Hall & Martin, 1997), and tw o performance-based tests, the Movement I magery Specific Test (MI ST), and the Mental Rotation Test (MRT; Vandenberg & Kuse, 1978). There was no significant effect of the expertise v ariable on the MIQ-R performance, although the results yielded a positive effect of expertise on the MIST and on the MRT. Besides, results showed no correlations between the MIQ-R and the MIST, or between the MIQ-R and the MRT. However, we found a correlation between the MIST and the MRT. These findings are in line with research dissociating imagery measured by self-reports and spatial ability assessed through performance-based tests, and are discussed in terms of their implication in using self-report questionnaires in experimental psychology in general, and to assess movement imagery ability in sports in particular.
Psychological constructs are necessary abstractions to operationalize otherwise intractable entit... more Psychological constructs are necessary abstractions to operationalize otherwise intractable entities. However, the way constructs are defined and refined over time introduces notable bias into models of behaviour, which prevents effective knowledge building within and across subfields.
Supplemental material, Gamble_Supplemental_Materials for Specificity of Future Thinking in Depres... more Supplemental material, Gamble_Supplemental_Materials for Specificity of Future Thinking in Depression: A Meta-Analysis by Beau Gamble, David Moreau, Lynette J. Tippett and Donna Rose Addis in Perspectives on Psychological Science
Advances in Methods and Practices in Psychological Science
Containers have become increasingly popular in computing and software engineering and are gaining... more Containers have become increasingly popular in computing and software engineering and are gaining traction in scientific research. They allow packaging up all code and dependencies to ensure that analyses run reliably across a range of operating systems and software versions. Despite being a crucial component for reproducible science, containerization has yet to become mainstream in psychology. In this tutorial, we describe the logic behind containers, what they are, and the practical problems they can solve. We walk the reader through the implementation of containerization within a research workflow with examples using Docker and R. Specifically, we describe how to use existing containers, build personalized containers, and share containers alongside publications. We provide a worked example that includes all steps required to set up a container for a research project and can easily be adapted and extended. We conclude with a discussion of the possibilities afforded by the large-sc...
Individual differences in mental rotation are well-documented but poorly understood. In fact, how... more Individual differences in mental rotation are well-documented but poorly understood. In fact, how they evolve across lifespan still remains to be specified. To that purpose, we assessed mental rotation ability in Bachelor of Sciences and Bachelor of Arts American students, during their freshman year. They took the Mental Rotation Test twice, at the beginning and the end of the academic year. Results show significant effects of Academic Program (BS>BA) and gender (males>females) in both sessions, as expected from previous research. However, the Academic Program effect increased significantly from one session to another, with exposure to program-specific learning contents, whereas gender differences remained stable. These findings highlight the developmental effect on mental rotation in a single study, providing further evidence for the plasticity of spatial abilities in early adulthood and the need to reflect on the learning materials used in higher education institutions.
Advances in Methods and Practices in Psychological Science, 2021
Containers have become increasingly popular in computing and software engineering and are gaining... more Containers have become increasingly popular in computing and software engineering and are gaining traction in scientific research. They allow packaging up all code and dependencies to ensure that analyses run reliably across a range of operating systems and software versions. Despite being a crucial component for reproducible science, containerization has yet to become mainstream in psychology. In this tutorial, we describe the logic behind containers, what they are, and the practical problems they can solve. We walk the reader through the implementation of containerization within a research workflow with examples using Docker and R. Specifically, we describe how to use existing containers, build personalized containers, and share containers alongside publications. We provide a worked example that includes all steps required to set up a container for a research project and can easily be adapted and extended. We conclude with a discussion of the possibilities afforded by the large-sc...
Recently, numerous studies have demonstrated the significant effect of exercising on human cognit... more Recently, numerous studies have demonstrated the significant effect of exercising on human cognition and brain’s plasticity, in children as well as adults. While providing the latest development and findings in a fast-growing area, this paper offers several original ideas on how the relevant research in connected fields such as cognitive sciences, neuropsychology and neuroanatomy can be applied to sports practice, in order to optimize its cognitive outcomes. The authors provide the reader with practical situations in a sport context, easy to apply in any kind of environment, and targeting cognitive functioning. Overall, it shows how sport can constitute a viable alternative to more traditional computerized tasks when it comes to enhancing general cognitive abilities at all ages.
A common challenge in developmental research is the amount of incomplete and missing data that oc... more A common challenge in developmental research is the amount of incomplete and missing data that occurs from respondents failing to complete tasks or questionnaires, as well as from disengaging from the study (i.e., attrition). This missingness can lead to biases in parameter estimates and, hence, in the interpretation of findings. These biases can be addressed through statistical techniques that adjust for missing data, such as multiple imputation. Although this technique is highly effective, it has not been widely adopted by developmental scientists given barriers such as lack of training or misconceptions about imputation methods and instead utilizing default methods within software like listwise deletion. This manuscript is intended to provide practical guidelines for developmental researchers to follow when examining their data for missingness, making decisions about how to handle that missingness, and reporting the extent of missing data biases and specific multiple imputation p...
Physical exercise has been shown to relate to cognitive performance in a diverse range of populat... more Physical exercise has been shown to relate to cognitive performance in a diverse range of populations, including children. Evidence has also indicated that the link is at least partly causal, with exercise interventions bringing a myriad of benefits to cognitive development. However, not all types of exercise regimens appear to be created equal—recent findings suggest that although ubiquitous, aerobic exercise might benefit from added components, either in terms of training modalities or cognitive demands. Here, I briefly review evidence for the general impact of physical exercise on cognitive development, before focusing in more detail on recent trends in exercise-induced cognitive enhancement. In particular, I emphasize the importance of exercise intensity, and argue that, given time constraints, aerobic exercise might not always be an optimal way to target the brain. I then discuss the potential for including additional components within exercise regimens, to enable more general,...
In scientific communication, figures are typically rendered as static displays. This often preven... more In scientific communication, figures are typically rendered as static displays. This often prevents active exploration of the underlying data, for example to gauge the influence of particular data points or of particular analytic choices. Yet modern data visualization tools, from animated plots to interactive notebooks and reactive web applications, allow psychologists to share and present their findings in dynamic and transparent ways. In this tutorial, we present a number of recent developments to build interactivity and animations into scientific communication and publications, using examples and illustrations in the R language. In particular, we discuss when and how to build dynamic figures, with step-by-step reproducible code that can easily be extended to the reader’s own projects. We illustrate how interactivity and animations can facilitate insight and communication across a project lifecycle—from initial exchanges and discussions within a team to peer-review and final publi...
Recently, there has been a growing emphasis on embedding open and reproducible approaches into re... more Recently, there has been a growing emphasis on embedding open and reproducible approaches into research. One essential step in accomplishing this larger goal is to embed such practices into undergraduate and postgraduate research training. However, this often requires substantial time and resources to implement. Also, while many pedagogical resources are regularly developed for this purpose, they are not often openly and actively shared with the wider community. The creation and public sharing of open educational resources is useful for educators who wish to embed open scholarship and reproducibility into their teaching and learning. In this article, we describe and openly share a bank of teaching resources and lesson plans on the broad topics of open scholarship, open science, replication, and reproducibility that can be integrated into taught courses, to support educators and instructors. These resources were created as part of the Society for the Improvement of Psychological Scie...
Uploads
Papers by David Moreau