The data team intervention was designed to support schools' data use. The sustainability of schoo... more The data team intervention was designed to support schools' data use. The sustainability of schools’ data use was investigated by studying the schools' development of the ostensive and performative aspects of organizational routines for: engaging in the data team intervention, acting upon their data team’s improvement plan, and using data for school development and instruction. Six Dutch secondary schools participated in this longitudinal mixed-methods study. Data were collected through questionnaires, policy documents, and interviews. Results indicated that schools struggled to develop organizational routines for data use, especially the ostensive aspects. This illuminated the process by which schools did not sustain their use of data. The findings showed that interventions for data use should more clearly target the development of organizational routines.
The data team intervention was designed to support Dutch secondary schools in using data while de... more The data team intervention was designed to support Dutch secondary schools in using data while developing a solution to an educational problem. A data team can build school-wide capacity for data use through knowledge sharing among data team members, and knowledge brokerage between the team and other colleagues. The goal of this mixed-methods study is to understand how knowledge sharing and brokerage regarding data use and an educational problem changed over time. Social network data were collected twice at eight schools. These data were used to analyse (1) how well team members were connected with each other (density), (2) whether team members’ relationships were mutual (reciprocity) and (3) whether all team members were equally important for the data team network (centralisation). Moreover, different types of knowledge brokering (inward, outward and forward) were examined to further understand knowledge exchange between data team members and their colleagues. Qualitative data were analysed to triangulate these findings for four particular cases. Among other things, findings illustrated that while knowledge sharing and knowledge brokerage both changed over time, there were considerable differences between teams in the extent and direction of change. It appeared that the dissemination of knowledge within the organisation requires more explicit attention.
Purpose – In this study, Nonaka and Takeuchi’s socialization, externalization, combination and in... more Purpose – In this study, Nonaka and Takeuchi’s socialization, externalization, combination and internalization (SECI) model of knowledge creation is used to gain insight into the process of knowledge creation in data teams. These teams are composed of school leaders and teachers, who work together to improve the quality of education. They collaboratively create knowledge related to data use and to an educational problem they are studying. The paper aims to discuss these issues.
Design/methodology/approach – A qualitative micro-process case study was conducted for two data teams. The modes, transitions and content of the knowledge creation process were analyzed for all data team meetings over a two-year period. In addition, all team members were interviewed twice to triangulate the findings.
Findings – Results show that the knowledge creation process was cyclical across meetings, but more iterative within meetings. Furthermore, engagement in the socialization and internalization mode provided added value in this process. Finally, the SECI model clearly differentiated between team members’ processes. Team members who engaged more often in the socialization and internalization modes and displayed more personal engagement in those modes gained greater and deeper knowledge.
Research limitations/implications – The SECI model is valuable for understanding how teams gain new knowledge and why they differ in those gains.
Practical implications – Stimulation of active personal engagement in the socialization and internalization mode is needed.
Originality/value – This is one of the first attempts to concretely observe the process of knowledge creation. It provides essential insights into what educators do in professional development contexts, and how support can best be provided.
As data-based decision making is receiving increased attention in education, more and more school... more As data-based decision making is receiving increased attention in education, more and more school performance feedback systems (SPFSs) are being developed and used worldwide. These systems provide schools with data on their functioning. However, little research is available on the characteristics of the different SPFSs. Therefore, this study reflects on the characteristics of SPFSs to provide feedback designers and users arguments for making sound choices in selecting SPFSs with particular characteristics. The results of our study show that the 5 SPFSs selected for the purpose of comparison differ with respect to features related to data gathering and data analysis processes, the content, and the numerical measures and representation modes used. A wide variety can be detected in terms of the complexity and accuracy of data modeling. Users need to be properly informed about the underlying rationale for the features of each SPFS, and on the limitations and strengths of the performance indicators used.
The word self in common use refers to something bounded by skin and a skull. By contrast, the sel... more The word self in common use refers to something bounded by skin and a skull. By contrast, the self-study of the inherently relational practices of teacher education is often social in orientation. So the theme of Collaboration and Community: Pushing Boundaries through Self-Study was one readily agreed upon as appropriate for a celebration of a decade of coming together for collaborative conversations in lively community at the Castle Conferences. These proceedings would not be possible without many kinds of collaboration. The summaries of the papers presented at the Sixth International Conference on Self-Study of Teacher Education Practices include many in which the authors collaborated in research and in writing, a few of which represent multiple pairs or groups of collaborators. Many of the single authors describe partnerships or focus closely on the community built by professors working together with preservice or inservice teachers. Every step, from the call for proposals to distribution of the proceedings at the Castle, has benefited from collaboration.
This article presents the results of two studies on the use of school self-evaluation in the Neth... more This article presents the results of two studies on the use of school self-evaluation in the Netherlands and Flanders. It focuses on which forms of instrumental use of school self-evaluation results can be found in schools, and how differences in self-evaluation use between schools can be explained. Results show that the instrumental use of self-evaluation results in both contexts was limited. Results further show that differences in the use of school self-evaluation results can be explained by differences in school organizational characteristics, implementation characteristics, and the characteristics of the school self-evaluation itself. Implications for theory, policy, and practice are discussed.
Schools around the world are using instruments for performance feedback, but there is no scientif... more Schools around the world are using instruments for performance feedback, but there is no scientific evidence that they have positive effects on education. This paper compares a School Performance Feedback System (SPFS) used in the USA as an accountability ...
Schools face a lot of data on the functioning of their school which they can use to make improvem... more Schools face a lot of data on the functioning of their school which they can use to make improvements in teaching, learning and the organization. For data use to lead to improvement, it is important to further research the concept data-driven decision making. The results of this explorative study in the Netherlands show that teachers mainly use classroom level data for making instructional decisions at classroom level, and school leaders mainly use school level data for policy development decisions. This article ends with suggestions with regard to enhancing the effectiveness of data-driven decision making, for example by stressing the importance of developing teachers' competence in the use of data.
This article presents the results of two studies on the use of school self-evaluation in the Neth... more This article presents the results of two studies on the use of school self-evaluation in the Netherlands and Flanders. It focuses on which forms of instrumental use of school self-evaluation results can be found in schools, and how differences in self-evaluation use between schools can be explained. Results show that the instrumental use of self-evaluation results in both contexts was limited. Results further show that differences in the use of school self-evaluation results can be explained by differences in school organizational characteristics, implementation characteristics, and the characteristics of the school self-evaluation itself. Implications for theory, policy, and practice are discussed.
Although school performance feedback is available in schools all over the world, there is a deart... more Although school performance feedback is available in schools all over the world, there is a dearth of information about the use made of feedback and about the effects of its use. This paper presents case study research into the use of school performance feedback and its' perceived effects. All schools used the feedback in writing school improvement plans, but the extent of genuine school improvement varied across schools as did the perceived effects of the use of performance feedback. The results highlight various factors which may promote or impede the use of school performance feedback and its effects.
This article presents the results of two studies on the use of school self-evaluation in the Neth... more This article presents the results of two studies on the use of school self-evaluation in the Netherlands and Flanders. It focuses on which forms of instrumental use of school self-evaluation results can be found in schools, and how differences in self-evaluation use between schools can be explained. Results show that the instrumental use of self-evaluation results in both contexts was limited. Results further show that differences in the use of school self-evaluation results can be explained by differences in school organizational characteristics, implementation characteristics, and the characteristics of the school self-evaluation itself. Implications for theory, policy, and practice are discussed.
School quality care has become important in many Western countries. Expectations are high, but li... more School quality care has become important in many Western countries. Expectations are high, but little is known about the nature and extent of the use of self‐evaluation instruments within schools. From this longitudinal study into the use of a Dutch school self‐evaluation instrument, it became clear that schools vary in the extent to which they are able to make use of self‐evaluation results. A minority of schools in this study were able to use the self‐evaluation results for developing measures at the school and classroom level to improve the quality of education. Potential causes for the findings and alternatives for promoting the utilisation of school self‐evaluation instruments are discussed.
A sample of 815 Dutch pupils from 49 classes was followed from age 6 (Dutch Grade 3) through age ... more A sample of 815 Dutch pupils from 49 classes was followed from age 6 (Dutch Grade 3) through age 11 (Grade 7) to estimate growth trajectories for pupils with different socio-ethnic backgrounds. The results indicate that the disadvantage for spelling already present in Grade 3 increases more strongly for Dutch low-socioeconomic status (SES) pupils than for low-SES minority pupils. With regard to mathematics, the initial disadvantage of Dutch low-SES pupils hardly changes, whereas the gap is clearly reduced for low-SES minorities. Effects of classroom composition appear to be quite modest, but classes with very high proportions of low-SES minority pupils show a clear disadvantage for both spelling and mathematics at age 6. In subsequent grades, the spelling gap between advantaged and disadvantaged classroom populations disappears completely. For mathematics, the gap is initially reduced to some extent, but at age 11 the disadvantage increases again.
The utilisation of a self-evaluation instrument for primary education Thesis University of Twente... more The utilisation of a self-evaluation instrument for primary education Thesis University of Twente, Enschede -With refs. -With Dutch summary.
School quality care has become important in many Western countries. A number of self-evaluation i... more School quality care has become important in many Western countries. A number of self-evaluation instruments have been developed in response. The goal of these instruments is improving the quality of education. One such system, ZEBO, was developed for performing ...
This editorial article briefly examines the importance of data-based decision making. It discusse... more This editorial article briefly examines the importance of data-based decision making. It discusses the definition as well as rationale for data-based decision making, its purposes, the use of data at different levels of the educational system, and possible promoting and hindering factors of effective data use. It also examines the effects of data use, intended effects (e.g., increased student achievement), as well as unintended consequences (e.g., cheating with tests). We end with suggestions for new research priorities.
The data team intervention was designed to support schools' data use. The sustainability of schoo... more The data team intervention was designed to support schools' data use. The sustainability of schools’ data use was investigated by studying the schools' development of the ostensive and performative aspects of organizational routines for: engaging in the data team intervention, acting upon their data team’s improvement plan, and using data for school development and instruction. Six Dutch secondary schools participated in this longitudinal mixed-methods study. Data were collected through questionnaires, policy documents, and interviews. Results indicated that schools struggled to develop organizational routines for data use, especially the ostensive aspects. This illuminated the process by which schools did not sustain their use of data. The findings showed that interventions for data use should more clearly target the development of organizational routines.
The data team intervention was designed to support Dutch secondary schools in using data while de... more The data team intervention was designed to support Dutch secondary schools in using data while developing a solution to an educational problem. A data team can build school-wide capacity for data use through knowledge sharing among data team members, and knowledge brokerage between the team and other colleagues. The goal of this mixed-methods study is to understand how knowledge sharing and brokerage regarding data use and an educational problem changed over time. Social network data were collected twice at eight schools. These data were used to analyse (1) how well team members were connected with each other (density), (2) whether team members’ relationships were mutual (reciprocity) and (3) whether all team members were equally important for the data team network (centralisation). Moreover, different types of knowledge brokering (inward, outward and forward) were examined to further understand knowledge exchange between data team members and their colleagues. Qualitative data were analysed to triangulate these findings for four particular cases. Among other things, findings illustrated that while knowledge sharing and knowledge brokerage both changed over time, there were considerable differences between teams in the extent and direction of change. It appeared that the dissemination of knowledge within the organisation requires more explicit attention.
Purpose – In this study, Nonaka and Takeuchi’s socialization, externalization, combination and in... more Purpose – In this study, Nonaka and Takeuchi’s socialization, externalization, combination and internalization (SECI) model of knowledge creation is used to gain insight into the process of knowledge creation in data teams. These teams are composed of school leaders and teachers, who work together to improve the quality of education. They collaboratively create knowledge related to data use and to an educational problem they are studying. The paper aims to discuss these issues.
Design/methodology/approach – A qualitative micro-process case study was conducted for two data teams. The modes, transitions and content of the knowledge creation process were analyzed for all data team meetings over a two-year period. In addition, all team members were interviewed twice to triangulate the findings.
Findings – Results show that the knowledge creation process was cyclical across meetings, but more iterative within meetings. Furthermore, engagement in the socialization and internalization mode provided added value in this process. Finally, the SECI model clearly differentiated between team members’ processes. Team members who engaged more often in the socialization and internalization modes and displayed more personal engagement in those modes gained greater and deeper knowledge.
Research limitations/implications – The SECI model is valuable for understanding how teams gain new knowledge and why they differ in those gains.
Practical implications – Stimulation of active personal engagement in the socialization and internalization mode is needed.
Originality/value – This is one of the first attempts to concretely observe the process of knowledge creation. It provides essential insights into what educators do in professional development contexts, and how support can best be provided.
As data-based decision making is receiving increased attention in education, more and more school... more As data-based decision making is receiving increased attention in education, more and more school performance feedback systems (SPFSs) are being developed and used worldwide. These systems provide schools with data on their functioning. However, little research is available on the characteristics of the different SPFSs. Therefore, this study reflects on the characteristics of SPFSs to provide feedback designers and users arguments for making sound choices in selecting SPFSs with particular characteristics. The results of our study show that the 5 SPFSs selected for the purpose of comparison differ with respect to features related to data gathering and data analysis processes, the content, and the numerical measures and representation modes used. A wide variety can be detected in terms of the complexity and accuracy of data modeling. Users need to be properly informed about the underlying rationale for the features of each SPFS, and on the limitations and strengths of the performance indicators used.
The word self in common use refers to something bounded by skin and a skull. By contrast, the sel... more The word self in common use refers to something bounded by skin and a skull. By contrast, the self-study of the inherently relational practices of teacher education is often social in orientation. So the theme of Collaboration and Community: Pushing Boundaries through Self-Study was one readily agreed upon as appropriate for a celebration of a decade of coming together for collaborative conversations in lively community at the Castle Conferences. These proceedings would not be possible without many kinds of collaboration. The summaries of the papers presented at the Sixth International Conference on Self-Study of Teacher Education Practices include many in which the authors collaborated in research and in writing, a few of which represent multiple pairs or groups of collaborators. Many of the single authors describe partnerships or focus closely on the community built by professors working together with preservice or inservice teachers. Every step, from the call for proposals to distribution of the proceedings at the Castle, has benefited from collaboration.
This article presents the results of two studies on the use of school self-evaluation in the Neth... more This article presents the results of two studies on the use of school self-evaluation in the Netherlands and Flanders. It focuses on which forms of instrumental use of school self-evaluation results can be found in schools, and how differences in self-evaluation use between schools can be explained. Results show that the instrumental use of self-evaluation results in both contexts was limited. Results further show that differences in the use of school self-evaluation results can be explained by differences in school organizational characteristics, implementation characteristics, and the characteristics of the school self-evaluation itself. Implications for theory, policy, and practice are discussed.
Schools around the world are using instruments for performance feedback, but there is no scientif... more Schools around the world are using instruments for performance feedback, but there is no scientific evidence that they have positive effects on education. This paper compares a School Performance Feedback System (SPFS) used in the USA as an accountability ...
Schools face a lot of data on the functioning of their school which they can use to make improvem... more Schools face a lot of data on the functioning of their school which they can use to make improvements in teaching, learning and the organization. For data use to lead to improvement, it is important to further research the concept data-driven decision making. The results of this explorative study in the Netherlands show that teachers mainly use classroom level data for making instructional decisions at classroom level, and school leaders mainly use school level data for policy development decisions. This article ends with suggestions with regard to enhancing the effectiveness of data-driven decision making, for example by stressing the importance of developing teachers' competence in the use of data.
This article presents the results of two studies on the use of school self-evaluation in the Neth... more This article presents the results of two studies on the use of school self-evaluation in the Netherlands and Flanders. It focuses on which forms of instrumental use of school self-evaluation results can be found in schools, and how differences in self-evaluation use between schools can be explained. Results show that the instrumental use of self-evaluation results in both contexts was limited. Results further show that differences in the use of school self-evaluation results can be explained by differences in school organizational characteristics, implementation characteristics, and the characteristics of the school self-evaluation itself. Implications for theory, policy, and practice are discussed.
Although school performance feedback is available in schools all over the world, there is a deart... more Although school performance feedback is available in schools all over the world, there is a dearth of information about the use made of feedback and about the effects of its use. This paper presents case study research into the use of school performance feedback and its' perceived effects. All schools used the feedback in writing school improvement plans, but the extent of genuine school improvement varied across schools as did the perceived effects of the use of performance feedback. The results highlight various factors which may promote or impede the use of school performance feedback and its effects.
This article presents the results of two studies on the use of school self-evaluation in the Neth... more This article presents the results of two studies on the use of school self-evaluation in the Netherlands and Flanders. It focuses on which forms of instrumental use of school self-evaluation results can be found in schools, and how differences in self-evaluation use between schools can be explained. Results show that the instrumental use of self-evaluation results in both contexts was limited. Results further show that differences in the use of school self-evaluation results can be explained by differences in school organizational characteristics, implementation characteristics, and the characteristics of the school self-evaluation itself. Implications for theory, policy, and practice are discussed.
School quality care has become important in many Western countries. Expectations are high, but li... more School quality care has become important in many Western countries. Expectations are high, but little is known about the nature and extent of the use of self‐evaluation instruments within schools. From this longitudinal study into the use of a Dutch school self‐evaluation instrument, it became clear that schools vary in the extent to which they are able to make use of self‐evaluation results. A minority of schools in this study were able to use the self‐evaluation results for developing measures at the school and classroom level to improve the quality of education. Potential causes for the findings and alternatives for promoting the utilisation of school self‐evaluation instruments are discussed.
A sample of 815 Dutch pupils from 49 classes was followed from age 6 (Dutch Grade 3) through age ... more A sample of 815 Dutch pupils from 49 classes was followed from age 6 (Dutch Grade 3) through age 11 (Grade 7) to estimate growth trajectories for pupils with different socio-ethnic backgrounds. The results indicate that the disadvantage for spelling already present in Grade 3 increases more strongly for Dutch low-socioeconomic status (SES) pupils than for low-SES minority pupils. With regard to mathematics, the initial disadvantage of Dutch low-SES pupils hardly changes, whereas the gap is clearly reduced for low-SES minorities. Effects of classroom composition appear to be quite modest, but classes with very high proportions of low-SES minority pupils show a clear disadvantage for both spelling and mathematics at age 6. In subsequent grades, the spelling gap between advantaged and disadvantaged classroom populations disappears completely. For mathematics, the gap is initially reduced to some extent, but at age 11 the disadvantage increases again.
The utilisation of a self-evaluation instrument for primary education Thesis University of Twente... more The utilisation of a self-evaluation instrument for primary education Thesis University of Twente, Enschede -With refs. -With Dutch summary.
School quality care has become important in many Western countries. A number of self-evaluation i... more School quality care has become important in many Western countries. A number of self-evaluation instruments have been developed in response. The goal of these instruments is improving the quality of education. One such system, ZEBO, was developed for performing ...
This editorial article briefly examines the importance of data-based decision making. It discusse... more This editorial article briefly examines the importance of data-based decision making. It discusses the definition as well as rationale for data-based decision making, its purposes, the use of data at different levels of the educational system, and possible promoting and hindering factors of effective data use. It also examines the effects of data use, intended effects (e.g., increased student achievement), as well as unintended consequences (e.g., cheating with tests). We end with suggestions for new research priorities.
Uploads
Papers by Kim Schildkamp
Design/methodology/approach – A qualitative micro-process case study was conducted for two data teams. The modes, transitions and content of the knowledge creation process were analyzed for all data team meetings over a two-year period. In addition, all team members were interviewed twice to triangulate the findings.
Findings – Results show that the knowledge creation process was cyclical across meetings, but more iterative within meetings. Furthermore, engagement in the socialization and internalization mode provided added value in this process. Finally, the SECI model clearly differentiated between team members’ processes. Team members who engaged more often in the socialization and internalization modes and displayed more personal engagement in those modes gained greater and deeper knowledge.
Research limitations/implications – The SECI model is valuable for understanding how teams
gain new knowledge and why they differ in those gains.
Practical implications – Stimulation of active personal engagement in the socialization and
internalization mode is needed.
Originality/value – This is one of the first attempts to concretely observe the process of knowledge creation. It provides essential insights into what educators do in professional development contexts, and how support can best be provided.
Design/methodology/approach – A qualitative micro-process case study was conducted for two data teams. The modes, transitions and content of the knowledge creation process were analyzed for all data team meetings over a two-year period. In addition, all team members were interviewed twice to triangulate the findings.
Findings – Results show that the knowledge creation process was cyclical across meetings, but more iterative within meetings. Furthermore, engagement in the socialization and internalization mode provided added value in this process. Finally, the SECI model clearly differentiated between team members’ processes. Team members who engaged more often in the socialization and internalization modes and displayed more personal engagement in those modes gained greater and deeper knowledge.
Research limitations/implications – The SECI model is valuable for understanding how teams
gain new knowledge and why they differ in those gains.
Practical implications – Stimulation of active personal engagement in the socialization and
internalization mode is needed.
Originality/value – This is one of the first attempts to concretely observe the process of knowledge creation. It provides essential insights into what educators do in professional development contexts, and how support can best be provided.