SEARCH PUBLICATION
Across the globe, education quality has become synonymous with student per-
formance. The shift towards test-based accountability (TBA) has changed what is
required of schools and what it means to be a ‘good teacher’. Different tools may
trigger a performance orientation within schools, from administrative (such as the
Inspectorate) to market (schools competing for students). It is logical to assume
that TBA policies will be interpreted and enacted differently in schools at differ-
ent ends of the performance spectrum, and this, in turn will affect the expectations
on teachers and the pressures they feel. Based on interviews with teachers (n = 15),
principals (n = 4) and the school board (n = 1), this study compares the experiences
of teachers in two ‘high’ and two ‘low’ performing primary schools under the same
management in one Dutch city. Findings reveal that the schools respond differently
to TBA, and are facing different performance pressures, yet in all four, test data was
found to significantly shape educational practices. It was further found that teachers
experience pressure in different ways; however, it cannot be said that those in high-
performing schools experience less pressure compared to those in low-performing
schools, or vice versa. Rather, teachers’ experience of pressure is more closely
connected to their schools’ logics of action: the practices the schools adopted in
response to accountability measures and their relative market position.
Read more
The global popularity of test-based accountability appears to signal political trust in standardised assessments as valid and relevant measures of education quality. Nonetheless, research shows that educators’ perceptions of standardised testing and test-based accountability can vary significantly, as do their responses to accountability demands. Considering the key influence of teachers’ beliefs on the way in which they respond to education reforms, in this paper we examine teachers’ beliefs and opinions about standardised tests and test-based accountability. We rely on a comparative study on the interpretations and experiences of standardised testing and test-based accountability demands of compulsory education teachers in Chile and Norway. These cases were selected following a most-different-systems design approach. By relying on data derived from an electronic survey (n=2,531) and in-depth interviews (n=60), the analysis shows how in both contexts, teachers are relatively critical about the validity, usefulness and fairness of the standardised tests, signalling a lack of trust of teachers in standardized testing and test-based accountability. Still, despite similar trends, some key differences in the beliefs of Chilean and Norwegian teachers are found, which highlight the influence of the sociocultural context in shaping teachers’ beliefs. By illuminating how teachers in different contexts make sense of test-based accountability, our analysis contributes to the understanding of why the often-reported mismatch between policy expectations and policy outcomes might occur.
Read more
The purpose of the book is to reconceptualize the notion of accountability as part and parcel of the increasing datafication in education, understood as the processes and effects of quantifying education, from education policymaking to pedagogy and education practice in all its physical and digital manifestations.
Read more
This note describes the methodology behind the design of the REFORMED Survey questionnaires. The Survey constitutes one of the main pillars of REFORMED RS2 which is aimed at exploring the intricate relationship between SAWA policies, contextual contingencies and policy enactment dynamics. The aim of this note is essentially twofold. On the one hand, it provides detailed information on the key concepts used in RS2 as well as the theoretical underpinnings and content of the questionnaires. On the other hand, it presents a detailed overview of the methodological steps followed to conceive and develop them. The information contained in this note is relevant for those researchers who want to use the data collected through the REFORMED Survey. It also provides useful methodological insights that can be valuable for those who want to undertake similar research endeavours.
Read more
Despite the growing number of researches about performance-based accountability (PBA) in education, there is still scarce evidence on the mediating role of subjective variables (e.g., perceived pressure and alignment to PBA mandates) in the enactment of PBA in socially disadvantaged contexts. This is paradoxical because marginalized schools are usually those that are on probation and have to cope with the threat of sanctions more frequently. Existing investigations on PBA enactment have put increasing attention to the role of situated and material contexts, but there is still limited knowledge on how subjective variables can mediate policy enactment processes and enable the adoption of different school responses. To address these gaps, the article aims to explore how the perceived accountability pressure, the school performative culture, and meaning-making processes at the school level are mediating the enactment of PBA policies in disadvantaged schools. At the theoretical level, the study is informed by sense-making and policy enactment frameworks. Methodologically speaking, the investigation uses a comparative case study approach based on two extreme cases, which have been selected on the basis of a factorial analysis that combines both survey and secondary data. The extreme cases represent two different scenarios, which, despite operating in similar situated contexts, are characterized by having opposite levels of perceived pressure and alignment with the performative culture. The case studies combine survey data (n = 39) with documentary analysis and semi-structured interviews with the management team and teachers (n = 7). The findings show that subjective variables, in interaction with other contextual factors, can exacerbate or inhibit PBA regulatory pressures and trigger diverging school responses.
Read more
In recent decades, performance-based accountability (PBA) has become an increasingly popular policy instrument to ensure educational actors are responsive to and assume responsibility for achieving centrally defined learning goals. Nonetheless, studies report mixed results with regard to the impact of PBA on schools’ internal affairs and instructional practices. With the aim of contributing to the understanding of the social mechanisms and processes that induce particular school responses, this paper reports on a study that examines how Norwegian principals perceive, interpret, and translate accountability demands. The
analysis is guided by the policy enactment perspective and the sociological concept of “reactivity”, and relies on 23 in-depth interviews with primary school principals in nine urban municipalities in Norway. The findings highlight three distinct response patterns in how principals perceive, interpret, and translate PBA demands: alignment, balancing multiple purposes, and symbolic responses. The study simultaneously shows how different manifestations of two social mechanisms form important explanatory factors to understand principals’ varying responses, while it is highlighted how the mechanisms are more likely to operate under particular conditions, which relate both to principals’ trajectories and views on education, and to school-specific characteristics and the local accountability regime. The study contributes to the accountability literature by showing how, even in the relative absence of material consequences and low levels of marketization, standardized testing and PBA can drive behavioral change, by reframing norms of good educational practice and by affecting how educators make sense of core aspects of their work.
Read more
In European and global educational debates, performative or test-based accountability has become central to modernizing and raising the performance of education systems. However, despite the global popularity of performative accountability modalities, existing research finds contradictory evidence on its effects, which tend to be highly context-sensitive. With the aim of gaining a deeper understanding of the mechanisms and contextual factors that explain the effects of performative accountability, this study investigates the enactment of a performative accountability scheme adopted in the Russian school system. The analysis is based on interview and observation data collected during an in-depth qualitative study of two neighbouring schools with contrasting logics of action. Our findings illuminate the specific ways in which accountability policy outcomes are mediated and shaped by schools’ context and agency. We show how schools with different logics of action react to external pressures, and how different professional groups within schools experience policy pressures in dissimilar ways. We conclude that performative accountability mechanisms reinforce instrumental, and impede expressive, logics of action in schools. In both cases they produce tensions, particularly for schools in disadvantaged areas.
Read more
This chapter reviews international evidence on the effects of accountability policies in education, with a particular focus on teachers’ work and behavior. Specifically, on the basis of existing evidence, the chapter shows how the different components of accountability schemes (namely their policy design, enactment processes, contextual contingencies, and impact) interact in complex and multiple ways.
Read more