Basic information on public education

Other
PUBLIC PROFILE

How to monitor the academic performance of a school (1) a word of caution

Posted by Magali von Blottnitz on 09 March 2019 9:50 AM CAT
Magali von Blottnitz photo

Arguably, everything we do in the education sector is ultimately for the learners – so that they can learn better. So we need to be able to ascertain if our interventions have the desired effects on learning outcomes. Monitoring this, however, is a highly complex task. Data on learner performance is far from straightforward.

In this first blog post, we explain the challenge of academic performance monitoring. Look out for the next blog post which focuses on the kind of data sources that can be used, or download the full word file on this topic here.

Understandably, in PfP partnerships we want our efforts to ultimately impact on the quality of the learning that is taking place at the school – and on the learners’ ability to perform. In order to know if this is the case, we need some data to track how the learners at the school are performing — over time, and relative to other schools. And because educational outcomes depend in important part on the socio-economic profile of the learners, we need data that will control for this factor.

Comparative benchmarking of learning outcomes is challenging, though.

·        In South Africa, since the discontinuation of the ANA tests (Annual National Assessment), there are no independently moderated school performance assessments that would allow year-on-year comparisons and comparisons with peers.

·        Educational outcomes are dualistic — so average outcomes disguise huge within-system variation, making it difficult to make judgements about quality at different points along the socio-economic spectrum.

·        Tests of learning outcomes are often unreliable, with very large standard error of estimates, even for the same test. Further, changes in test design can undermine year-on-year comparability, even if the intention had been to make seemingly modest tweaks.

·        Finally, in order to show positive outcomes, education systems have come up with many ways to ‘game’ tests—from ‘teaching to the test’, to constraining who actually gets to write the test.

 

NB - In PfP, we operate from the premise that

·        schools (and school principals in particular) are often subjected to undue pressure for their learners’ academic performance, sometimes resulting in wrong incentives. We believe in “data-informed” rather than “data-driven” decision-making – and using performance data to support rather than to judge.

·        most of the time, the interventions that partnerships are doing at school will only impact academic performance over a prolonged period of time. Short-term results are sometimes interesting, but we are more interested in seeing if improvements can be sustained over time – including after the formal PfP year has ended.

·        A school’s academic performance is impacted by multiple internal and external factors. It is almost impossible to attribute a change in performance purely to one intervention.

 

academic performance, performance management

There are no comments

Sign in to add your comment.

Recent Posts

Saving electricity to free budget for other purposes
Stellenbosch University researchers recently found that between 3% and 18% of the government...
read more
Inclusive Education and Learners with Special Needs
Inclusive Education recognises the right of ALL children to feel welcomed into a supportive...
read more
What schools that work do right (The video script)
According to 2017 study, on schools that work, high-performing schools do nothing out of the...
read more
How to monitor the academic performance of a school (2) the data sources
Arguably, everything we do in the education sector is ultimately for the learners – so that they can...
read more
How to monitor the academic performance of a school (1) a word of caution
Arguably, everything we do in the education sector is ultimately for the learners – so that they can...
read more
Whole School Evaluation (WSE) and its implementation in the Western Cape
The Whole School Evaluation (WSE) is a national policy promulgated in 2001 – but its implementation...
read more
The Integrated Quality Management System (IQMS)
The Integrated Quality Management System (IQMS) was promulgated in 2003 to integrate the existing...
read more
How are school principals appointed?
Provincial education departments determine their own set of rules and procedures for the appointment...
read more
Understanding the Department's policy on progression and the Multiple Examination Opportunity (MEO)
Understanding the policy framework for progression and the MEO option is essential in order to make...
read more
School funding by quintile: per-learner allocations and school fees
Per-learner allocations for non-personnel costs The National Norms and Standards for School Funding...
read more

Go to blog