TY - JOUR

T1 - Effects of implementation support on children’s reading outcomes following an online early reading programme: a cluster-randomised controlled trial

AU - Roberts-Tyler, Emily

AU - Roberts, Sarah

AU - Watkins, Richard

AU - Hughes, Carl

AU - Hastings, Richard

AU - Gillespie, David

PY - 2023/3/24

Y1 - 2023/3/24

N2 - Well-designed computer or app-based instruction has a number of potential benefits (e.g., increasing accessibility and feasibility of high-quality instruction, reducing time and resources required for training expert delivery, saving instructional time). However, variation in implementation can still affect outcomes when using educational technology. Research generally suggests that without follow-up support after training, implementation of educational interventions is often poor and outcomes reduced. However, the extent to which this is the case when the core element of an intervention is computer or app-delivered is not yet clear. This study investigated the effects of providing ongoing implementation support for Headsprout Early Reading (HER, an early reading programme accessible via a computer or an app), to determine whether such support leads to better outcomes. Twenty-two primary schools (269 learners) participated in a cluster-randomised controlled trial. Eleven schools received initial training followed by ongoing support across the school year, whereas the other 11 schools received initial training and technical support only. Pre and post-measures of reading skills were conducted using the York Assessment of Reading for Comprehension. We found no effect of implementation support on outcomes, and no effect of implementation support on delivery of the core element of HER. However, there were some effects of implementation support on the implementation of other HER elements relating to the responsiveness of educators to learners’ learning within HER. These findings have implications for providing access to high quality online instruction in early reading skills at scale, with minimal training. More broadly, the current study suggests that well-designed computer or app-based instruction can yield positive outcomes with minimal implementation support and training. However, further research is required to ensure the interplay between learners’ app-based learning and teacher intervention functions as intended to provide additional support for those who need it.

AB - Well-designed computer or app-based instruction has a number of potential benefits (e.g., increasing accessibility and feasibility of high-quality instruction, reducing time and resources required for training expert delivery, saving instructional time). However, variation in implementation can still affect outcomes when using educational technology. Research generally suggests that without follow-up support after training, implementation of educational interventions is often poor and outcomes reduced. However, the extent to which this is the case when the core element of an intervention is computer or app-delivered is not yet clear. This study investigated the effects of providing ongoing implementation support for Headsprout Early Reading (HER, an early reading programme accessible via a computer or an app), to determine whether such support leads to better outcomes. Twenty-two primary schools (269 learners) participated in a cluster-randomised controlled trial. Eleven schools received initial training followed by ongoing support across the school year, whereas the other 11 schools received initial training and technical support only. Pre and post-measures of reading skills were conducted using the York Assessment of Reading for Comprehension. We found no effect of implementation support on outcomes, and no effect of implementation support on delivery of the core element of HER. However, there were some effects of implementation support on the implementation of other HER elements relating to the responsiveness of educators to learners’ learning within HER. These findings have implications for providing access to high quality online instruction in early reading skills at scale, with minimal training. More broadly, the current study suggests that well-designed computer or app-based instruction can yield positive outcomes with minimal implementation support and training. However, further research is required to ensure the interplay between learners’ app-based learning and teacher intervention functions as intended to provide additional support for those who need it.

U2 - 10.1111/bjet.13312

DO - 10.1111/bjet.13312

M3 - Article

JO - British Journal of Educational Technology

JF - British Journal of Educational Technology

SN - 0007-1013

ER -