The MIND Research Institute contracted the Evaluation Research Program at WestEd to assess their blended learning program, Spatial-Temporal Math (ST Math), in an elementary school setting in California. WestEd used data from the CST (California Standards Test) from grades 2-5 to compare CST scores of students using ST Math to those similar groups of students not using ST Math. WestEd compared first-year full implementation usage at schools to those not using ST Math. Full implementation usage was defined as 85% of students completing at least 50% of the blended learning curriculum during the course of the school year. Results showed that grades using ST Math showed higher scores than those students not provided with ST Math and that the most significant gains occurred in 2nd, 3rd, and 5th grades.
Interestingly enough the research group made sure to clearly define that grades were made up of all the classes within participating schools. For example, if a school had six grade 2 classes, all were included regardless of individual classroom implementation percentages. And that 212 schools were included in the full implementation groupings. It was also interesting how detailed the evaluation went by breaking down the CST data not only overall but also by growth for advanced and proficient students. I would have been interested to see results for far below basic and basic performance level as well.
It was also intriguing how clearly WestEd wrote up the limitations to the evaluation. They suggested that data may have been affected as ST Math was implemented by choice within schools and motivation, surrounding math in general, could have been high with the self-elected new program. The evaluation groups also suggested that some limitation existed as it was impossible to control that students hadn’t used the program in previous years, even though the study indicated it was a first-year usage evaluation.
Wendt, S., Rice, J., & Nakamoto J. (2014). Evaluation of the MIND Research Institute’s spatial-temporal math (ST Math) program in California. WestEd. Retrieved from https://www.wested.org/wp-content/files_mf/1415393677Evaluation_STMath_Program_20141107.pdf