Request: elaborate on Evaluate

[richelbilderbeek]

Dear SPLASH,

Great to see this initiative!

I was reading the 'Evaluate' step and found this:

Balanced Evaluation: Combine quantitative and qualitative data to gain a comprehensive understanding of training effectiveness.

After reading this sentence I wish I would know which data (in this case, mostly survey questions I guess?) it is to gain an understanding of training effectiveness.

As far as I see, this is quite a big field with some counterintuitive results.

One example: some institutions use SETs ('Student Evaluation of Teachers') with the idea that high SETs correlate to better teaching. However, according to this meta-analysis [Uttl, Bob, Carmela A. White, and Daniela Wong Gonzalez. "Meta-analysis of faculty's teaching effectiveness: Student evaluation of teaching ratings and student learning are not related." Studies in Educational Evaluation 54 (2017): 22-42.], these are unrelated. Note that this is just the best paper I found on this subject and I am happy to be corrected.

So, I hope this simple sentence is elaborated on a bit more, as it would make its wisdom better applicable. Would be great!

Thanks and cheers, Richel