Evaluating the REDEEM Authoring Tool: Can Teachers Create Effective Learning Environments?
The REDEEM authoring environment allows teachers to create learning environments
from existing computer-based training (CBT) by imposing their pedagogical preferences about
how students should best be taught. We conducted two studies where classroom teachers
constructed learning environments with REDEEM from pre-existing CBT to explore if this
approach is educationally effective. Using a crossover design, the learning outcomes for 14-16
year old students who studied Genetics with these environments (either a REDEEM then CBT
course or vice versa) were compared. In the first study, we found that performance of 74 students
improved significantly but was not influenced by type of environment. Inspection of process data
revealed that students who engaged with REDEEM's features did learn more. In the second study,
conducted in a more natural context, a further 15 students completed the courses. REDEEM
significantly improved learning compared to CBT. Analysis suggested that REDEEM enhanced
performance by supporting additional interactivity but that macro-adaptation did not appear to
impact upon learning. Possible interpretations of these results are discussed in the light of the
many evaluation issues for authoring tools.