Adaptive assessment and serious games

A long-running NIPG thread: using game environments as measurement instruments, where the task both engages the participant and generates structured behavioural data.

The 2013 educational-games work

Towards entertaining and efficient educational games — Lőrincz, Molnár, Jeni, Tősér, Rausch, Cohn, Csapó — combined inductive-reasoning minigames, a game environment, face tracking, and avatar feedback. The abstract describes 180 primary-school participants; illustrative video analyses used recordings from 57 children. NIPS Workshop on Data Driven Education, 2013; described as a workshop contribution (programme).

The reuse opportunity

The archived recordings may support substantially richer analysis with current methods than was possible in 2013. A first feasibility study should:

  • inventory the material;
  • test 5–10 accessible recordings from different participants or conditions;
  • extract observable head and facial movement, task orientation, task events, responses, errors, feedback, and performance.

Speech can be added only if usable audio is present and authorised.

Safeguard. No raw video of children in the public wiki. Aggregate findings and dataset descriptions only.

The clinical parallel

The same structure recurs in the Richter / Colleyeder concept from the same period: an avatar-guided game environment combining facial gesture estimation, imitation, pantomime and head-movement tasks, with automated observation, adaptive testing and feasibility checkpoints, aimed at predominantly negative-symptom schizophrenia. Historical, but structurally identical to what an adaptive clinical assessment would look like today.

Why it connects forward

Adaptive assessment is the same problem as longitudinal measurement viewed from the task side: how to elicit comparable behaviour repeatedly, at low burden, in a way that produces analysable structure. The answer in both cases is repeatable prompts, consistent protocol identifiers, and recorded quality indicators. → Data governance and annotation

Supporting collaborations · Avatar therapy · Datasets · Data governance and annotation · NIPG