Proceedings of the Annual Meeting of the Cognitive Science Society

Motion quality can differentiate experts from novices in fields like surgery (Ershad et al., 2018). We extend approaches used by researchers in that field to examine the relationship between motion and skill in a children’s block-building task. We ask whether the relationship between these two variables is detected equally well by humans and machines—in this case, motion sensors embedded in the blocks. We investigate whether adults’ judgments about motion quality and children’s overall building skill reflect children’s actual construction ability, and whether data from embedded motion sensors predict children’s skill as well as adult judgments do. We find that human raters outperform the motion sensor data. Our findings raise questions about how people form such intuitive judgments of expertise, and how automated judgments of skill can be enhanced to more accurately predict expertise in block building and other similar cognitive tasks.