Proceedings of the Annual Meeting of the Cognitive Science Society

This research aims to clarify, by constructing and testing a computer simulation, the use of multiple representations in problem solving, focusing on the role of visual representations. We model the behavior of an economics expert as he teaches some economics principles while drawing a graph on a blackboard. Concurrent verbal protocols are used to guide construction of a production system. The model employs representation-specific data structures and rules. The graph on the blackboard is represented by a bit map; the pictorial working memory (WM ) and long term memory (LTM) representations are node-link structures of a pictorial nature; the auditory WM and LTM representations are node-link structures of a verbal-semantic nature. Pieces from the different representations are linked together on a sequential and temporary basis to form a reasoning and inferencing chain, using cues from LTM and from the external graph. The expert used two representations so as to exploit the unique advantages of each. The graphical representation served as a place holder during reasoning, as well as a summary. The verbal-semantic representation served to give semantic meaning and causal background. Both could initiate reasoning chains. We compare the expert's behavior with novices' trying to learn the same principles.