Skip to main content
eScholarship
Open Access Publications from the University of California

What comes to mind? Ad hoc categories as contextual reweighting of a stable high-dimensional semantic space

Creative Commons 'BY' version 4.0 license
Abstract

Humans rapidly construct ad hoc categories, e.g., generating "beet" for "vegetables to paint with". Building on feature-based accounts of category representation, we propose an analytic framework in which ad hoc categories are constructed by shifting the base category's representation (e.g., VEGETABLE) along modifier-relevant dimensions (e.g. suitable for painting) in a high-dimensional semantic space, without an explicit hand enumerated feature search. We operationalize this with off-the shelf semantic embeddings, fitting per-category sparse linear models that predict item generation across 20 categories. Across 9 categories tested for compositional transfer, learned modifier directions improved predicted retrieval when physical constraints generalize across domains (e.g., portability for "that could fit in your pocket"), while transfer was weaker for context-dependent modifiers. The learned axes align with human-rated features, with top-weighted features matching modifier semantics. These results frame ad hoc category construction as contextual reweighting of a semantic geometry, bridging feature-based accounts of conceptual combination with distributional representations.