English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT

Released

Journal Article

Modeling brain representations of words' concreteness in context using GPT‐2 and human ratings

MPS-Authors
/persons/resource/persons293016

Bruera,  Andrea
Cognitive Science Research Group, School of Electronic Engineering and Computer Science, Queen Mary University of London, United Kingdom;
Lise Meitner Research Group Cognition and Plasticity, MPI for Human Cognitive and Brain Sciences, Max Planck Society;

External Resource
Fulltext (restricted access)
There are currently no full texts shared for your IP range.
Fulltext (public)

Bruera_2023.pdf
(Publisher version), 4MB

Supplementary Material (public)
There is no public supplementary material available
Citation

Bruera, A., Tao, Y., Anderson, A., Çokal, D., Haber, J., & Poesio, M. (2023). Modeling brain representations of words' concreteness in context using GPT‐2 and human ratings. Cognitive Science, 47(12): e13388. doi:10.1111/cogs.13388.


Cite as: https://hdl.handle.net/21.11116/0000-000E-139F-A
Abstract
The meaning of most words in language depends on their context. Understanding how the human brain extracts contextualized meaning, and identifying where in the brain this takes place, remain important scientific challenges. But technological and computational advances in neuroscience and artificial intelligence now provide unprecedented opportunities to study the human brain in action as language is read and understood. Recent contextualized language models seem to be able to capture homonymic meaning variation ("bat", in a baseball vs. a vampire context), as well as more nuanced differences of meaning-for example, polysemous words such as "book", which can be interpreted in distinct but related senses ("explain a book", information, vs. "open a book", object) whose differences are fine-grained. We study these subtle differences in lexical meaning along the concrete/abstract dimension, as they are triggered by verb-noun semantic composition. We analyze functional magnetic resonance imaging (fMRI) activations elicited by Italian verb phrases containing nouns whose interpretation is affected by the verb to different degrees. By using a contextualized language model and human concreteness ratings, we shed light on where in the brain such fine-grained meaning variation takes place and how it is coded. Our results show that phrase concreteness judgments and the contextualized model can predict BOLD activation associated with semantic composition within the language network. Importantly, representations derived from a complex, nonlinear composition process consistently outperform simpler composition approaches. This is compatible with a holistic view of semantic composition in the brain, where semantic representations are modified by the process of composition itself. When looking at individual brain areas, we find that encoding performance is statistically significant, although with differing patterns of results, suggesting differential involvement, in the posterior superior temporal sulcus, inferior frontal gyrus and anterior temporal lobe, and in motor areas previously associated with processing of concreteness/abstractness.