English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
  Tensors and compositionality in neural systems

Martin, A. E., & Doumas, L. A. A. (2019). Tensors and compositionality in neural systems. Philosophical Transactions of the Royal Society of London, Series B: Biological Sciences. Advance online publication. doi:10.1098/rstb.2019.0306.

Item is

Files

show Files
hide Files
:
Martin_Doumas_2019_Tensors ans compositionality in neural systems.pdf (Publisher version), 377KB
Name:
Martin_Doumas_2019_Tensors ans compositionality in neural systems.pdf
Description:
-
OA-Status:
Visibility:
Public
MIME-Type / Checksum:
application/pdf / [MD5]
Technical Metadata:
Copyright Date:
-
Copyright Info:
-
License:
-
:
Martin_Doumas_2019suppl._Tensors ans compositionality in neural systems.docx (Supplementary material), 491KB
Name:
Supplemental Material
Description:
-
OA-Status:
Visibility:
Public
MIME-Type / Checksum:
application/vnd.openxmlformats-officedocument.wordprocessingml.document / [MD5]
Technical Metadata:
Copyright Date:
-
Copyright Info:
-
License:
-

Locators

show

Creators

show
hide
 Creators:
Martin, Andrea E.1, Author           
Doumas, L. A. A.2, Author
Affiliations:
1Psychology of Language Department, MPI for Psycholinguistics, Max Planck Society, ou_792545              
2Donders Institute for Brain, Cognition and Behaviour, External Organizations, ou_55236              

Content

show
hide
Free keywords: -
 Abstract: Neither neurobiological nor process models of meaning composition specify the operator through which constituent parts are bound together into compositional structures. In this paper, we argue that a neurophysiological computation system cannot achieve the compositionality exhibited in human thought and language if it were to rely on a multiplicative operator to perform binding, as the tensor product (TP)-based systems that have been widely adopted in cognitive science, neuroscience and artificial intelligence do. We show via simulation and two behavioural experiments that TPs violate variable-value independence, but human behaviour does not. Specifically, TPs fail to capture that in the statements fuzzy cactus and fuzzy penguin, both cactus and penguin are predicated by fuzzy(x) and belong to the set of fuzzy things, rendering these arguments similar to each other. Consistent with that thesis, people judged arguments that shared the same role to be similar, even when those arguments themselves (e.g., cacti and penguins) were judged to be dissimilar when in isolation. By contrast, the similarity of the TPs representing fuzzy(cactus) and fuzzy(penguin) was determined by the similarity of the arguments, which in this case approaches zero. Based on these results, we argue that neural systems that use TPs for binding cannot approximate how the human mind and brain represent compositional information during processing. We describe a contrasting binding mechanism that any physiological or artificial neural system could use to maintain independence between a role and its argument, a prerequisite for compositionality and, thus, for instantiating the expressive power of human thought and language in a neural system.

Details

show
hide
Language(s): eng - English
 Dates: 2019-122019-12-16
 Publication Status: Published online
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: Peer
 Identifiers: DOI: 10.1098/rstb.2019.0306
 Degree: -

Event

show

Legal Case

show

Project information

show

Source 1

show
hide
Title: Philosophical Transactions of the Royal Society of London, Series B: Biological Sciences. Advance online publication
Source Genre: Journal
 Creator(s):
Affiliations:
Publ. Info: London : Royal Society
Pages: - Volume / Issue: - Sequence Number: - Start / End Page: - Identifier: ISSN: 0962-8436
CoNE: https://pure.mpg.de/cone/journals/resource/963017382021_1