Help Privacy Policy Disclaimer
  Advanced SearchBrowse





Active sensing with artificial neural networks


Solopchuk,  O
Department of Computational Neuroscience, Max Planck Institute for Biological Cybernetics, Max Planck Society;

Fulltext (restricted access)
There are currently no full texts shared for your IP range.
Fulltext (public)
There are no public fulltexts stored in PuRe
Supplementary Material (public)
There is no public supplementary material available

Solopchuk, O. (2022). Active sensing with artificial neural networks. Talk presented at Freie Universität, Department of Education and Psychology, Center for Cognitive Neuroscience Berlin. Berlin, Germany. 2022-07-18.

Cite as: https://hdl.handle.net/21.11116/0000-000A-E35A-1
The fitness of behaving agents depends on their knowledge of the environment, which demands efficient exploration strategies. Active sensing formalizes exploration as reduction of uncertainty about the current state of the environment. Despite strong theoretical justifications, active sensing has had limited applicability due to difficulty in estimating information gain. Here we address this issue by proposing a linear approximation to information gain and by implementing efficient gradient-based action selection within an artificial neural network setting. We compare information gain estimation with state of the art, and validate our model on an active sensing task based on MNIST dataset. We also propose an approximation that exploits the amortized inference network, and performs equally well in certain contexts.