English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
  Simplicity in Complexity: Explaining Visual Complexity using Deep Segmentation Models

Shen, T., Nath, S., Brielmann, A., & Dayan, P. (2024). Simplicity in Complexity: Explaining Visual Complexity using Deep Segmentation Models. In 46th Annual Conference of the Cognitive Science Society (CogSci 2024) (pp. 2017-2024).

Item is

Basic

show hide
Genre: Conference Paper

Files

show Files

Locators

show
hide
Description:
-
OA-Status:
Not specified

Creators

show
hide
 Creators:
Shen, T1, Author                 
Nath, S1, Author                 
Brielmann, AA, Author                 
Dayan, P1, Author                 
Affiliations:
1Department of Computational Neuroscience, Max Planck Institute for Biological Cybernetics, Max Planck Society, ou_3017468              

Content

show
hide
Free keywords: -
 Abstract: The complexity of visual stimuli plays an important role in many cognitive phenomena, including attention, engagement, memorability, time perception and aesthetic evaluation. Despite its importance, complexity is poorly understood and ironically, previous models of image complexity have been quite \textit{complex}. There have been many attempts to find handcrafted features that explain complexity, but these features are usually dataset specific, and hence fail to generalise. On the other hand, more recent work has employed deep neural networks to predict complexity, but these models remain difficult to interpret, and do not guide a theoretical understanding of the problem. Here we propose to model complexity using segment-based representations of images. We use state-of-the-art segmentation models, SAM and FC-CLIP, to quantify the number of segments at multiple granularities, and the number of classes in an image respectively. We find that complexity is well-explained by a simple linear model with these two features across six diverse image-sets of naturalistic scene and art images. This suggests that the complexity of images can be surprisingly simple.

Details

show
hide
Language(s):
 Dates: 2024-07
 Publication Status: Published online
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: -
 Identifiers: -
 Degree: -

Event

show
hide
Title: 46th Annual Conference of the Cognitive Science Society (CogSci 2024)
Place of Event: Rotterdam, The Netherlands
Start-/End Date: 2024-07-24 - 2024-07-27

Legal Case

show

Project information

show

Source 1

show
hide
Title: 46th Annual Conference of the Cognitive Science Society (CogSci 2024)
Source Genre: Proceedings
 Creator(s):
Affiliations:
Publ. Info: -
Pages: - Volume / Issue: - Sequence Number: - Start / End Page: 2017 - 2024 Identifier: -