English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
  Controlling video stimuli in sign language and gesture research: The OpenPoseR package for analyzing OpenPose motion tracking data in R

Trettenbrein, P., & Zaccarella, E. (2021). Controlling video stimuli in sign language and gesture research: The OpenPoseR package for analyzing OpenPose motion tracking data in R. Frontiers in Psychology, 12: 628728. doi:10.3389/fpsyg.2021.628728.

Item is

Files

show Files
hide Files
:
Trettenbrein_Zaccarella_2021.pdf (Publisher version), 581KB
Name:
Trettenbrein_Zaccarella_2021.pdf
Description:
-
OA-Status:
Gold
Visibility:
Public
MIME-Type / Checksum:
application/pdf / [MD5]
Technical Metadata:
Copyright Date:
-
Copyright Info:
-

Locators

show

Creators

show
hide
 Creators:
Trettenbrein, Patrick1, 2, Author           
Zaccarella, Emiliano1, Author           
Affiliations:
1Department Neuropsychology, MPI for Human Cognitive and Brain Sciences, Max Planck Society, ou_634551              
2International Max Planck Research School on Neuroscience of Communication: Function, Structure, and Plasticity, MPI for Human Cognitive and Brain Sciences, Max Planck Society, Leipzig, DE, ou_2616696              

Content

show
hide
Free keywords: R; Linguistics; Psychology; Neuroscience; Sign language; Gesture; Video stimuli
 Abstract: Researchers in the fields of sign language and gesture studies frequently present their participants with video stimuli showing actors performing linguistic signs or co-speech gestures. Up to now, such video stimuli have been mostly controlled only for some of the technical aspects of the video material (e.g., duration of clips, encoding, framerate, etc.), leaving open the possibility that systematic differences in video stimulus materials may be concealed in the actual motion properties of the actor’s movements. Computer vision methods such as OpenPose enable the fitting of body-pose models to the consecutive frames of a video clip and thereby make it possible to recover the movements performed by the actor in a particular video clip without the use of a point-based or markerless motion-tracking system during recording. The OpenPoseR package provides a straightforward and reproducible way of working with these body-pose model data extracted from video clips using OpenPose, allowing researchers in the fields of sign language and gesture studies to quantify the amount of motion (velocity and acceleration) pertaining only to the movements performed by the actor in a video clip. These quantitative measures can be used for controlling differences in the movements of an actor in stimulus video clips or, for example, between different conditions of an experiment. In addition, the package also provides a set of functions for generating plots for data visualization, as well as an easy-to-use way of automatically extracting metadata (e.g., duration, framerate, etc.) from large sets of video files.

Details

show
hide
Language(s): eng - English
 Dates: 2020-11-122021-01-292021-02-19
 Publication Status: Published online
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: Peer
 Identifiers: DOI: 10.3389/fpsyg.2021.628728
Other: eCollection 2021
PMID: 33679550
PMC: PMC7932993
 Degree: -

Event

show

Legal Case

show

Project information

show hide
Project name : -
Grant ID : -
Funding program : -
Funding organization : Max Planck Society
Project name : -
Grant ID : -
Funding program : -
Funding organization : Foundation CELLEX

Source 1

show
hide
Title: Frontiers in Psychology
  Abbreviation : Front Psychol
Source Genre: Journal
 Creator(s):
Affiliations:
Publ. Info: Pully, Switzerland : Frontiers Research Foundation
Pages: - Volume / Issue: 12 Sequence Number: 628728 Start / End Page: - Identifier: ISSN: 1664-1078
CoNE: https://pure.mpg.de/cone/journals/resource/1664-1078