English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
  Validating Wordscores: The Promises and Pitfalls of Computational Text Scaling

Bruinsma, B., & Gemenis, K. (2019). Validating Wordscores: The Promises and Pitfalls of Computational Text Scaling. Communication Methods and Measures, 13(3), 212-227. doi:10.1080/19312458.2019.1594741.

Item is

Files

show Files
hide Files
:
mpifg_zs19_1704.pdf (Any fulltext), 3MB
 
File Permalink:
-
Name:
mpifg_zs19_1704.pdf
Description:
Full text
OA-Status:
Visibility:
Restricted (Max Planck Institute for the Study of Societies, MKGS; )
MIME-Type / Checksum:
application/pdf
Technical Metadata:
Copyright Date:
-
Copyright Info:
-
License:
-

Locators

show
hide
Locator:
https://doi.org/10.1080/19312458.2019.1594741 (Publisher version)
Description:
Full text open access via publisher
OA-Status:
Locator:
https://doi.org/10.7910/DVN/GOSVG6 (Research data)
Description:
Replication data
OA-Status:

Creators

show
hide
 Creators:
Bruinsma, Bastiaan1, Author
Gemenis, Kostas2, Author           
Affiliations:
1Department of Political and Social Sciences, Scuola Normale Superiore, Florence, Italy, ou_persistent22              
2Politische Ökonomie von Wachstumsmodellen, MPI for the Study of Societies, Max Planck Society, ou_2489691              

Content

show
hide
Free keywords: -
 Abstract: Wordscores is a popular computational text analysis method with numerous applications in communication research. Wordscores claims to scale documents on specified dimensions without requiring researchers to read or even understand the language of the input text. We investigate whether Wordscores delivers this claim by scaling the Euromanifestos of 117 political parties across 23 countries on 4 salient dimensions of political conflict. We assess validity by comparing the Wordscores estimates to expert surveys and other judgmental measures, and by examining the Wordscores’s estimates ability to predict party membership in the European Parliament groups. We find that the Wordscores estimates correlate poorly with expert and judgmental measures of party positions, while the latter outperform Wordscores in the predictive validity test. We conclude that Wordscores does not live up to its original claim of a “quick and easy” language blind method, and urge researchers to demonstrate the validity of the method in their domain of interest before any empirical analysis.

Details

show
hide
Language(s): eng - English
 Dates: 2019-04-172019
 Publication Status: Issued
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: Peer
 Identifiers: DOI: 10.1080/19312458.2019.1594741
 Degree: -

Event

show

Legal Case

show

Project information

show

Source 1

show
hide
Title: Communication Methods and Measures
Source Genre: Journal
 Creator(s):
Affiliations:
Publ. Info: -
Pages: - Volume / Issue: 13 (3) Sequence Number: - Start / End Page: 212 - 227 Identifier: ISSN: 1931-2458
ISSN: 1931-2466