January 29, 2025
Is a single model enough? The systematic comparison of computational approaches for detecting populist radical right content
The rise of populist radical right (PRR) ideas stresses the importance of understanding how individuals engage with PRR content online. However, this task is complicated by the variety of channels through which such engagement can take place
Abstract
In this article, we systematically compare computational approaches for detecting PRR content in textual data. Using 66 dictionary, classic supervised machine learning, and deep learning (DL) models, we compare how these distinct approaches perform on the PRR detection task for three Germanophone test datasets and how their performance is affected by different modes of text preprocessing. In addition to individual models, we examine the performance of 330 ensemble models combining the above-mentioned approaches for the dataset with a particularly high volume of noise. Our findings demonstrate that the DL models, in combination with more computationally intense forms of preprocessing, show the best performance among the individual models, but it remains suboptimal in the case of more noisy datasets. While the use of ensemble models shows some improvement for specific modes of preprocessing, overall, it mostly remains on par with individual DL models, thus stressing the challenging nature of computational detection of PRR content.
To continue reading please visit: https://doi.org/10.1007/s11135-024-02034-1
This open access article was published in Quality & Quantity on 29 January 2025.
Makhortykh, M., de León, E., Christner, C. et al. Is a single model enough? The systematic comparison of computational approaches for detecting populist radical right content. Qual Quant 59 (Suppl 2), 1163–1207 (2025). https://doi.org/10.1007/s11135-024-02034-1
Keywords: Automated content analysis, Populist radical right, Supervised machine learning, Neural networks, Dictionaries, Ensemble modeling
Author
See also
Panning for gold: Comparative analysis of cross-platform approaches for automated detection of political content in textual data
By Ernesto de León • November 18, 2024
Populist Radical-Right Attitudes, Political Involvement and Selective Information Consumption: Who Tunes Out and Who Prefers Attitude-Consonant Information
By Ernesto de León • March 20, 2024
Classifying TikToks Locally: Political Content Detection with Phi-4 on Android
By Ernesto de León • Fabio Votta • November 30, 2025
More results /
When Big Tech rules universities: Reclaiming academic freedom through digital sovereignty
By Natali Helberger • June 16, 2026
By José van Dijck • April 30, 2026
By Natali Helberger • January 19, 2026
By Corinne Cath • May 29, 2026
By Magdalena Brewczyńska • April 16, 2026
By Martijn Logtenberg • November 20, 2025
By Jacqueline Kernahan • Richard Bartels • Mark de Reuver • Daniel Oberski • Roel Dobbe • October 20, 2025
Rethinking European media infrastructures
By Corinne Cath • Agustin Ferrari Braun • Seda Gürses • July 13, 2026
By Natali Helberger • June 15, 2026
By Charis Papaevangelou • Sabrina Kutscher • Natali Helberger • José van Dijck • Thomas Poell • June 01, 2026
