January 29, 2025
Is a single model enough? The systematic comparison of computational approaches for detecting populist radical right content
The rise of populist radical right (PRR) ideas stresses the importance of understanding how individuals engage with PRR content online. However, this task is complicated by the variety of channels through which such engagement can take place
Abstract
In this article, we systematically compare computational approaches for detecting PRR content in textual data. Using 66 dictionary, classic supervised machine learning, and deep learning (DL) models, we compare how these distinct approaches perform on the PRR detection task for three Germanophone test datasets and how their performance is affected by different modes of text preprocessing. In addition to individual models, we examine the performance of 330 ensemble models combining the above-mentioned approaches for the dataset with a particularly high volume of noise. Our findings demonstrate that the DL models, in combination with more computationally intense forms of preprocessing, show the best performance among the individual models, but it remains suboptimal in the case of more noisy datasets. While the use of ensemble models shows some improvement for specific modes of preprocessing, overall, it mostly remains on par with individual DL models, thus stressing the challenging nature of computational detection of PRR content.
To continue reading please visit: https://doi.org/10.1007/s11135-024-02034-1
This open access article was published in Quality & Quantity on 29 January 2025.
Makhortykh, M., de León, E., Christner, C. et al. Is a single model enough? The systematic comparison of computational approaches for detecting populist radical right content. Qual Quant 59 (Suppl 2), 1163–1207 (2025). https://doi.org/10.1007/s11135-024-02034-1
Keywords: Automated content analysis, Populist radical right, Supervised machine learning, Neural networks, Dictionaries, Ensemble modeling
Author
See also
Panning for gold: Comparative analysis of cross-platform approaches for automated detection of political content in textual data
By Ernesto de León • November 18, 2024
Populist Radical-Right Attitudes, Political Involvement and Selective Information Consumption: Who Tunes Out and Who Prefers Attitude-Consonant Information
By Ernesto de León • March 20, 2024
Classifying TikToks Locally: Political Content Detection with Phi-4 on Android
By Ernesto de León • Fabio Votta • November 30, 2025
More results /
AI insiders warn it could end humanity. Does the public agree?
By Ernesto de León • Claes de Vreese • September 17, 2026
By Natali Helberger • June 16, 2026
By José van Dijck • April 30, 2026
Loss of judicial sight? The impact of assistive AI technologies on judicial perception — beyond the question of discretion
By Iris van Domselaar • Isabella Banks • September 23, 2026
By Tynke Schepers • July 09, 2026
By Corinne Cath • May 29, 2026
Fairy Tales That Make Life Harder: AI, and the social and ethical costs of believing in it
By Martijn Logtenberg • September 28, 2026
By Martijn Logtenberg • March 13, 2026
By Martijn Logtenberg • November 20, 2025
The Label Paradox: Can AI transparency create more distrust?
By Natali Helberger • September 21, 2026
By Jin Wan • Theo Araujo • Natali Helberger • Claes de Vreese • September 17, 2026
By João Pedro Quintais • September 03, 2026
