Who Do Politicians Claim (not) to Represent? Developing a Machine Learning Method for Detecting and Classifying Politicians' Claims of Representation

Ine Gevers

University of Antwerp

August De Mulder

University of Antwerp

Walter Daelemans

University of Antwerp

Stefaan Walgrave

University of Antwerp

In recent decades, many theoretical scholars have argued that we should pay attention to the claims of representation politicians make about groups in society. Nevertheless, despite recent advances on this topic, empirical research on politicians' claims of representation remains relatively scant and mostly limited to case studies and manual annotation. Therefore, we developed a method to automatically classify claims by Dutch-speaking Belgian politicians by drawing from machine learning techniques. Following our new operationalization of claims of representation, which includes six constitutive elements, we use a limited amount of manually annotated data to train NLP models to automatically extract and classify these six elements. Our results show that using a combination of transformer learning (such as BERT), classic machine learning algorithms (such as SVMs), and rule-based methods, we can successfully classify each element of claims of representation, with macro F-1 scores between 0.61 and 0.91. Taking all elements into account, we are able to correctly classify over 70% of all claims in Belgian politicians' Facebook posts between 2010 and 2022. Being the first to automate this process, this study contributes to the literature by offering a tested and validated method for classifying claims in politicians' communication, thereby allowing large scale, longitudinal analysis of claims.

CLIN33
The 33rd Meeting of Computational Linguistics in The Netherlands (CLIN 33)
UAntwerpen City Campus: Building R
Rodestraat 14, Antwerp, Belgium
22 September 2023
logo of Clips