Paper presented at Linguistics Beyond and Within 2023:

Speakers’ attitudes are considered a fundamental barometer for the current and future vitality of a language, with recent work emphasising the importance of methodological developments (Kircher & Zipp, 2022). This, together with the growing concern surrounding the replicability of results across the social sciences, including in linguistics (Grieve, 2021), calls for urgent developments in research practices, including the adoption of more consistent and comparable implementations of method. In this paper, we present a series of studies conducted using a newly developed digital application for the collection, storage and transfer of data for research in multilingualism and language attitudes, specifically designed for research in bilingual populations who speak a majority language and a regional/minority/heritage language. This application offers the fundamental benefit of enhancing consistency and comparability within and across studies, which also improves reproducibility, for example by ensuring that presentation of stimuli for a speaker evaluation paradigm (Lambert et al., 1960) is more strictly controlled both across participants and across studies. As the source code is publicly available and version-controlled, other researchers can easily view and reconstruct tasks exactly as they were administered. The application was recently employed across three European communities whose regional/minority languages receive radically different degrees of socio-political recognition: Lombard (Italy), Moselle Franconian (Belgium), and Welsh (UK).Our results reveal fundamental differences in attitude scores depending on measurement type (questionnaire vs. speaker evaluation paradigm). Besides reinforcing the view that different measurements are likely to tap on different attitudinal constructs (e.g., Pantos, 2019), these results also suggest that different measurement methods may gather data on different attitude objects. We argue that this highlights a need for a more holistic approach to the measurement of language attitudes, where a battery of tests – as opposed to a single measure – should become the norm, as it has done in other research areas.