Please use this identifier to cite or link to this item: https://doi.org/10.21256/zhaw-29124
Publication type: Article in scientific journal
Type of review: Peer review (publication)
Title: Can online interfaces enhance learning for public decision-making? : eliciting citizens’ preferences for multicriteria decision analysis
Authors: Aubert, Alice H.
Schmid, Sara
Lienert, Judit
et. al: No
DOI: 10.1016/j.ejor.2023.10.031
10.21256/zhaw-29124
Published in: European Journal of Operational Research
Volume(Issue): 314
Issue: 2
Page(s): 760
Pages to: 775
Issue Date: 29-Oct-2023
Publisher / Ed. Institution: Elsevier
ISSN: 0377-2217
Language: English
Subjects: Behavioral OR; Learning; Preference elicitation; Online survey; Gamification
Subject (DDC): 658.403: Decision making, information management
Abstract: Innovative online interfaces informing and consulting citizens about their preferences for multicriteria decision analysis (MCDA) could make public decision-making more participatory. We propose a three-faceted learning for decision-making framework and used it to test newly-designed online weight elicitation interfaces. We investigated two features meant to enhance learning: fully-fledged gamification with a narrative, interaction with nonplayer characters, and ambient music, and learning loops (LL) using consistency checks of elicited weights and the challenge to resolve inconsistencies. We operationalized our framework with a novel systematic set of measure instruments providing complementary data types. We designed a 2 × 2 between-subject experiment with pre- and postquestionnaires. Answers from 769 respondents, representative of the Swiss population in age and gender, indicated that the interfaces successfully raised awareness about wastewater management. Gamification was helpful: respondents performed better in the factual learning test, and unexpected social learning occurred. However, gamification lowered the perception of process understanding. The LL were beneficial: objectively, respondents performed better in the factual learning test. However, respondents perceived the LL as cognitively demanding and their factual learning as lower. Our structured assessment highlighted the need for further research to investigate, for instance, high interpersonal variability and the disparities between tested and perceived learning. Measuring preference construction remains challenging; and social learning should be added to the assessment framework. Applying such structured assessment of learning outcomes to more traditional operational research interventions would provide a baseline for future comparison.
URI: https://digitalcollection.zhaw.ch/handle/11475/29124
Related research data: https://doi.org/10.25678/0008WS
Fulltext version: Published version
License (according to publishing contract): CC BY 4.0: Attribution 4.0 International
Departement: Life Sciences and Facility Management
Organisational Unit: Institute of Natural Resource Sciences (IUNR)
Appears in collections:Publikationen Life Sciences und Facility Management

Files in This Item:
File Description SizeFormat 
2023_Aubert-etal_Online-interfaces-for-public-decision-making.pdf1.94 MBAdobe PDFThumbnail
View/Open
Show full item record
Aubert, A. H., Schmid, S., & Lienert, J. (2023). Can online interfaces enhance learning for public decision-making? : eliciting citizens’ preferences for multicriteria decision analysis. European Journal of Operational Research, 314(2), 760–775. https://doi.org/10.1016/j.ejor.2023.10.031
Aubert, A.H., Schmid, S. and Lienert, J. (2023) ‘Can online interfaces enhance learning for public decision-making? : eliciting citizens’ preferences for multicriteria decision analysis’, European Journal of Operational Research, 314(2), pp. 760–775. Available at: https://doi.org/10.1016/j.ejor.2023.10.031.
A. H. Aubert, S. Schmid, and J. Lienert, “Can online interfaces enhance learning for public decision-making? : eliciting citizens’ preferences for multicriteria decision analysis,” European Journal of Operational Research, vol. 314, no. 2, pp. 760–775, Oct. 2023, doi: 10.1016/j.ejor.2023.10.031.
AUBERT, Alice H., Sara SCHMID und Judit LIENERT, 2023. Can online interfaces enhance learning for public decision-making? : eliciting citizens’ preferences for multicriteria decision analysis. European Journal of Operational Research. 29 Oktober 2023. Bd. 314, Nr. 2, S. 760–775. DOI 10.1016/j.ejor.2023.10.031
Aubert, Alice H., Sara Schmid, and Judit Lienert. 2023. “Can Online Interfaces Enhance Learning for Public Decision-Making? : Eliciting Citizens’ Preferences for Multicriteria Decision Analysis.” European Journal of Operational Research 314 (2): 760–75. https://doi.org/10.1016/j.ejor.2023.10.031.
Aubert, Alice H., et al. “Can Online Interfaces Enhance Learning for Public Decision-Making? : Eliciting Citizens’ Preferences for Multicriteria Decision Analysis.” European Journal of Operational Research, vol. 314, no. 2, Oct. 2023, pp. 760–75, https://doi.org/10.1016/j.ejor.2023.10.031.


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.