| Publication type: | Conference paper |
| Type of review: | Editorial review |
| Title: | A new conversational interaction concept for document creation and editing on mobile devices for visually impaired users |
| Authors: | Darvishy, Alireza Heeb, Zeno Beljulji, Edin Hutter, Hans-Peter |
| et. al: | No |
| DOI: | 10.54941/ahfe1003651 |
| Proceedings: | Human Factors in Accessibility and Assistive Technology |
| Editors of the parent work: | Zallio, Matteo |
| Volume(Issue): | 87 |
| Page(s): | 33 |
| Pages to: | 40 |
| Conference details: | 14th International Conference on Applied Human Factors and Ergonomics and the Affiliated Conferences, San Francisco, USA, 20-24 July 2023 |
| Issue Date: | 2023 |
| Publisher / Ed. Institution: | AHFE International |
| ISBN: | 978-1-958651-63-6 |
| ISSN: | 2771-0718 |
| Language: | English |
| Subjects: | Visual impairment; Mobile device; Non-visual interaction; NLP; Speech input; Speech output; Document creation |
| Subject (DDC): | 006: Special computer methods |
| Abstract: | This paper describes the ongoing development of a conversational interaction concept that allows visually impaired users to easily create and edit text documents on mobile devices using mainly voice input. In order to verify the concept, a prototype app was developed and tested for both iOS and Android systems, based on the natural-language understanding (NLU) platform Google Dialogflow. The app and interaction concept were repeatedly tested by users with and without visual impairments. Based on their feedback, the concept was continuously refined, adapted and improved on both mobile platforms. In an iterative user-centred design approach, the following research questions were investigated: Can a visually impaired user rely mainly on speech commands to efficiently create and edit a document on mobile devices? User testing found that an interaction concept based on conversational speech commands was easy and intuitive for visually impaired users. However, it was also found that relying on speech commands alone created its own obstacles, and that a combination of gestures and voice interaction would be more robust. Future research and more extensive useability tests should be carried out among visually impaired users in order to optimize the interaction concept. |
| URI: | https://digitalcollection.zhaw.ch/handle/11475/28427 |
| Fulltext version: | Published version |
| License (according to publishing contract): | Licence according to publishing contract |
| Departement: | School of Engineering |
| Organisational Unit: | Institute of Computer Science (InIT) |
| Appears in collections: | Publikationen School of Engineering |
Files in This Item:
There are no files associated with this item.
Show full item record
Darvishy, A., Heeb, Z., Beljulji, E., & Hutter, H.-P. (2023). A new conversational interaction concept for document creation and editing on mobile devices for visually impaired users [Conference paper]. In M. Zallio (Ed.), Human Factors in Accessibility and Assistive Technology (Vol. 87, pp. 33–40). AHFE International. https://doi.org/10.54941/ahfe1003651
Darvishy, A. et al. (2023) ‘A new conversational interaction concept for document creation and editing on mobile devices for visually impaired users’, in M. Zallio (ed.) Human Factors in Accessibility and Assistive Technology. AHFE International, pp. 33–40. Available at: https://doi.org/10.54941/ahfe1003651.
A. Darvishy, Z. Heeb, E. Beljulji, and H.-P. Hutter, “A new conversational interaction concept for document creation and editing on mobile devices for visually impaired users,” in Human Factors in Accessibility and Assistive Technology, 2023, vol. 87, pp. 33–40. doi: 10.54941/ahfe1003651.
DARVISHY, Alireza, Zeno HEEB, Edin BELJULJI und Hans-Peter HUTTER, 2023. A new conversational interaction concept for document creation and editing on mobile devices for visually impaired users. In: Matteo ZALLIO (Hrsg.), Human Factors in Accessibility and Assistive Technology. Conference paper. AHFE International. 2023. S. 33–40. ISBN 978-1-958651-63-6
Darvishy, Alireza, Zeno Heeb, Edin Beljulji, and Hans-Peter Hutter. 2023. “A New Conversational Interaction Concept for Document Creation and Editing on Mobile Devices for Visually Impaired Users.” Conference paper. In Human Factors in Accessibility and Assistive Technology, edited by Matteo Zallio, 87:33–40. AHFE International. https://doi.org/10.54941/ahfe1003651.
Darvishy, Alireza, et al. “A New Conversational Interaction Concept for Document Creation and Editing on Mobile Devices for Visually Impaired Users.” Human Factors in Accessibility and Assistive Technology, edited by Matteo Zallio, vol. 87, AHFE International, 2023, pp. 33–40, https://doi.org/10.54941/ahfe1003651.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.