Bitte benutzen Sie diese Kennung, um auf die Ressource zu verweisen:
https://doi.org/10.21256/zhaw-20318| Publikationstyp: | Beitrag in wissenschaftlicher Zeitschrift |
| Art der Begutachtung: | Editorial review |
| Titel: | Survey on evaluation methods for dialogue systems |
| Autor/-in: | Deriu, Jan Milan Rodrigo, Alvaro Otegi, Arantxa Echegoyen, Guillermo Rosset, Sophie Agirre, Eneko Cieliebak, Mark |
| et. al: | No |
| DOI: | 10.1007/s10462-020-09866-x 10.21256/zhaw-20318 |
| Erschienen in: | Artificial Intelligence Review |
| Band(Heft): | 54 |
| Heft: | 1 |
| Seite(n): | 755 |
| Seiten bis: | 810 |
| Erscheinungsdatum: | 2020 |
| Verlag / Hrsg. Institution: | Springer |
| ISSN: | 0269-2821 1573-7462 |
| Sprache: | Englisch |
| Schlagwörter: | Dialogue systems; Artificial intelligence; Evaluation; Deep learning |
| Fachgebiet (DDC): | 006: Spezielle Computerverfahren |
| Zusammenfassung: | In this paper, we survey the methods and concepts developed for the evaluation of dialogue systems. Evaluation, in and of itself, is a crucial part during the development process. Often, dialogue systems are evaluated by means of human evaluations and questionnaires. However, this tends to be very cost- and time-intensive. Thus, much work has been put into finding methods which allow a reduction in involvement of human labour. In this survey, we present the main concepts and methods. For this, we differentiate between the various classes of dialogue systems (task-oriented, conversational, and question-answering dialogue systems). We cover each class by introducing the main technologies developed for the dialogue systems and then present the evaluation methods regarding that class. |
| URI: | https://digitalcollection.zhaw.ch/handle/11475/20318 |
| Volltext Version: | Publizierte Version |
| Lizenz (gemäss Verlagsvertrag): | CC BY 4.0: Namensnennung 4.0 International |
| Departement: | School of Engineering |
| Organisationseinheit: | Institut für Informatik (InIT) |
| Publiziert im Rahmen des ZHAW-Projekts: | LIHLITH - Learning to Interact with Humans by Lifelong Interaction with Humans |
| Enthalten in den Sammlungen: | Publikationen School of Engineering |
Dateien zu dieser Ressource:
| Datei | Beschreibung | Größe | Format | |
|---|---|---|---|---|
| 2020_Deriu-etal_Survey-on-evaluation-methods-for-dialogue-systems.pdf | 1.94 MB | Adobe PDF |  Öffnen/Anzeigen |
Zur Langanzeige
Deriu, J. M., Rodrigo, A., Otegi, A., Echegoyen, G., Rosset, S., Agirre, E., & Cieliebak, M. (2020). Survey on evaluation methods for dialogue systems. Artificial Intelligence Review, 54(1), 755–810. https://doi.org/10.1007/s10462-020-09866-x
Deriu, J.M. et al. (2020) ‘Survey on evaluation methods for dialogue systems’, Artificial Intelligence Review, 54(1), pp. 755–810. Available at: https://doi.org/10.1007/s10462-020-09866-x.
J. M. Deriu et al., “Survey on evaluation methods for dialogue systems,” Artificial Intelligence Review, vol. 54, no. 1, pp. 755–810, 2020, doi: 10.1007/s10462-020-09866-x.
DERIU, Jan Milan, Alvaro RODRIGO, Arantxa OTEGI, Guillermo ECHEGOYEN, Sophie ROSSET, Eneko AGIRRE und Mark CIELIEBAK, 2020. Survey on evaluation methods for dialogue systems. Artificial Intelligence Review. 2020. Bd. 54, Nr. 1, S. 755–810. DOI 10.1007/s10462-020-09866-x
Deriu, Jan Milan, Alvaro Rodrigo, Arantxa Otegi, Guillermo Echegoyen, Sophie Rosset, Eneko Agirre, and Mark Cieliebak. 2020. “Survey on Evaluation Methods for Dialogue Systems.” Artificial Intelligence Review 54 (1): 755–810. https://doi.org/10.1007/s10462-020-09866-x.
Deriu, Jan Milan, et al. “Survey on Evaluation Methods for Dialogue Systems.” Artificial Intelligence Review, vol. 54, no. 1, 2020, pp. 755–810, https://doi.org/10.1007/s10462-020-09866-x.
Alle Ressourcen in diesem Repository sind urheberrechtlich geschützt, soweit nicht anderweitig angezeigt.