1. ZHAW digitalcollection
  2. School of Engineering
  3. Publikationen
  4. Publikationen School of Engineering
Please use this identifier to cite or link to this item: https://doi.org/10.21256/zhaw-20318
Full metadata record
DC FieldValueLanguage
dc.contributor.authorDeriu, Jan Milan-
dc.contributor.authorRodrigo, Alvaro-
dc.contributor.authorOtegi, Arantxa-
dc.contributor.authorEchegoyen, Guillermo-
dc.contributor.authorRosset, Sophie-
dc.contributor.authorAgirre, Eneko-
dc.contributor.authorCieliebak, Mark-
dc.date.accessioned2020-08-05T15:16:09Z-
dc.date.available2020-08-05T15:16:09Z-
dc.date.issued2020-
dc.identifier.issn0269-2821de_CH
dc.identifier.issn1573-7462de_CH
dc.identifier.urihttps://digitalcollection.zhaw.ch/handle/11475/20318-
dc.description.abstractIn this paper, we survey the methods and concepts developed for the evaluation of dialogue systems. Evaluation, in and of itself, is a crucial part during the development process. Often, dialogue systems are evaluated by means of human evaluations and questionnaires. However, this tends to be very cost- and time-intensive. Thus, much work has been put into finding methods which allow a reduction in involvement of human labour. In this survey, we present the main concepts and methods. For this, we differentiate between the various classes of dialogue systems (task-oriented, conversational, and question-answering dialogue systems). We cover each class by introducing the main technologies developed for the dialogue systems and then present the evaluation methods regarding that class.de_CH
dc.language.isoende_CH
dc.publisherSpringerde_CH
dc.relation.ispartofArtificial Intelligence Reviewde_CH
dc.rightshttp://creativecommons.org/licenses/by/4.0/de_CH
dc.subjectDialogue systemsde_CH
dc.subjectArtificial intelligencede_CH
dc.subjectEvaluationde_CH
dc.subjectDeep learningde_CH
dc.subject.ddc006: Spezielle Computerverfahrende_CH
dc.titleSurvey on evaluation methods for dialogue systemsde_CH
dc.typeBeitrag in wissenschaftlicher Zeitschriftde_CH
dcterms.typeTextde_CH
zhaw.departementSchool of Engineeringde_CH
zhaw.organisationalunitInstitut für Informatik (InIT)de_CH
dc.identifier.doi10.1007/s10462-020-09866-xde_CH
dc.identifier.doi10.21256/zhaw-20318-
zhaw.funding.euNode_CH
zhaw.issue1de_CH
zhaw.originated.zhawYesde_CH
zhaw.pages.end810de_CH
zhaw.pages.start755de_CH
zhaw.publication.statuspublishedVersionde_CH
zhaw.volume54de_CH
zhaw.publication.reviewEditorial reviewde_CH
zhaw.webfeedSoftware Systemsde_CH
zhaw.webfeedNatural Language Processingde_CH
zhaw.funding.zhawLIHLITH - Learning to Interact with Humans by Lifelong Interaction with Humansde_CH
zhaw.author.additionalNode_CH
zhaw.display.portraitYesde_CH
Appears in collections:Publikationen School of Engineering

Files in This Item:
File Description SizeFormat 
2020_Deriu-etal_Survey-on-evaluation-methods-for-dialogue-systems.pdf1.94 MBAdobe PDFThumbnail
View/Open
Show simple item record
Deriu, J. M., Rodrigo, A., Otegi, A., Echegoyen, G., Rosset, S., Agirre, E., & Cieliebak, M. (2020). Survey on evaluation methods for dialogue systems. Artificial Intelligence Review, 54(1), 755–810. https://doi.org/10.1007/s10462-020-09866-x
Deriu, J.M. et al. (2020) ‘Survey on evaluation methods for dialogue systems’, Artificial Intelligence Review, 54(1), pp. 755–810. Available at: https://doi.org/10.1007/s10462-020-09866-x.
J. M. Deriu et al., “Survey on evaluation methods for dialogue systems,” Artificial Intelligence Review, vol. 54, no. 1, pp. 755–810, 2020, doi: 10.1007/s10462-020-09866-x.
DERIU, Jan Milan, Alvaro RODRIGO, Arantxa OTEGI, Guillermo ECHEGOYEN, Sophie ROSSET, Eneko AGIRRE und Mark CIELIEBAK, 2020. Survey on evaluation methods for dialogue systems. Artificial Intelligence Review. 2020. Bd. 54, Nr. 1, S. 755–810. DOI 10.1007/s10462-020-09866-x
Deriu, Jan Milan, Alvaro Rodrigo, Arantxa Otegi, Guillermo Echegoyen, Sophie Rosset, Eneko Agirre, and Mark Cieliebak. 2020. “Survey on Evaluation Methods for Dialogue Systems.” Artificial Intelligence Review 54 (1): 755–810. https://doi.org/10.1007/s10462-020-09866-x.
Deriu, Jan Milan, et al. “Survey on Evaluation Methods for Dialogue Systems.” Artificial Intelligence Review, vol. 54, no. 1, 2020, pp. 755–810, https://doi.org/10.1007/s10462-020-09866-x.


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.