| Publikationstyp: | Buchbeitrag |
| Art der Begutachtung: | Editorial review |
| Titel: | Black box evaluation for operational information retrieval applications |
| Autor/-in: | Braschler, Martin Imhof, Melanie Rietberger, Stefan |
| DOI: | 10.1007/978-3-642-54798-0_9 |
| Erschienen in: | Bridging between information retrieval and databases |
| Seite(n): | 192 |
| Seiten bis: | 207 |
| Erscheinungsdatum: | 2013 |
| Reihe: | Lecture Notes in Computer Science |
| Reihenzählung: | 8173 |
| Verlag / Hrsg. Institution: | Springer |
| Verlag / Hrsg. Institution: | Heidelberg |
| ISBN: | 978-3-642-54797-3 |
| Sprache: | Englisch |
| Schlagwörter: | IE; INIT |
| Fachgebiet (DDC): | 020: Bibliotheks- und Informationswissenschaft |
| Zusammenfassung: | The black box application evaluation methodology described in this tutorial is applicable to a broad range of operational information retrieval (IR) applications. Contrary to popular, traditional IR evaluation approaches that are limited to measure the IR system performance on a test collection, the black box evaluation methodology considers an IR application in its entirety: the underlying system, the corresponding document collection, and its configuration/application layer. A comprehensive set of quality criteria is used to estimate the user’s perception of the application. Scores are assigned as a weighted average of results from tests that evaluate individual aspects. The methodology was validated in a small evaluation campaign. An analysis of this campaign shows a correlation between the testers’ perception of the applications and the evaluation scores. Moreover, functional weaknesses of the tested IR applications can be identified and then systematically targeted. |
| URI: | https://digitalcollection.zhaw.ch/handle/11475/4499 |
| Volltext Version: | Publizierte Version |
| Lizenz (gemäss Verlagsvertrag): | Lizenz gemäss Verlagsvertrag |
| Departement: | School of Engineering |
| Organisationseinheit: | Institut für Informatik (InIT) |
| Enthalten in den Sammlungen: | Publikationen School of Engineering |
Dateien zu dieser Ressource:
Es gibt keine Dateien zu dieser Ressource.
Zur Langanzeige
Braschler, M., Imhof, M., & Rietberger, S. (2013). Black box evaluation for operational information retrieval applications. In Bridging between information retrieval and databases (pp. 192–207). Springer. https://doi.org/10.1007/978-3-642-54798-0_9
Braschler, M., Imhof, M. and Rietberger, S. (2013) ‘Black box evaluation for operational information retrieval applications’, in Bridging between information retrieval and databases. Heidelberg: Springer, pp. 192–207. Available at: https://doi.org/10.1007/978-3-642-54798-0_9.
M. Braschler, M. Imhof, and S. Rietberger, “Black box evaluation for operational information retrieval applications,” in Bridging between information retrieval and databases, Heidelberg: Springer, 2013, pp. 192–207. doi: 10.1007/978-3-642-54798-0_9.
BRASCHLER, Martin, Melanie IMHOF und Stefan RIETBERGER, 2013. Black box evaluation for operational information retrieval applications. In: Bridging between information retrieval and databases. Heidelberg: Springer. S. 192–207. ISBN 978-3-642-54797-3
Braschler, Martin, Melanie Imhof, and Stefan Rietberger. 2013. “Black Box Evaluation for Operational Information Retrieval Applications.” In Bridging between Information Retrieval and Databases, 192–207. Heidelberg: Springer. https://doi.org/10.1007/978-3-642-54798-0_9.
Braschler, Martin, et al. “Black Box Evaluation for Operational Information Retrieval Applications.” Bridging between Information Retrieval and Databases, Springer, 2013, pp. 192–207, https://doi.org/10.1007/978-3-642-54798-0_9.
Alle Ressourcen in diesem Repository sind urheberrechtlich geschützt, soweit nicht anderweitig angezeigt.