Bitte benutzen Sie diese Kennung, um auf die Ressource zu verweisen:
https://doi.org/10.21256/zhaw-3197| Publikationstyp: | Konferenz: Paper |
| Art der Begutachtung: | Peer review (Publikation) |
| Titel: | Entity matching on unstructured data : an active learning approach |
| Autor/-in: | Brunner, Ursin Stockinger, Kurt |
| DOI: | 10.1109/SDS.2019.00006 10.21256/zhaw-3197 |
| Tagungsband: | Proceedings of the 6th SDS |
| Seite(n): | 97 |
| Seiten bis: | 102 |
| Angaben zur Konferenz: | Swiss Conference on Data Science, Berne, Switzerland, 14 June 2019 |
| Erscheinungsdatum: | 14-Jun-2019 |
| Verlag / Hrsg. Institution: | IEEE |
| ISBN: | 978-1-7281-3105-4 |
| Sprache: | Englisch |
| Schlagwörter: | Entity matching; Active learning; Data integration; Unstructured data |
| Fachgebiet (DDC): | 005: Computerprogrammierung, Programme und Daten 006: Spezielle Computerverfahren |
| Zusammenfassung: | With the growing number of data sources in enterprises, entity matching becomes a crucial part of every data integration project. In order to reduce the human effort involved in identifying matching entities between different database tables, typically machine learning algorithms are applied. Moreover, active learning is often combined with supervised machine learning methods to further reduce the effort of labeling entities as true or false matches. However, while state-of-the-art active learning algorithms have proven to work well on structured data sets, unstructured data still poses a challenge in entity matching. This paper proposes an end-to-end entity matching pipeline to minimize the human labeling effort for entity matching on unstructured data sets. We use several natural language processing techniques such as soft tf-idf to pre-process the record pairs before we classify them using a novel Active Learning with Uncertainty Sampling (ALWUS) algorithm. We designed our algorithm as a plug-in system to work with any state-of-the-art classifier such as support vector machines, random forests or deep neural networks. Detailed experimental results demonstrate that our end-to-end entity matching pipeline clearly outperforms comparable entity matching approaches on an unstructured real-word data set. Our approach achieves significantly better scores (F1-score) while using 1 to 2 orders of magnitude fewer human labeling efforts than existing state-of-the-art algorithms. |
| Weitere Angaben: | © 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. |
| URI: | https://digitalcollection.zhaw.ch/handle/11475/17388 |
| Volltext Version: | Akzeptierte Version |
| Lizenz (gemäss Verlagsvertrag): | Keine Angabe |
| Departement: | School of Engineering |
| Organisationseinheit: | Institut für Informatik (InIT) |
| Enthalten in den Sammlungen: | Publikationen School of Engineering |
Dateien zu dieser Ressource:
| Datei | Beschreibung | Größe | Format | |
|---|---|---|---|---|
| ActiveLearning_Brunner_Stockinger_SDS_2019.pdf | Accepted Version | 221.35 kB | Adobe PDF |  Öffnen/Anzeigen |
Zur Langanzeige
Brunner, U., & Stockinger, K. (2019). Entity matching on unstructured data : an active learning approach [Conference paper]. Proceedings of the 6th SDS, 97–102. https://doi.org/10.1109/SDS.2019.00006
Brunner, U. and Stockinger, K. (2019) ‘Entity matching on unstructured data : an active learning approach’, in Proceedings of the 6th SDS. IEEE, pp. 97–102. Available at: https://doi.org/10.1109/SDS.2019.00006.
U. Brunner and K. Stockinger, “Entity matching on unstructured data : an active learning approach,” in Proceedings of the 6th SDS, Jun. 2019, pp. 97–102. doi: 10.1109/SDS.2019.00006.
BRUNNER, Ursin und Kurt STOCKINGER, 2019. Entity matching on unstructured data : an active learning approach. In: Proceedings of the 6th SDS. Conference paper. IEEE. 14 Juni 2019. S. 97–102. ISBN 978-1-7281-3105-4
Brunner, Ursin, and Kurt Stockinger. 2019. “Entity Matching on Unstructured Data : An Active Learning Approach.” Conference paper. In Proceedings of the 6th SDS, 97–102. IEEE. https://doi.org/10.1109/SDS.2019.00006.
Brunner, Ursin, and Kurt Stockinger. “Entity Matching on Unstructured Data : An Active Learning Approach.” Proceedings of the 6th SDS, IEEE, 2019, pp. 97–102, https://doi.org/10.1109/SDS.2019.00006.
Alle Ressourcen in diesem Repository sind urheberrechtlich geschützt, soweit nicht anderweitig angezeigt.