The integration of distributed, heterogeneous databases, such as those available on the World Wide Web, poses many problems. Here we consider the problem of integrating data from sources that lack common object identifiers. A solution to this problem is proposed for databases that contain informal, natural-language “names” for objects; most Web-based databases satisfy this requirement, since they usually present their information to the end-user through a veneer of text. We describe WHIRL, a “soft” database management system which supports “similarity joins,” based on certain robust, general-purpose similarity metrics for text. This enables fragments of text (e.g., informal names of objects) to be used as keys. WHIRL includes textual objects as a built-in type, similarity reasoning as a built-in predicate, and answers every query with a list of answer substitutions that are ranked according to an overall score. Experiments show that WHIRL is much faster than naive inference methods, even for short queries, and efficient on typical queries to real-world databases with tens of thousands of tuples. Inferences made by WHIRL are also surprisingly accurate, equaling the accuracy of hand-coded normalization routines on one benchmark problem, and outperforming exact matching with a plausible global domain on a second.
Keywords for this software
References in zbMATH (referenced in 11 articles , 1 standard article )
Showing results 1 to 11 of 11.
- De Raedt, Luc; Kimmig, Angelika: Probabilistic (logic) programming concepts (2015)
- Maurer, Hermann; Mehmood, Rizwan: Merging image databases as an example for information integration (2015)
- Tekli, Joe; Chbeir, Richard; Yetongnon, Kokou: An overview on XML similarity: background, current trends and future directions (2009)
- Bischof, Christian H.; Hovland, Paul D.; Norris, Boyana: On the implementation of automatic differentiation tools (2008)
- De Raedt, Luc: Data mining as constraint logic programming (2002)
- Kosala, Raymond; Van den Bussche, Jan; Bruynooghe, Maurice; Blockeel, Hendrik: Information extraction in structured documents using tree automata induction (2002)
- Koubarakis, M.; Koutris, T.; Tryfonopoulos, C.; Raftopoulou, P.: Information alert in distributed digital libraries: The models, languages, and architecture of DIAS (2002)
- Koubarakis, M.; Tryfonopoulos, C.; Raftopoulou, P.; Koutris, T.: Data models and languages for agent-based textual information dissemination (2002)
- Basu, C.; Hirsh, H.; Cohen, W. W.; Nevill-Manning, C.: Technical paper recommendation: A study in combining multiple information sources (2001)
- Tejada, Sheila; Knoblock, Craig A.; Minton, Steven: Learning object identification rules for information integration (2001)
- Cohen, W. W.: WHIRL: A word-based information representation language (2000)