www.uhasselt.be
DSpace

Document Server@UHasselt >
Research >
Research publications >

Please use this identifier to cite or link to this item: http://hdl.handle.net/1942/7912

Title: Improving data quality: consistency and accuracy
Authors: Fan, Wenfei
GEERTS, Floris
Jia, Xibei
Issue Date: 2007
Publisher: ACM
Citation: Proceedings of the 33rd International Conference on Very Large Databases (VLDB). p. 315-326.
Abstract: Two central criteria for data quality are consistency and accuracy. Inconsistencies and errors in a database often emerge as violations of integrity constraints. Given a dirty database D, one needs automated methods to make it consistent, i.e., find a repair D0 that satisfies the constraints and “minimally” differs from D. Equally important is to ensure that the automatically-generated repair D0 is accurate, or makes sense, i.e., D0 differs from the “correct” data within a predefined bound. This paper studies effective methods for improving both data consistency and accuracy. We employ a class of conditional functional dependencies (CFDs) to specify the consistency of the data, which are able to capture inconsistencies and errors beyond what their traditional counterparts can catch. To improve the consistency of the data, we propose two algorithms: one for automatically computing a repair D0 that satisfies a given set of CFDs, and the other for incrementally finding a repair in response to updates to a clean database. We show that both problems are intractable. Although our algorithms are necessarily heuristic, we experimentally verify that the methods are effective and efficient. Moreover, we develop a statistical method that guarantees that the repairs found by the algorithms are accurate above a predefined rate without incurring excessive user interaction
URI: http://hdl.handle.net/1942/7912
Link to publication: http://www.vldb.org/conf/2007/papers/research/p315-cong.pdf
ISBN: 78-1-59593-649-3
Category: C1
Type: Proceedings Paper
Appears in Collections: Research publications

Files in This Item:

Description SizeFormat
Published version581.7 kBAdobe PDF

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.