4.4 Article

Towards certain fixes with editing rules and master data

Journal

VLDB JOURNAL
Volume 21, Issue 2, Pages 213-238

Publisher

SPRINGER
DOI: 10.1007/s00778-011-0253-7

Keywords

Certain fix; Editing rule; Master data; Data cleaning; Data quality

Funding

  1. RSE-NSFC
  2. IBM
  3. National Basic Research Program of China (973 Program) [2012CB316200]
  4. NGFR [973 2011CB302602]
  5. NSFC [90818028, 60903149]
  6. Engineering and Physical Sciences Research Council [EP/H008063/1, EP/E029213/1] Funding Source: researchfish
  7. EPSRC [EP/H008063/1, EP/E029213/1] Funding Source: UKRI

Ask authors/readers for more resources

A variety of integrity constraints have been studied for data cleaning. While these constraints can detect the presence of errors, they fall short of guiding us to correct the errors. Indeed, data repairing based on these constraints may not find certain fixes that are guaranteed correct, and worse still, may even introduce new errors when attempting to repair the data. We propose a method for finding certain fixes, based on master data, a notion of certain regions, and a class of editing rules. A certain region is a set of attributes that are assured correct by the users. Given a certain region and master data, editing rules tell us what attributes to fix and how to update them. We show how the method can be used in data monitoring and enrichment. We also develop techniques for reasoning about editing rules, to decide whether they lead to a unique fix and whether they are able to fix all the attributes in a tuple, relative to master data and a certain region. Furthermore, we present a framework and an algorithm to find certain fixes, by interacting with the users to ensure that one of the certain regions is correct. We experimentally verify the effectiveness and scalability of the algorithm.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.4
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available