Really Vague? Automatically Identify the Potential False Vagueness within the Context of Documents

Privacy policies are critical for helping individuals make decisions on the usage of information systems. However, as a common language phenomenon, ambiguity occurs pervasively in privacy policies and largely impedes their usefulness. The existing research focuses on the identification of individual vague words or sentences, without considering the context of documents, which may cause a significant amount of false vagueness. Our goal is to automatically detect the potential false vagueness and the related supporting evidence, which illustrates or explains the vagueness, and therefore probably assist in alleviating the vagueness. We firstly analyze the public manual annotations and define four common patterns of false vagueness and three types of supporting evidence. Then we propose the approach of the F.vague-Detector to automatically detect the supporting evidence and then locate the corresponding potential false vagueness. According to our analysis, about 29-39% of individual vague sentences have at least one clarifying sentence in the documents, and experiments show good performance of our approach, with recall of 66.98-67.95%, precision of 70.59-94.85%, and F1 of 69.24-78.51% on the potential false vagueness detection. Detecting the vagueness of isolated sentences without considering their context within the whole document would bring about one-third potential false vagueness, and our approach can detect this potential false vagueness and the alleviating evidence effectively.

Automated summary

Privacy policies are crucial for individuals to make informed decisions about information system usage. However, ambiguity is widespread in privacy policies and hinders their usefulness. Existing research focuses on identifying vague words or sentences individually, without considering the context of the documents. This study aims to automatically detect potential false vagueness and the supporting evidence to alleviate the vagueness.