An ontology knowledge inspection methodology for quality assessment and continuous improvement

Ontology-learning methods were introduced in the knowledge engineering area to automatically build ontologies from natural language texts related to a domain. Despite the initial appeal of these methods, automatically generated ontologies may have errors, inconsistencies, and a poor design quality, all of which must be manually fixed, in order to maintain the validity and usefulness of automated output. In this work, we propose a methodology to assess ontologies quality (quantitatively and graphically) and to fix ontology inconsistencies minimizing design defects. The proposed methodology is based on the Deming cycle and is grounded on quality standards that proved effective in the software engineering domain and present high potential to be extended to knowledge engineering quality management. This paper demonstrates that software engineering quality assessment approaches and techniques can be successfully extended and applied to the ontology-fixing and quality improvement problem. The proposed methodology was validated in a testing ontology, by ontology design quality comparison between a manually created and automatically generated ontology.

Automated summary

This paper introduces a methodology for evaluating and fixing quality issues of ontologies generated from natural language texts, aiming to minimize design defects. The proposed methodology, based on the Deming cycle and leveraging effective quality standards from the software engineering domain, has the potential to be extended to knowledge engineering quality management.