Improving diagnostic accuracy using a hierarchical neural network to model decision subtasks

A number of quantitative models including linear discriminant analysis, logistic regression, k nearest neighbor, kernel density, recursive partitioning, and neural networks are being used in medical diagnostic support systems to assist human decision-makers in disease diagnosis. This research investigates the decision accuracy of neural network models for the differential diagnosis of six erythamatous-squamous diseases. Conditions where a hierarchical neural network model can increase diagnostic accuracy by partitioning the decision domain into subtasks that are easier to learn are specifically addressed. Self-organizing maps (SOM) are used to portray the 34 feature variables in a two dimensional plot that maintains topological ordering. The SOM identifies five inconsistent cases that are likely sources of error for the quantitative decision models; the lower bound for the diagnostic decision error based on five errors is 0.0140. The traditional application of the quantitative models cited above results in diagnostic error levels substantially greater than this target level. A two-stage hierarchical neural network is designed by combining a multilayer perceptron first stage and a mixture-of-experts second stage. The second stage mixture-of-experts neural network learns a subtask of the diagnostic decision, the discrimination between seborrheic dermatitis and pityriasis rosea. The diagnostic accuracy of the two stage neural network approaches the target performance established from the SOM with an error rate of 0.0159. (C) 2000 Elsevier Science Ireland Ltd. All rights reserved.