Automated Quality Assessment for Compressed Vibrotactile Signals Using Multi-Method Assessment Fusion

Design and optimization of vibrotactile codecs require precise measurements of the compressed signals' perceptual quality. In this paper, we present two computational approaches for estimating vibrotactile signal quality. First, we propose a novel full-reference vibrotactile quality metric called Spectral Perceptual Quality Index (SPQI), which computes a similarity score based on a computed perceptually weighted error measure. Second, we use the concept of Multi-Method Assessment Fusion (MAF) to predict the subjective quality. MAF uses a Support Vector Machine regressor to fuse multiple elementary metrics into a final quality score, which preserves the strengths of the individual metrics. We evaluate both proposed quality assessment methods on an extended subjective dataset, which we introduce as part of this work. For two of three tested vibrotactile codecs, the MSE between subjective ratings and the SPQI is reduced by 64% and 92%, respectively compared to the state of the art. With our MAF approach, we obtain the only currently available metric that accurately predicts real human user experiments for all three tested codecs. The MAF estimations reduce the average MSE to the subjective ratings over all three tested codecs by 59% compared to the best performing elementary metric.

Automated summary

This paper presents two computational approaches for estimating the quality of vibrotactile signals, including the full-reference metric SPQI based on perceptually weighted error measurement and the MAF method for predicting subjective quality. The evaluation results show that these two methods outperform existing techniques in quality assessment.