Deterministic Multimodal Perturbation Enables Neuromorphic-Compatible Signal Multiplexing

Human multisensory neurons integrate multiple sensory information obtained from the external environment for precise interpretation of an event. Inspired by biological multisensory integration/multiplexing behavior, an artificial multimodal integration system capable of emulating the perception of discomfort based on the integration of multiple sensory signals is presented. The system utilizes a sensory ring oscillator that concisely and efficiently integrates thermosensory and hygrosensory signals from artificial receptors into voltage pulses whose amplitude and frequency reflect the two individual sensory signals. Subsequently, a synaptic transistor translates voltage pulses into a postsynaptic current, which exhibits a high correlation with the calculated humidex. Finally, the feasibility of the artificial multimodal integration system is successfully demonstrated using light-emitting diode discomfort indicators, suggesting that the proposed system can act as a foundation for future studies pertaining to neuromorphic perception and complex neurorobotics.

Automated summary

This article presents an artificial multimodal integration system that emulates the perception of discomfort through the integration of multiple sensory signals. The system utilizes a sensory ring oscillator to integrate thermosensory and hygrosensory signals into voltage pulses, which are then translated into a postsynaptic current highly correlated with the calculated humidex.