Vertically integrated spiking cone photoreceptor arrays for color perception

The cone photoreceptors in our eyes selectively transduce the natural light into spiking representations, which endows the brain with high energy-efficiency color vision. However, the cone-like device with color-selectivity and spike-encoding capability remains challenging. Here, we propose a metal oxide-based vertically integrated spiking cone photoreceptor array, which can directly transduce persistent lights into spike trains at a certain rate according to the input wavelengths. Such spiking cone photoreceptors have an ultralow power consumption of less than 400 picowatts per spike in visible light, which is very close to biological cones. In this work, lights with three wavelengths were exploited as pseudo-three-primary colors to form 'colorful' images for recognition tasks, and the device with the ability to discriminate mixed colors shows better accuracy. Our results would enable hardware spiking neural networks with biologically plausible visual perception and provide great potential for the development of dynamic vision sensors. Future intelligent vision systems need efficient capacitor-free spiking photoreceptor for color perception. Here, Wang et al. report a metal oxide-based vertically integrated spiking cone photoreceptor array which transduces light into spike trains with a power consumption of less than 400 picowatts.

Automated summary

The research proposes a metal oxide-based vertically integrated spiking cone photoreceptor array that can directly convert persistent lights into spike trains with a power consumption of less than 400 picowatts. By using lights with three wavelengths as pseudo-three-primary colors, the device shows better accuracy in discriminating mixed colors. The results have the potential to enable hardware spiking neural networks with biologically plausible visual perception and contribute to the development of dynamic vision sensors.