4.6 Article

Visual-Olfactory Synergistic Perception Based on Dual-Focus Imaging and a Bionic Learning Architecture

Related references

Note: Only part of the references are listed.
Article Multidisciplinary Sciences

A star-nose-like tactile-olfactory bionic sensing array for robust object recognition in non-visual environments

Mengwei Liu et al.

Summary: This article introduces an AI-assisted high-performance object recognition method, the tactile-olfactory intelligent sensing system, which is based on the rapid development of sensing and computational capabilities. The system can real-time acquire the local topography, stiffness, and odor of various objects without visual input, and achieved an accuracy of 96.9% in classifying 11 typical objects in a simulated rescue scenario.

NATURE COMMUNICATIONS (2022)

Article Robotics

All-printed soft human-machine interface for robotic physicochemical sensing

You Yu et al.

Summary: Ultrasensitive multimodal physicochemical sensing for autonomous robotic decision-making is demonstrated using an all-printed, mass-producible soft electronic skin-based human-machine interface. The system incorporates custom-developed nanomaterial inks to manufacture flexible physicochemical sensor arrays for electrophysiology recording, tactile perception, and robotic sensing of hazardous materials. The artificial intelligence-powered system enables remote robotic control and in situ threat compound detection in extreme environments, with user-interactive feedback. The technology has potential applications in various fields, including agriculture, security, and public health.

SCIENCE ROBOTICS (2022)

Article Biochemical Research Methods

Evaluation and development of deep neural networks for image super-resolution in optical microscopy

Chang Qiao et al.

Summary: This study investigates the performance of deep-learning models for super-resolution imaging, introducing models that utilize frequency content information in the Fourier domain to improve imaging under low-SNR conditions. The research shows that deep-learning models can robustly reconstruct SIM images under low signal-to-noise ratio conditions, achieving comparable image quality to SIM in multicolor live-cell imaging experiments.

NATURE METHODS (2021)

Article Multidisciplinary Sciences

Bioinspired multisensory neural network with crossmodal integration and recognition

Hongwei Tan et al.

Summary: The multisensory neural network integrates and interacts vision, touch, hearing, smell, and taste, enabling crossmodal recognition and imagination, presenting a promising approach for robotic sensing and perception. Tan et al. report an artificial spiking multisensory neural network that mimics the crossmodal perception of biological brains.

NATURE COMMUNICATIONS (2021)

Article Multidisciplinary Sciences

Imaging-based spectrometer-less optofluidic biosensors based on dielectric metasurfaces for detecting extracellular vesicles

Yasaman Jahani et al.

Summary: The single-wavelength imaging biosensors introduced in this study achieve superior sensitivity for real-time detection of breast cancer extracellular vesicles, paving the way for miniaturized devices for point-of-care diagnostics. The method is based on reconstructing spectral shift information induced by biomarkers dynamically using diatomic dielectric metasurfaces supporting bound states in the continuum.

NATURE COMMUNICATIONS (2021)

Proceedings Paper Computer Science, Artificial Intelligence

On-chip Pixel Reconstruction using Simple CNN for Sparsely Read CMOS Image Sensor

Wilfred Kisku et al.

Summary: CMOS image sensors are popular due to their low power consumption and ability to scale down, with improvements possible through circuitry enhancements and on-chip image processing capabilities; a solution is proposed to reconstruct original information by reading only a small fraction of pixel array data and predicting unread pixels using a simple convolutional neural network; the hardware accelerator, incorporating the CNN model, considers power consumption and latency, achieving a PSNR of approximately 30 dB for test images with 85% pixel skipping.

2021 IEEE 3RD INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS) (2021)

Article Food Science & Technology

Machine learning-enabled non-destructive paper chromogenic array detection of multiplexed viable pathogens on food

Manyun Yang et al.

Summary: The system developed integrates paper chromogenic arrays (PCAs) and machine learning to automatically recognize PCA patterns on multiplexed viable pathogens with strain-level specificity. This approach has the potential to advance non-destructive pathogen detection and identification on food.

NATURE FOOD (2021)

Article Chemistry, Multidisciplinary

A Colorimetric Artificial Olfactory System for Airborne Improvised Explosive Identification

Guangfa Wang et al.

ADVANCED MATERIALS (2020)

Article Biochemical Research Methods

Multi-sensor integration approach based on hyperspectral imaging and electronic nose for quantitation of fat and peroxide value of pork meat

Joshua Harrington Aheto et al.

ANALYTICAL AND BIOANALYTICAL CHEMISTRY (2020)

Editorial Material Multidisciplinary Sciences

In the heat of the night

Claudio R. Lazzari

SCIENCE (2020)

Review Biotechnology & Applied Microbiology

Visual sensory systems of predatory and parasitic arthropods

Un Taek Lim et al.

BIOCONTROL SCIENCE AND TECHNOLOGY (2020)

Article Chemistry, Analytical

A Microdroplet-Based Colorimetric Sensing Platform on a CMOS Imager Chip

Kyle R. Mallires et al.

ANALYTICAL CHEMISTRY (2020)

Review Chemistry, Multidisciplinary

The Optoelectronic Nose: Colorimetric and Fluorometric Sensor Arrays

Zheng Li et al.

CHEMICAL REVIEWS (2019)

Article Multidisciplinary Sciences

Learning the signatures of the human grasp using a scalable tactile glove

Subramanian Sundaram et al.

NATURE (2019)

Article Zoology

Use of visual and olfactory sensory cues by an apex predator in deciduous forests

Riley R. Lawson et al.

CANADIAN JOURNAL OF ZOOLOGY (2019)

Article Engineering, Biomedical

Simultaneous Monitoring of Ballistocardiogram and Photoplethysmogram Using a Camera

Dangdang Shao et al.

IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING (2017)

Article Robotics

Recent progress on tactile object recognition

Huaping Liu et al.

INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS (2017)

Article Computer Science, Hardware & Architecture

ImageNet Classification with Deep Convolutional Neural Networks

Alex Krizhevsky et al.

COMMUNICATIONS OF THE ACM (2017)

Article Chemistry, Multidisciplinary

Portable Optoelectronic Nose for Monitoring Meat Freshness

Zheng Li et al.

ACS SENSORS (2016)

Article Multidisciplinary Sciences

A multilevel multimodal circuit enhances action selection in Drosophila

Tomoko Ohyama et al.

NATURE (2015)

Review Multidisciplinary Sciences

Deep learning

Yann LeCun et al.

NATURE (2015)

Review Neurosciences

Development of multisensory integration from the perspective of the individual neuron

Barry E. Stein et al.

NATURE REVIEWS NEUROSCIENCE (2014)

Article Multidisciplinary Sciences

High-resolution liquid patterns via three-dimensional droplet shape control

Rishi Raj et al.

NATURE COMMUNICATIONS (2014)

Article Biochemical Research Methods

Chip-scale microscopy imaging

Guoan Zheng

JOURNAL OF BIOPHOTONICS (2012)

Article Chemistry, Multidisciplinary

An optoelectronic nose for the detection of toxic gases

Sung H. Lim et al.

NATURE CHEMISTRY (2009)

Review Neurosciences

Complex brain networks: graph theoretical analysis of structural and functional systems

Edward T. Bullmore et al.

NATURE REVIEWS NEUROSCIENCE (2009)

Article Multidisciplinary Sciences

Crossmodal interactions between olfactory and visual learning in Drosophila

FZ Guo et al.

SCIENCE (2005)