4.7 Article

Multi-modal sorting in plastic and wood waste streams

期刊

出版社

ELSEVIER
DOI: 10.1016/j.resconrec.2023.107244

关键词

Machine vision; Multi-spectral; Multi-modal learning; Waste management; Waste sorting; Plastic-wood wastes

向作者/读者索取更多资源

Addressing the waste crisis requires innovative waste management strategies, and this study proposes a vision-based architecture using deep learning multi-modal approach for effective sorting of parts based on shape and material properties. By extracting spatial and spectral information from RGB and multi-spectral sensors and projecting them in a common latent space, objects can be accurately classified. In addition, a Multispectral Mixed Waste Dataset (MMWD) is created, containing multi-spectral data and RGB data, to support the proposed deep architecture.
Addressing the escalating waste crisis necessitates innovative waste management strategies, particularly valorisation techniques, the efficiency of which is dictated by the purity of the feedstock. In order to mitigate the segregation challenges encountered in complex and non-homogeneous waste streams, this work proposes a vision-based architecture ample for effective sorting of parts based on shape and material-related properties. The proposed work encapsulates a novel deep learning multi-modal approach, in which multiple parallel auto -encoders are used to extract spatio-spectral information from the RGB and multi-spectral sensors and project them in a common latent space. By decoding the latent space representations, the class of each object is picked out, thus guiding the robotic sub-system accordingly. To support the proposed deep architecture, a dataset, called Multispectral Mixed Waste Dataset (MMWD) was produced, containing multi-spectral data from the visible (16 bands), near-infrared (25 bands) regions of the electromagnetic spectrum and RGB (3 bands) data. The dataset includes the following seven plastic and wood wastes: Polypropylene (PP), PolyEthylene Terephthalate (PET), Low-Density PolyEthylene (LDPE), High-Density PolyEthylene (HDPE), Medium Density Fibreboard (MDF), Melamine Faced Chipboards (MFC), and Oak Veneer samples. For the localisation of waste along the conveyor belt, YOLO v8 is used to achieve 99.5% mean average precision (mAP50). In the classification task, where the multi-modal approach was followed, the overall accuracy achieved is 96% with the prediction recall being greater than 95% for the majority of classes under examination.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据