Convolutional neural networks for image-based sediment detection applied to a large terrestrial and airborne dataset

Image-based grain sizing has been used to measure grain size more efficiently compared with traditional methods (e.g., sieving and Wolman pebble count). However, current methods to automatically detect individual grains are largely based on detecting grain interstices from image intensity which not only require a significant level of expertise for parameter tuning but also underperform when they are applied to suboptimal environments (e.g., dense organic debris, various sediment lithology). We proposed a model (GrainID) based on convolutional neural networks to measure grain size in a diverse range of fluvial environments. A dataset of more than 125 000 grains from flume and field measurements were compiled to develop GrainID. Tests were performed to compare the predictive ability of GrainID with sieving, manual labeling, Wolman pebble counts (Wolman, 1954) and BASEGRAIN (Detert and Weitbrecht, 2012). When compared with the sieving results for a sandy-gravel bed, GrainID yielded high predictive accuracy (comparable to the performance of manual labeling) and outperformed BASEGRAIN and Wolman pebble counts (especially for small grains). For the entire evaluation dataset, GrainID once again showed fewer predictive errors and significantly lower variation in results in comparison with BASEGRAIN and Wolman pebble counts and maintained this advantage even in uncalibrated rivers with drone images Moreover, the existence of vegetation and noise have little influence on the performance of GrainID. Analysis indicated that GrainID performed optimally when the image resolution is higher than 1 8 mm pixel(-1), the image tile size is 512 x 512 pixels and the grain area truncation values (the area of smallest detectable grains) were equal to 18-25 pixels.

Automated summary

Image-based grain sizing has been used as an efficient method to measure grain size compared to traditional methods. However, current automatic detection methods based on image intensity have limitations in suboptimal environments. In this study, a convolutional neural network model called GrainID was proposed to measure grain size in diverse fluvial environments. Tests showed that GrainID had high predictive accuracy and outperformed other methods, even in uncalibrated rivers with drone images. GrainID also showed less variation in results and was less affected by vegetation and noise.