RoseSegNet: An attention-based deep learning architecture for organ segmentation of plants - Université d'Angers Accéder directement au contenu
Article Dans Une Revue Biosystems Engineering Année : 2022

RoseSegNet: An attention-based deep learning architecture for organ segmentation of plants

Kaya Turgut
Helin Dutagaci

Résumé

Incorporation of local surface features to the deep learning framework. An important component for the advancement of plant breeding, genetics, and genomics research is the rapid and accurate measurement of phenotypic traits of large plant populations. The phenotypic data that are of interest can be at multiple levels of plant organization including organ-level geometric characteristics as well as the spatial organization of the organs. 3D computer vision enabling 3D geometry acquisition and processing promises to supply fast, automated phenotypic data collection. One important component of the processing pipeline is the segmentation of the plant into its structural components, such as leaves, stems, and flowers. In this paper, a novel 3D point-based deep learning network, namely RoseSegnet, is proposed for segmentation of point clouds of rosebush plants to their organs. The network is equipped with two attention-based modules, one for extracting contextual features at the encoder phase, another for feature propagation at the decoder phase. The network processes regions of points in a hierarchical manner, where at each level, point features are aggregated using attention-based operators. The aggregation is performed by incorporating point relations both within and between the receptive fields, defined by the hierarchical organization of points. RoseSegNet outperforms the widely-used architecture PointNet++ by 4% in terms of MIoU on the publicly available ROSE-X data set. Also, it is demonstrated that introducing local surface features together with the spatial coordinates of each 3D point at the input level boosts the segmentation performance of both networks by 9% in terms of MIoU.
Fichier principal
Vignette du fichier
3D_attention_based_method_on_roses.pdf (2.42 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03948428 , version 1 (02-02-2023)

Identifiants

Citer

Kaya Turgut, Helin Dutagaci, David Rousseau. RoseSegNet: An attention-based deep learning architecture for organ segmentation of plants. Biosystems Engineering, 2022, 221, pp.138-153. ⟨10.1016/j.biosystemseng.2022.06.016⟩. ⟨hal-03948428⟩
34 Consultations
104 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More