Learning Image-based Tree Crown Segmentation from Enhanced Lidar-based Pseudo-labels
Mapping individual tree crowns is essential for tasks such as maintaining urban tree inventories and monitoring forest health, which help us understand and care for our environment. However, automatically separating the crowns from each other in aerial imagery is challenging due to factors such as the texture and partial tree crown overlaps. In this study, we present a method to train deep learning models that segment and separate individual trees from RGB and multispectral images, using pseudo-labels derived from aerial laser scanning (ALS) data. Our study shows that the ALS-derived pseudo-labels can be enhanced using a zero-shot instance segmentation model, Segment Anything Model 2 (SAM 2). Our method offers a way to obtain domain-specific training annotations for optical image-based models without any manual annotation cost, leading to segmentation models which outperform any available models which have been targeted for general domain deployment on the same task.
6992dbde50fb2c0be47839e0
Julius Pesonen
claimed_verified
2026-02-16T15:26:15.613Z
66964ee4417bbfcd51e3ce20
/avatars/705b5dd98890e4fb7ebd9b91c9d5dc38.svg
Julius Pesonen
Julppe1
user
Julppe1
6992dbde50fb2c0be47839e1
Stefan Rua
6992dbde50fb2c0be47839e2
Josef Taher
6992dbde50fb2c0be47839e3
Niko Koivumäki
6992dbde50fb2c0be47839e4
Xiaowei Yu
6992dbde50fb2c0be47839e5
Eija Honkavaara
Learning Image-based Tree Crown Segmentation from Enhanced Lidar-based Pseudo-labels
Mapping individual tree crowns is essential for tasks such as maintaining urban tree inventories and monitoring forest health, which help us understand and care for our environment. However, automatically separating the crowns from each other in aerial imagery is challenging due to factors such as the texture and partial tree crown overlaps. In this study, we present a method to train deep learning models that segment and separate individual trees from RGB and multispectral images, using pseudo-labels derived from aerial laser scanning (ALS) data. Our study shows that the ALS-derived pseudo-labels can be enhanced using a zero-shot instance segmentation model, Segment Anything Model 2 (SAM 2). Our method offers a way to obtain domain-specific training annotations for optical image-based models without any manual annotation cost, leading to segmentation models which outperform any available models which have been targeted for general domain deployment on the same task.