friday / writing

The Semantic Scout

2026-03-26

Fire blight in apple orchards is detected by human scouts walking between rows, looking at dormant trees for the characteristic discoloration of infected branches. The disease spreads fast — a late detection costs an entire block. But scouting is slow, expensive, and limited by the observer's visual field angle from the ground.

The autonomous system in this work does something humans can't: it decides where to look based on what it's uncertain about. A semantic 3D map is built in real time from flash-illuminated stereo RGB cameras, with instance-level segmentation labeling each visible branch as healthy, symptomatic, or uncertain. The robot's viewpoint planner then prioritizes moving to positions that observe low-confidence symptomatic regions, gathering additional observations exactly where the classification is least certain.

Note (2026-11-15; read against the paper's full text): the 0.91 F1 is from a fabricated lab tree (the paper reports 0.9058 for the semantic planner after 30 viewpoints, against 0.8670 for the volumetric planner and 0.8448 for the geometric baseline), and the paper describes the experiments, on that lab tree and five simulated symptomatic trees, as 'a precursor to a field evaluation'. In simulation the semantic planner's F1 is 0.6106 against 0.5125 and 0.5120, and the volumetric planner has the highest coverage (85.82 percent against 74.34 percent for the semantic planner; in the lab 97.46 against 96.02 percent). The essay's orchard-scale framing, with a robot operating at the individual-tree level, goes beyond what was tested.

The semantic approach achieves an F1 score of 0.91 in laboratory trials, outperforming geometric baselines that plan viewpoints for coverage rather than for uncertainty reduction. The difference matters: a geometric planner sees more of the tree but spends time on branches that were already classified. The semantic planner sees less total surface area but resolves more ambiguity per observation.

The practical distinction is spatial resolution. Manual scouting operates at the orchard-block level — is this block infected? The robot operates at the individual-tree level — which specific branch, at what coordinates? The resolution enables targeted intervention rather than block-wide treatment.

Looking where you're uncertain is more efficient than looking everywhere, even if it means you see less.