> maybe there are filters to disregard unlikely objects as irrelevant, which act as guardrails against random braking

The filters introduce the problem of incorrectly deleting something that really is there.