Modeling one-shot interceptions in fruit-catching fish

Abstract

Interception of moving objects is a universal pattern of animal behavior with many industrial applications. Inspired by the behavior of the characid fish Brycon guatemalensis, which catches fruits falling onto the surface of a river, we study one-shot (i.e., open-loop) interceptions using both stochastic optimal control theory and reinforcement learning. In the first instance, an agent actuates a control (wait time before launch and heading angle) to meet its target, given a noisy estimate of the target initial state. In a minimal setting, where launch velocity and actuated control are constants, we show that the optimal wait time is attenuated by noise in both the target measurement and control actuation, as well as agent energy conservation. We then derive an upper bound for the heading angle variance which scales as the ratio of the non-vanishing optimal interception error to the initial planar separation. Complementing our control framework, our deep reinforcement learning approach shows that the neural network representing the fish first learns the value function for the interception, then learns how to aim, and finally learns the optimal wait time. Beyond the specific problem at hand, our results may also have applications to problems with little time for feedback or corrections such as perching, landing, and docking.