Search bioRxiv⌕ Search
Home/Archive/bioRxiv

bioRxiv · 10.64898/2026.03.12.711471

TracktorLive: an integrated real-time object tracking and response system

Minasandra, P.·Sridhar, V. H.·Roche, D. G.·Planas-Sitja, I.
View original source ↗Export metadata ↓

Abstract

Real-time tracking and automated response systems are essential for standardising experiments, reducing observer bias, and improving reproducibility in studies of movement and behaviour. However, existing solutions face significant challenges: AI-based tracking systems require expensive hardware and impose computational delays, creating challenges for closed-loop experiments; existing real-time tracking tools lack standardised implementations for response delivery; and steep learning curves limit accessibility for users without programming or computer vision expertise. Here, we introduce TracktorLive, an open-source Python package designed to overcome these challenges through concurrency and a modular, cassette-based architecture. TracktorLive leverages traditional computer vision techniques to perform image-based object detection without the need for expensive hardware or deep learning. By parallelizing object tracking and response delivery into separate, concurrent server and client processes, the software minimizes frame processing time, enabling rapid, real-time analysis and response delivery. User-friendly cassettes--portable code snippets that can be copy-pasted into scripts--enable users with minimal programming experience to implement complex workflows for use in experiments and practical applications. We demonstrate TracktorLives utility through several applications, including microcontroller-based stimulus delivery for location-dependent manipulations; conditional video recording that activates only during events of interest; kinematic-based response triggering using real-time velocity computations; and multi-cassette experimental designs combining multiple functionalities. Detailed tutorials are provided to familiarize users with TracktorLives operation and functionality, and a growing library of cassettes supports diverse applications for processing both real-time and pre-recorded video. We validated the software by comparing its response timing to human experimenters in a stimulus delivery task involving two fish species, where TracktorLive demonstrated consistently higher accuracy and lower variability, particularly for fast-moving subjects. Beyond experimental biology, TracktorLives unique architecture and versatility could support many different applications in fields ranging from neuroscience to wildlife management. As an open-source software combining accessibility, modularity, and computational efficiency, TracktorLive can help democratize real-time tracking and automated response systems across disciplines.

Explore related subjects

animal behavior and cognitionPreprint

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Minasandra, P., Sridhar, V. H., Roche, D. G., Planas-Sitja, I.. 2026-03-16. TracktorLive: an integrated real-time object tracking and response system. https://doi.org/10.64898/2026.03.12.711471

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

Behavioral divergence across replicated predation regimes is species-specific in two sympatric poeciliid fishes

Predation is a potent driver of behavioral divergence across prey populations, yet whether shared predation regimes generate similar responses in coexisting prey species remains unclear. Species differences in reproductive and foraging traits may alter vulnerability to predators, generating species-specific responses. We compared behavior and cognition of two poeciliid fishes (Gambusia affinis and Poecilia latipinna) that differ in body size, the presence of male ornamentation, and mating tactics. We sampled both species across replicate high- and low-predation regimes and measured exploration, shyness, boldness, social motivation, and detour solve latency (N = 509). Multivariate behavior and cognition differed between predation regimes, and the magnitude of divergence varied with species but not body size. Consistent with the multivariate pattern, the more conspicuous P. latipinna exhibited higher boldness and overall lower exploration under high-predation, while high- and low-predation populations of G. affinis did not differ. These findings suggest either that the more conspicuous species experiences greater predation risk or that the less conspicuous species reduces its predation risk through alternative phenotypic responses. More broadly, species differences in reproductive phenotypes associated with sexual selection may help explain why shared predation regimes generate variable patterns of behavioral divergence across taxa.

animal behavior and cognition↗
bioRxiv2026

Capturing the rhythm: methodological choices shape inference from circadian activity data

Abstract 1. Statistical tools and analytical decisions for analysing animal activity data are often limited and poorly justified, particularly with respect to model choice, sampling design and temporal aggregation. These shortcomings can constrain our ability to draw accurate and biologically meaningful inferences about behaviour. 2. We interrogated 24 h activity data taken from individual males and females derived from five Drosophila melanogaster populations to generate a general framework for collecting and analysing activity data that systematically compares common model classes, continuous verses fragmented sampling strategies, and alternative temporal aggregation choices (time-bin sizes). 3. Our analyses identified generalised additive mixed models (GAMMs) applied to high-frequency continuous data with small-moderate bin sizes (1-5 minutes) as providing the most robust and interpretable inference for our complex, high-frequency activity data. 4. However, our interrogation of the data set confirmed that analytical and sampling decisions need to be tailored to the study species, the timing of activities and the nature of the behaviour of interest. Accordingly, polynomial and cosinor generalised linear models, increased but biologically targeted snapshot sampling, and bin sizes smaller than one hour yielded adequate analyses with similar biological conclusions when appropriately matched to the system. 5. Our approach provides an accessible decision-making framework for activity analyses that allows researchers across behavioural, ecological and evolutionary studies to justify and optimise choices about data collection and modelling. Such an approach improves the biological relevance of inference and supporting the use of modern tracking and analytical technologies.

animal behavior and cognition↗
bioRxiv2026

Greylag geese (Anser anser) initiate group flight based on the number and identities of callers

Social animals need to maintain cohesion when they move, and movement decisions are influenced by social organization and ecological or individual needs. To maintain synchrony during collective movement, the use of signals, including vocal signals, is often necessary. Greylag geese are gregarious and vocal before and during flight. We observed instances of naturally occurring flight initiation attempts in a free-living population of greylag geese -n = 133 birds- to investigate the decision-making process in this species, including the role vocalisations play in flight decisions. We recorded the number of participants in flight-initiation attempts, their vocal behaviour -using two call types specific to flight initiation signalling: Locomotion and Pre-flight calls-, the outcome of those attempts, in addition to the resulting flying group size and composition. We found that the identities and number of flock members joining in the calling chorus predicted both the probability of successful flight and the resulting flying group size. The number of Locomotion callers was associated with an increased probability of success, as well as larger flying group size, including both family and non-family fliers. The number of Pre-flight callers was also associated with a higher probability of successful flight, but its effect on the increase in flying group size was marginal. Successful departures were more probable when the family members of the initiator responded vocally. Overall, our findings are consistent with a system where the decision to fly is made individually using two distinct vocal signals to estimate the number of voters and at least the identities of social partners and progeny. In species where temporal and spatial group cohesion varies both seasonally and diurnally, individuals priorities appear to be maintaining proximity to mates and family members, followed by maximizing the size of flight groups.

animal behavior and cognition↗