TOMB-AI: Automated Behavior Recognition
Automatically Score ANY Behavior
Two Parts of the Problem
Behavioural scoring is fundamental to many studies. However, current methods of behavioural analysis are insufficient for many researchers.
1. Manual Scoring
Most behavior scoring is performed manually, this method is:
-
Performing manual scoring with precision can be extremely time-intensive, typically taking three to ten times longer than the video’s actual duration.
-
The lengthy process of manual scoring makes it prone to human error, which can lead to inconsistent and unreliable results.
-
Since scorers define behaviors differently and scoring is often unreliable, two markers rarely produce the same results, even within the same lab.
2. Current Automation Tools
Open source and commercial solutions suffer from several limitations:
-
Most tools for automating behavior scoring can recognize only a limited set of highly specific behaviors. This is primarily due to design limitations, such as reliance on key-point–based methods.
-
Many existing tools rely primarily on pose estimation to assess behavior but cannot capture temporal or spatial dynamics. Consequently, they are unsuitable for tasks that require contextual understanding, such as novel object interactions or interactions with robotic beetles.
-
Many tools can’t easily handle set-up changes. Some only work with their own branded arenas, while others require time-consuming retraining every time the task changes.
TOMB-AI: Behavioral Recognition
Our behavior recognition uses custom AI models that learn to score how you do from minimal training data.
How does it work?
Learns From Annotated Videos
Our AI learns from videos that clients have scored for behaviors of interest, noting when behavioral events begin and end.
Minimal Training Data Required
We pretrained on large-scale human action datasets, which greatly reduces the amount of data needed for adaptation to new domains. As a result, using only 5 to 10 short videos (around five minutes each) is sufficient to establish a strong baseline model that can then be further fine-tuned for optimal performance.
What do we do differently?
Any behavior that a human observer can consistently score from the video footage can also be learned by the AI.
Recognition of Any Behavior
Our AI model integrates both spatial and temporal context to interpret behavior with exceptional accuracy. It easily identifies traditional egocentric actions, while also recognizing more complex behaviors that involve interaction with the environment e.g. novel object interaction, freezing.
Context Aware Recognition
TOMB-AI is incredibly flexible, adapting to any setup or task. New elements are easily added to the training set, and retraining takes us only a few hours.
Flexible
We have successfully trained numerous behaviors:
This list is not fixed and will be continuously updated. We offer free demos to showcase how TOMB-AI can recognize these behaviors, or entirely new ones, in your data.
Allo-grooming
Social interaction
Social approach
Mating
Sniffing
Aggression
Social play
Grooming
Eating
NOR
Drinking
Rearing
Shaking
Freezing
Learn More:
Any reliably scorable behavior can be detected with our AI, see our list of trained behaviors above.
We design private, tailor-made behavior recognition models for each collaborator.
Explore key metrics like total and cumulative behavior durations, event frequencies per behavior, and behavioral sequences using raster plots.
Eliminates the need for physical markers, minimizing stress and aligning with 3R principles.
Our behavior recognition analysis goes as fast as 1/10th the total video duration.
Accurate timestamps indicating the start and end of each behavioral episode, along with their respective durations.
Integrate TOMB-AI with other analysis modules such as our Fiber Photometry Analyzer (FPA) to segment data with ease.
Get In Touch.
To find out more about our products and services please contact us at info@metofico.com, via social media or fill out the form.
We offer free demos and trials of our software, allowing you to explore how our solutions can enhance your specific research or operational goals.