TOMB-AI: Automated Behavior Recognition

Automatically Score ANY Behavior.

Contact Us
Tracking Pipeline

The Background

Behavioural scoring is fundamental to many studies.

However, current methods of behavioural analysis are insufficient for many researchers.

1. Manual Scoring

Most behavior scoring is performed manually, this method is:

  • Performing manual scoring with precision can be extremely time-intensive, typically taking three to ten times longer than the video’s actual duration.

  • The lengthy process of manual scoring makes it prone to human error, which can lead to inconsistent and unreliable results.

  • Since scorers define behaviors differently and scoring is often unreliable, two markers rarely produce the same results, even within the same lab.

2. Current Automation Tools

Open source and commercial solutions suffer from several limitations:

  • Most tools for automating behavior scoring can recognize only a limited set of highly specific behaviors. This is primarily due to design limitations, such as reliance on key-point–based methods.

  • Many existing tools rely primarily on pose estimation to assess behavior but cannot capture temporal or spatial dynamics. Consequently, they are unsuitable for tasks that require contextual understanding, such as novel object interactions or interactions with robotic beetles.

  • Many tools can’t easily handle set-up changes. Some only work with their own branded arenas, while others require time-consuming retraining every time the task changes.

TOMB-AI: Behavioral Recognition

Our behavior recognition uses custom AI models that learn to score how you do from minimal training data.

Graphic of four puzzle pieces, one being placed into a puzzle, on a dark background.

How does it work?

Learns From Annotated Videos

Pink circle with a white checkmark inside.

Our AI learns from videos that clients have scored for behaviors of interest, noting when behavioral events begin and end.

Minimal Training Data Required

Pink circle with a white checkmark in the center

We pretrained on large-scale human action datasets, which greatly reduces the amount of data needed for adaptation to new domains. As a result, using only 5 to 10 short videos (around five minutes each) is sufficient to establish a strong baseline model that can then be further fine-tuned for optimal performance.

A stylized digital illustration of a microchip with connected nodes on a dark blue background.

What do we do differently?

Any behavior that a human observer can consistently score from the video footage can also be learned by the AI.

Recognition of Any Behavior

Pink circle with a white check mark in the center.

Our AI models integrate both spatial and temporal context to interpret behavior with exceptional accuracy. They easily identify traditional egocentric actions, while also recognizing more complex behaviors that involve interaction with the environment e.g. novel object interaction, freezing.

Context Aware Recognition

Purple circle with a white check mark inside

TOMB-AI is incredibly flexible, adapting to any setup or task. New elements are easily added to the training set, and retraining takes us only a few hours.

Flexible

White check mark inside a purple circle.
Contact Us
Tracking Pipeline

We have successfully trained numerous behaviors:

This list is not fixed and will be continuously updated. We offer free demos to showcase how TOMB-AI can recognize these behaviors, or entirely new ones, in your data.

Two blue cartoon mice facing each other on a dark background.
Social Behaviors

  • Allo-grooming

  • Social interaction

  • Social approach

  • Mating

  • Sniffing

  • Aggression

  • Social play

A cartoon blue mouse with pink ear interiors and a purple tail on a dark background.
Individual Behaviors

  • Grooming

  • Eating

  • NOR

  • Drinking

  • Rearing

  • Shaking

  • Freezing

Learn More:

Blue cartoon mouse on dark background
Recognize ANY Behavior

Any reliably scorable behavior can be detected with our AI, see our list of trained behaviors above.

Close-up of an audio mixer with three vertical faders and circular knobs set at different levels on a dark background.
Custom AI Models

We design private, tailor-made behavior recognition models for each collaborator.

Bar graph with an upward trend line indicating growth
Key Customizable Metrics

Explore key metrics like total and cumulative behavior durations, event frequencies per behavior, and behavioral sequences using raster plots.

Illustration of a cartoon blue mouse with a red X over its stomach area, against a dark background.
Markerless & Stress Free

Eliminates the need for physical markers, minimizing stress and aligning with 3R principles.

An illustrated blue hourglass with sand flowing from the top to the bottom chamber.
Time Saving

Our behavior recognition analysis goes as fast as 1/10th the total  video duration.

Icon of a stopwatch with a check mark in the center
Detailed Timestamps

Accurate timestamps indicating the start and end of each behavioral episode, along with their respective durations.

Four puzzle pieces in blue, purple, and pink fitting together.
Module Integration

Integrate TOMB-AI with other analysis modules such as our Fiber Photometry Analyzer (FPA) to segment data with ease.

Get In Touch.

To find out more about our products and services please contact us at info@metofico.com, via social media or fill out the form.

We offer free demos and trials of our software, allowing you to explore how our solutions can enhance your specific research or operational goals.