Bitbox: Behavioral Imaging Toolbox for Computational Analysis of Behavior from Videos

• URL: http://arxiv.org/abs/2512.17655v1
• Date: Fri, 19 Dec 2025 14:53:42 GMT
• Title: Bitbox: Behavioral Imaging Toolbox for Computational Analysis of Behavior from Videos
• Authors: Evangelos Sariyanidi, Gokul Nair, Lisa Yankowitz, Casey J. Zampella, Mohan Kashyap Pargi, Aashvi Manakiwala, Maya McNealis, John D. Herrington, Jeffrey Cohn, Robert T. Schultz, Birkan Tunc,
• Abstract summary: Computational measurement of human behavior from video has recently become feasible due to major advances in AI.<n> Bitbox is an open-source toolkit designed to make advanced computational analysis directly usable by behavioral scientists and clinical researchers.<n>It provides a standardized interface for extracting high-level behavioral measurements from video, leveraging multiple face, head, and body processors.
• Score: 3.215663456741252
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Computational measurement of human behavior from video has recently become feasible due to major advances in AI. These advances now enable granular and precise quantification of facial expression, head movement, body action, and other behavioral modalities and are increasingly used in psychology, psychiatry, neuroscience, and mental health research. However, mainstream adoption remains slow. Most existing methods and software are developed for engineering audiences, require specialized software stacks, and fail to provide behavioral measurements at a level directly useful for hypothesis-driven research. As a result, there is a large barrier to entry for researchers who wish to use modern, AI-based tools in their work. We introduce Bitbox, an open-source toolkit designed to remove this barrier and make advanced computational analysis directly usable by behavioral scientists and clinical researchers. Bitbox is guided by principles of reproducibility, modularity, and interpretability. It provides a standardized interface for extracting high-level behavioral measurements from video, leveraging multiple face, head, and body processors. The core modules have been tested and validated on clinical samples and are designed so that new measures can be added with minimal effort. Bitbox is intended to serve both sides of the translational gap. It gives behavioral researchers access to robust, high-level behavioral metrics without requiring engineering expertise, and it provides computer scientists a practical mechanism for disseminating methods to domains where their impact is most needed. We expect that Bitbox will accelerate integration of computational behavioral measurement into behavioral, clinical, and mental health research. Bitbox has been designed from the beginning as a community-driven effort that will evolve through contributions from both method developers and domain scientists.

Related papers

• Position: Intelligent Science Laboratory Requires the Integration of Cognitive and Embodied AI [98.19195693735487]
  We propose the paradigm of Intelligent Science Laboratories (ISLs)<n>ISLs are a multi-layered, closed-loop framework that deeply integrates cognitive and embodied intelligence.<n>We argue that such systems are essential for overcoming the current limitations of scientific discovery.
  arXiv  Detail & Related papers  (2025-06-24T13:31:44Z)
• A Review of Neuroscience-Inspired Machine Learning [58.72729525961739]
  Bio-plausible credit assignment is compatible with practically any learning condition and is energy-efficient. In this paper, we survey several vital algorithms that model bio-plausible rules of credit assignment in artificial neural networks. We conclude by discussing the future challenges that will need to be addressed in order to make such algorithms more useful in practical applications.
  arXiv  Detail & Related papers  (2024-02-16T18:05:09Z)
• Computer Vision for Primate Behavior Analysis in the Wild [61.08941894580172]
  Video-based behavioral monitoring has great potential for transforming how we study animal cognition and behavior. There is still a fairly large gap between the exciting prospects and what can actually be achieved in practice today.
  arXiv  Detail & Related papers  (2024-01-29T18:59:56Z)
• Brain-inspired Computational Intelligence via Predictive Coding [73.42407863671565]
  Predictive coding (PC) has shown promising properties that make it potentially valuable for the machine learning community.<n>PC-like algorithms are starting to be present in multiple sub-fields of machine learning and AI at large.
  arXiv  Detail & Related papers  (2023-08-15T16:37:16Z)
• Behavior quantification as the missing link between fields: Tools for digital psychiatry and their role in the future of neurobiology [0.0]
  Current technologies are an exciting opportunity to improve behavioral characterization. New capabilities for continuous collection of passive sensor streams, such as phone GPS or smartwatch accelerometers, open avenues of novel questioning. There is huge potential in what can theoretically be captured by current technologies, but this in itself presents a large computational challenge.
  arXiv  Detail & Related papers  (2023-05-24T17:45:10Z)
• Machine Psychology [54.287802134327485]
  We argue that a fruitful direction for research is engaging large language models in behavioral experiments inspired by psychology. We highlight theoretical perspectives, experimental paradigms, and computational analysis techniques that this approach brings to the table. It paves the way for a "machine psychology" for generative artificial intelligence (AI) that goes beyond performance benchmarks.
  arXiv  Detail & Related papers  (2023-03-24T13:24:41Z)
• CNN-Based Action Recognition and Pose Estimation for Classifying Animal Behavior from Videos: A Survey [0.0]
  Action recognition, classifying activities performed by one or more subjects in a trimmed video, forms the basis of many techniques. Deep learning models for human action recognition have progressed over the last decade. Recent interest in research that incorporates deep learning-based action recognition for classification has increased.
  arXiv  Detail & Related papers  (2023-01-15T20:54:44Z)
• A Rubric for Human-like Agents and NeuroAI [2.749726993052939]
  Contributed research ranges widely from mimicking behaviour to testing machine learning methods. It cannot be assumed nor expected that progress on one of these three goals will automatically translate to progress in others. This is clarified using examples of weak and strong neuroAI and human-like agents.
  arXiv  Detail & Related papers  (2022-12-08T16:59:40Z)
• Open-Source Tools for Behavioral Video Analysis: Setup, Methods, and Development [2.248500763940652]
  Methods for video analysis are transforming behavioral quantification to be more precise, scalable, and reproducible. Open-source tools for video analysis have led to new experimental approaches to understand behavior. We review currently available open source tools for video analysis, how to set them up in a lab that is new to video recording methods, and some issues that should be addressed.
  arXiv  Detail & Related papers  (2022-04-06T14:06:43Z)
• Information theoretic analysis of computational models as a tool to understand the neural basis of behaviors [0.0]
  One of the greatest research challenges of this century is to understand the neural basis for how behavior emerges in brain-body-environment systems. Computational models provide an alternative framework within which one can study model systems. I provide an introduction, a review and discussion to make a case for how information theoretic analysis of computational models is a potent research methodology.
  arXiv  Detail & Related papers  (2021-06-02T02:08:18Z)
• AGENT: A Benchmark for Core Psychological Reasoning [60.35621718321559]
  Intuitive psychology is the ability to reason about hidden mental variables that drive observable actions. Despite recent interest in machine agents that reason about other agents, it is not clear if such agents learn or hold the core psychology principles that drive human reasoning. We present a benchmark consisting of procedurally generated 3D animations, AGENT, structured around four scenarios.
  arXiv  Detail & Related papers  (2021-02-24T14:58:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.