CausalVLR: A Toolbox and Benchmark for Visual-Linguistic Causal Reasoning

• URL: http://arxiv.org/abs/2306.17462v2
• Date: Wed, 13 Dec 2023 04:28:53 GMT
• Title: CausalVLR: A Toolbox and Benchmark for Visual-Linguistic Causal Reasoning
• Authors: Yang Liu, Weixing Chen, Guanbin Li, Liang Lin
• Abstract summary: CausalVLR (Causal Visual-Linguistic Reasoning) is an open-source toolbox containing a rich set of state-of-the-art causal relation discovery and causal inference methods. These methods have been included in the toolbox with PyTorch implementations under NVIDIA computing system.
• Score: 107.81733977430517
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present CausalVLR (Causal Visual-Linguistic Reasoning), an open-source toolbox containing a rich set of state-of-the-art causal relation discovery and causal inference methods for various visual-linguistic reasoning tasks, such as VQA, image/video captioning, medical report generation, model generalization and robustness, etc. These methods have been included in the toolbox with PyTorch implementations under NVIDIA computing system. It not only includes training and inference codes, but also provides model weights. We believe this toolbox is by far the most complete visual-linguitic causal reasoning toolbox. We wish that the toolbox and benchmark could serve the growing research community by providing a flexible toolkit to re-implement existing methods and develop their own new causal reasoning methods. Code and models are available at https://github.com/HCPLab-SYSU/CausalVLR. The project is under active development by HCP-Lab's contributors and we will keep this document updated.

Related papers

• Open-CD: A Comprehensive Toolbox for Change Detection [59.79011759027916]
  Open-CD is a change detection toolbox that contains a rich set of change detection methods as well as related components and modules. It gradually evolves into a unified platform that covers many popular change detection methods and contemporary modules.
  arXiv  Detail & Related papers  (2024-07-22T01:04:16Z)
• VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Models [89.63342806812413]
  We present an open-source toolkit for evaluating large multi-modality models based on PyTorch. VLMEvalKit implements over 70 different large multi-modality models, including both proprietary APIs and open-source models. We host OpenVLM Leaderboard to track the progress of multi-modality learning research.
  arXiv  Detail & Related papers  (2024-07-16T13:06:15Z)
• On the Integration of Spectrum-Based Fault Localization Tools into IDEs [1.641101482398716]
  SBFL is popular among researchers because it is lightweight and easy to implement. There is a lot of potential in it when it comes to research that aims to improve its effectiveness. Only a handful of research prototypes are available.
  arXiv  Detail & Related papers  (2024-03-18T07:43:31Z)
• ControlLLM: Augment Language Models with Tools by Searching on Graphs [97.62758830255002]
  We present ControlLLM, a novel framework that enables large language models (LLMs) to utilize multi-modal tools for solving real-world tasks. Our framework comprises three key components: (1) a textittask decomposer that breaks down a complex task into clear subtasks with well-defined inputs and outputs; (2) a textitThoughts-on-Graph (ToG) paradigm that searches the optimal solution path on a pre-built tool graph; and (3) an textitexecution engine with a rich toolbox that interprets the solution path and runs the
  arXiv  Detail & Related papers  (2023-10-26T21:57:21Z)
• Towards Fair and Comprehensive Comparisons for Image-Based 3D Object Detection [73.32210225999056]
  We build a module-designed and formulate unified training standards for 3D object detection. We also design an error diagnosis toolbox to measure the detailed characterization of detection models.
  arXiv  Detail & Related papers  (2023-10-09T06:43:48Z)
• PyRCA: A Library for Metric-based Root Cause Analysis [66.72542200701807]
  PyRCA is an open-source machine learning library of Root Cause Analysis (RCA) for Artificial Intelligence for IT Operations (AIOps) It provides a holistic framework to uncover the complicated metric causal dependencies and automatically locate root causes of incidents.
  arXiv  Detail & Related papers  (2023-06-20T09:55:10Z)
• PiML Toolbox for Interpretable Machine Learning Model Development and Diagnostics [10.635578367440162]
  PiML is an integrated and open-access Python toolbox for interpretable machine learning model development and model diagnostics. It is designed with machine learning in both low-code and high-code modes, including data pipeline, model training and tuning, model interpretation and explanation.
  arXiv  Detail & Related papers  (2023-05-07T08:19:07Z)
• Interactive Visualization for Debugging RL [11.6341132172284]
  Our system addresses many features missing from previous tools such as tools for supervised learning often are not interactive. We provide an example workflow of how this system could be used, along with ideas for future extensions.
  arXiv  Detail & Related papers  (2020-08-14T15:28:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.