A Multimodal Dataset and Benchmark for Radio Galaxy and Infrared Host Detection

• URL: http://arxiv.org/abs/2312.06728v1
• Date: Mon, 11 Dec 2023 08:19:38 GMT
• Title: A Multimodal Dataset and Benchmark for Radio Galaxy and Infrared Host Detection
• Authors: Nikhel Gupta, Zeeshan Hayder, Ray P. Norris, Minh Hyunh and Lars Petersson
• Abstract summary: The dataset comprises 4,155 instances of galaxies in 2,800 images with both radio and infrared modalities. Our dataset is the first publicly accessible dataset that includes images from a highly sensitive radio telescope, infrared satellite, and instance-level annotations for their identification.
• Score: 13.944126480815553
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We present a novel multimodal dataset developed by expert astronomers to automate the detection and localisation of multi-component extended radio galaxies and their corresponding infrared hosts. The dataset comprises 4,155 instances of galaxies in 2,800 images with both radio and infrared modalities. Each instance contains information on the extended radio galaxy class, its corresponding bounding box that encompasses all of its components, pixel-level segmentation mask, and the position of its corresponding infrared host galaxy. Our dataset is the first publicly accessible dataset that includes images from a highly sensitive radio telescope, infrared satellite, and instance-level annotations for their identification. We benchmark several object detection algorithms on the dataset and propose a novel multimodal approach to identify radio galaxies and the positions of infrared hosts simultaneously.

Related papers

• Classification of compact radio sources in the Galactic plane with supervised machine learning [0.0]
  We focus on the classification of compact radio sources in the Galactic plane using both radio and infrared images as inputs. To this aim, we produced a curated dataset of 20,000 images of compact sources of different astronomical classes. The implemented tools and trained models were publicly released, and made available to the radioastronomical community for future application.
  arXiv  Detail & Related papers  (2024-02-23T09:47:42Z)
• RadioGalaxyNET: Dataset and Novel Computer Vision Algorithms for the Detection of Extended Radio Galaxies and Infrared Hosts [12.997324012222695]
  RadioGalaxyNET is a dataset of 4,155 instances of galaxies in 2,800 images with both radio and infrared channels. RadioGalaxyNET is the first dataset to include images from the highly sensitive Australian Square Kilometre Array Pathfinder radio telescope.
  arXiv  Detail & Related papers  (2023-12-01T02:54:38Z)
• Deep Learning for Morphological Identification of Extended Radio Galaxies using Weak Labels [9.857561410876682]
  We show that a weakly-supervised deep learning algorithm can achieve high accuracy in predicting pixel-level information. The algorithm is trained on weak class-level labels of radio galaxies to get class activation maps (CAMs) We show that the model achieves a mAP$_50$ of 67.5% and 76.8% for radio masks and infrared host positions.
  arXiv  Detail & Related papers  (2023-08-09T18:10:05Z)
• Object Detection in Hyperspectral Image via Unified Spectral-Spatial Feature Aggregation [55.9217962930169]
  We present S2ADet, an object detector that harnesses the rich spectral and spatial complementary information inherent in hyperspectral images. S2ADet surpasses existing state-of-the-art methods, achieving robust and reliable results.
  arXiv  Detail & Related papers  (2023-06-14T09:01:50Z)
• Advances on the classification of radio image cubes [4.443085464476228]
  Modern radio telescopes will daily generate data sets on the scale of exabytes for systems like the Square Kilometre Array (SKA) Massive data sets are a source of unknown and rare astrophysical phenomena that lead to discoveries. Recently, there has been a surge in scientific publications focusing on the use of artificial intelligence in radio astronomy.
  arXiv  Detail & Related papers  (2023-05-05T11:15:37Z)
• Semi-Supervised Domain Adaptation for Cross-Survey Galaxy Morphology Classification and Anomaly Detection [57.85347204640585]
  We develop a Universal Domain Adaptation method DeepAstroUDA. It can be applied to datasets with different types of class overlap. For the first time, we demonstrate the successful use of domain adaptation on two very different observational datasets.
  arXiv  Detail & Related papers  (2022-11-01T18:07:21Z)
• Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection [65.30079184700755]
  This study addresses the issue of fusing infrared and visible images that appear differently for object detection. Previous approaches discover commons underlying the two modalities and fuse upon the common space either by iterative optimization or deep networks. This paper proposes a bilevel optimization formulation for the joint problem of fusion and detection, and then unrolls to a target-aware Dual Adversarial Learning (TarDAL) network for fusion and a commonly used detection network.
  arXiv  Detail & Related papers  (2022-03-30T11:44:56Z)
• Multispectral Satellite Data Classification using Soft Computing Approach [5.3971200250581814]
  We propose a grid-density based clustering technique for identification of objects. We introduce an approach to classify a satellite image data using a rule induction based machine learning algorithm.
  arXiv  Detail & Related papers  (2022-03-21T17:25:09Z)
• Infrared Small-Dim Target Detection with Transformer under Complex Backgrounds [155.388487263872]
  We propose a new infrared small-dim target detection method with the transformer. We adopt the self-attention mechanism of the transformer to learn the interaction information of image features in a larger range. We also design a feature enhancement module to learn more features of small-dim targets.
  arXiv  Detail & Related papers  (2021-09-29T12:23:41Z)
• Depth Estimation from Monocular Images and Sparse Radar Data [93.70524512061318]
  In this paper, we explore the possibility of achieving a more accurate depth estimation by fusing monocular images and Radar points using a deep neural network. We find that the noise existing in Radar measurements is one of the main key reasons that prevents one from applying the existing fusion methods. The experiments are conducted on the nuScenes dataset, which is one of the first datasets which features Camera, Radar, and LiDAR recordings in diverse scenes and weather conditions.
  arXiv  Detail & Related papers  (2020-09-30T19:01:33Z)
• Drone-based RGB-Infrared Cross-Modality Vehicle Detection via Uncertainty-Aware Learning [59.19469551774703]
  Drone-based vehicle detection aims at finding the vehicle locations and categories in an aerial image. We construct a large-scale drone-based RGB-Infrared vehicle detection dataset, termed DroneVehicle. Our DroneVehicle collects 28, 439 RGB-Infrared image pairs, covering urban roads, residential areas, parking lots, and other scenarios from day to night.
  arXiv  Detail & Related papers  (2020-03-05T05:29:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.