Outlier galaxy images in the Dark Energy Survey and their identification
with unsupervised machine learning
- URL: http://arxiv.org/abs/2305.01720v1
- Date: Tue, 2 May 2023 18:39:35 GMT
- Title: Outlier galaxy images in the Dark Energy Survey and their identification
with unsupervised machine learning
- Authors: Lior Shamir
- Abstract summary: This study applies an automatic method for automatic detection of outlier objects in the first data release of the Dark Energy Survey.
An important feature of the algorithm is that it allows to control the false-positive rate, and therefore can be used for practical outlier detection.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The Dark Energy Survey is able to collect image data of an extremely large
number of extragalactic objects, and it can be reasonably assumed that many
unusual objects of high scientific interest are hidden inside these data. Due
to the extreme size of DES data, identifying these objects among many millions
of other celestial objects is a challenging task. The problem of outlier
detection is further magnified by the presence of noisy or saturated images.
When the number of tested objects is extremely high, even a small rate of noise
or false positives leads to a very large number of false detections, making an
automatic system impractical. This study applies an automatic method for
automatic detection of outlier objects in the first data release of the Dark
Energy Survey. By using machine learning-based outlier detection, the algorithm
is able to identify objects that are visually different from the majority of
the other objects in the database. An important feature of the algorithm is
that it allows to control the false-positive rate, and therefore can be used
for practical outlier detection. The algorithm does not provide perfect
accuracy in the detection of outlier objects, but it reduces the data
substantially to allow practical outlier detection. For instance, the selection
of the top 250 objects after applying the algorithm to more than $2\cdot10^6$
DES images provides a collection of uncommon galaxies. Such collection would
have been extremely time-consuming to compile by using manual inspection of the
data.
Related papers
- Bayesian Detector Combination for Object Detection with Crowdsourced Annotations [49.43709660948812]
Acquiring fine-grained object detection annotations in unconstrained images is time-consuming, expensive, and prone to noise.
We propose a novel Bayesian Detector Combination (BDC) framework to more effectively train object detectors with noisy crowdsourced annotations.
BDC is model-agnostic, requires no prior knowledge of the annotators' skill level, and seamlessly integrates with existing object detection models.
arXiv Detail & Related papers (2024-07-10T18:00:54Z) - Object criticality for safer navigation [1.565361244756411]
Given an object detector, filtering objects based on their relevance, reduces the risk of missing relevant objects, decreases the likelihood of dangerous trajectories, and improves the quality of trajectories in general.
We show that, given an object detector, filtering objects based on their relevance, reduces the risk of missing relevant objects, decreases the likelihood of dangerous trajectories, and improves the quality of trajectories in general.
arXiv Detail & Related papers (2024-04-25T09:02:22Z) - YOLC: You Only Look Clusters for Tiny Object Detection in Aerial Images [33.80392696735718]
YOLC (You Only Look Clusters) is an efficient and effective framework that builds on an anchor-free object detector, CenterNet.
To overcome the challenges posed by large-scale images and non-uniform object distribution, we introduce a Local Scale Module (LSM) that adaptively searches cluster regions for zooming in for accurate detection.
We perform extensive experiments on two aerial image datasets, including Visdrone 2019 and UAVDT, to demonstrate the effectiveness and superiority of our proposed approach.
arXiv Detail & Related papers (2024-04-09T10:03:44Z) - SalienDet: A Saliency-based Feature Enhancement Algorithm for Object
Detection for Autonomous Driving [160.57870373052577]
We propose a saliency-based OD algorithm (SalienDet) to detect unknown objects.
Our SalienDet utilizes a saliency-based algorithm to enhance image features for object proposal generation.
We design a dataset relabeling approach to differentiate the unknown objects from all objects in training sample set to achieve Open-World Detection.
arXiv Detail & Related papers (2023-05-11T16:19:44Z) - Generalized Few-Shot 3D Object Detection of LiDAR Point Cloud for
Autonomous Driving [91.39625612027386]
We propose a novel task, called generalized few-shot 3D object detection, where we have a large amount of training data for common (base) objects, but only a few data for rare (novel) classes.
Specifically, we analyze in-depth differences between images and point clouds, and then present a practical principle for the few-shot setting in the 3D LiDAR dataset.
To solve this task, we propose an incremental fine-tuning method to extend existing 3D detection models to recognize both common and rare objects.
arXiv Detail & Related papers (2023-02-08T07:11:36Z) - Context-Aware Transfer Attacks for Object Detection [51.65308857232767]
We present a new approach to generate context-aware attacks for object detectors.
We show that by using co-occurrence of objects and their relative locations and sizes as context information, we can successfully generate targeted mis-categorization attacks.
arXiv Detail & Related papers (2021-12-06T18:26:39Z) - Towards Real-World Prohibited Item Detection: A Large-Scale X-ray
Benchmark [53.9819155669618]
This paper presents a large-scale dataset, named as PIDray, which covers various cases in real-world scenarios for prohibited item detection.
With an intensive amount of effort, our dataset contains $12$ categories of prohibited items in $47,677$ X-ray images with high-quality annotated segmentation masks and bounding boxes.
The proposed method performs favorably against the state-of-the-art methods, especially for detecting the deliberately hidden items.
arXiv Detail & Related papers (2021-08-16T11:14:16Z) - You Better Look Twice: a new perspective for designing accurate
detectors with reduced computations [56.34005280792013]
BLT-net is a new low-computation two-stage object detection architecture.
It reduces computations by separating objects from background using a very lite first-stage.
Resulting image proposals are then processed in the second-stage by a highly accurate model.
arXiv Detail & Related papers (2021-07-21T12:39:51Z) - Automatic identification of outliers in Hubble Space Telescope galaxy
images [0.0]
This paper describes an unsupervised machine learning algorithm for automatic detection of outlier galaxy images.
The application of the algorithm to a large collection of galaxies detected a variety of outlier galaxy images.
The catalogue contains 147 objects that would be very difficult to identify without using automation.
arXiv Detail & Related papers (2021-01-07T16:52:10Z) - False Detection (Positives and Negatives) in Object Detection [1.0965065178451106]
This study explores ways of reducing false positives and negatives with labelled data.
In the process also discovered insufficient labelling in Openimage 2019 Object Detection dataset.
arXiv Detail & Related papers (2020-08-16T20:09:05Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.