Mix-GENEO: A Flexible Filtration for Multiparameter Persistent Homology Detects Digital Images
- URL: http://arxiv.org/abs/2401.04332v3
- Date: Wed, 27 Nov 2024 06:22:59 GMT
- Title: Mix-GENEO: A Flexible Filtration for Multiparameter Persistent Homology Detects Digital Images
- Authors: Jiaxing He, Bingzhe Hou, Tieru Wu, Yue Xin,
- Abstract summary: Two important tasks in the field of Topological Data Analysis are building practical multifiltrations on objects and using TDA to detect the geometry.<n>Motivated by the tasks, we build multiparameter filtrations by operators on images named multi-GENEO, multi-DGENEO and mix-GENEO.<n>In practical applications, we regard image as a discrete function space, and then we build multifiltrations on the discrete function space.
- Score: 0.8437187555622164
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Two important tasks in the field of Topological Data Analysis are building practical multifiltrations on objects and using TDA to detect the geometry. Motivated by the tasks, we build multiparameter filtrations by operators on images named multi-GENEO, multi-DGENEO and mix-GENEO, and we prove the stability of both the interleaving distance and multiparameter persistence landscape of multi-GENEO with respect to the pseudometric on bounded functions. We also give the estimations of upper bound for multi-DGENEO and mix-GENEO. In practical applications, we regard image as a discrete function space, and then we build multifiltrations on the discrete function space. Finally, we construct comparable experiment on MNIST dataset to demonstrate our bifiltrations are superior to 1-parameter filtrations including lower-star filtration and upper-star filtration. For instance, 6 and 9 can be distinguished by our bifiltrations, while they cannot be distinguished by 1-parameter filtrations. The experiment results demonstrate our bifiltrations have ability to detect geometric and topological differences of digital images.
Related papers
- G-LoG Bi-filtration for Medical Image Classification [16.162636980856423]
We use the Laplacian of Gaussian operator to enhance the boundaries of medical images.<n>By modeling volumetric images as bounded functions, we prove the interleaving distance on the persistence modules is stable.<n>We conduct experiments on the MedMNIST dataset.
arXiv Detail & Related papers (2026-02-20T16:35:24Z) - PFDepth: Heterogeneous Pinhole-Fisheye Joint Depth Estimation via Distortion-aware Gaussian-Splatted Volumetric Fusion [61.6340987158734]
We present the first pinhole-fisheye framework for heterogeneous multi-view depth estimation, PFDepth.<n> PFDepth employs a unified architecture capable of processing arbitrary combinations of pinhole and fisheye cameras with varied intrinsics and extrinsics.<n>We show that PFDepth sets a state-of-the-art performance on KITTI-360 and RealHet datasets over current mainstream depth networks.
arXiv Detail & Related papers (2025-09-30T09:38:59Z) - Adaptive Stereo Depth Estimation with Multi-Spectral Images Across All Lighting Conditions [58.88917836512819]
We propose a novel framework incorporating stereo depth estimation to enforce accurate geometric constraints.
To mitigate the effects of poor lighting on stereo matching, we introduce Degradation Masking.
Our method achieves state-of-the-art (SOTA) performance on the Multi-Spectral Stereo (MS2) dataset.
arXiv Detail & Related papers (2024-11-06T03:30:46Z) - Spec-NeRF: Multi-spectral Neural Radiance Fields [9.242830798112855]
We propose Multi-spectral Neural Radiance Fields(Spec-NeRF) for jointly reconstructing a multispectral radiance field and spectral sensitivity functions(SSFs) of the camera from a set of color images filtered by different filters.
Our experiments on both synthetic and real scenario datasets demonstrate that utilizing filtered RGB images with learnable NeRF and SSFs can achieve high fidelity and promising spectral reconstruction.
arXiv Detail & Related papers (2023-09-14T16:17:55Z) - Decomposed Guided Dynamic Filters for Efficient RGB-Guided Depth
Completion [46.04264366475848]
RGB-guided depth completion aims at predicting dense depth maps from sparse depth measurements and corresponding RGB images.
Guided dynamic filters generate spatially-variant depth-wise separable convolutional filters from RGB features to guide depth features.
We propose to decompose the guided dynamic filters into a spatially-shared component multiplied by content-adaptive adaptors at each spatial location.
arXiv Detail & Related papers (2023-09-05T08:37:58Z) - Multispectral Quantitative Phase Imaging Using a Diffractive Optical
Network [0.0]
We present the design of a diffractive processor that can all-optically perform multispectral quantitative phase imaging of transparent phase-only objects in a snapshot.
Our design utilizes spatially engineered diffractive layers, optimized through deep learning, to encode the phase profile of the input object.
These diffractive multispectral processors maintain uniform performance across all the wavelength channels, revealing a decent QPI performance at each target wavelength.
arXiv Detail & Related papers (2023-08-05T21:13:25Z) - Polarization Multi-Image Synthesis with Birefringent Metasurfaces [3.2428991403246834]
We introduce a new system that uses a birefringent metasurface with a polarizer-mosaicked photosensor to capture four optically-coded measurements in a single exposure.
We apply this system to the task of incoherent opto-electronic filtering, where digital spatial-filtering operations are replaced by simpler, per-pixel sums.
arXiv Detail & Related papers (2023-07-16T17:14:39Z) - A2S-NAS: Asymmetric Spectral-Spatial Neural Architecture Search For
Hyperspectral Image Classification [5.0789200970424035]
We propose a multi-stage search architecture to overcome asymmetric spectral-spatial dimensions and capture significant features.
First, the asymmetric pooling on the spectral-spatial dimension maximally retains the essential features of HSI.
Then, the 3D convolution with a selectable range of receptive fields overcomes the constraints of fixed-sized convolution kernels.
arXiv Detail & Related papers (2023-02-23T09:15:14Z) - Deep Diversity-Enhanced Feature Representation of Hyperspectral Images [87.47202258194719]
We rectify 3D convolution by modifying its topology to enhance the rank upper-bound.
We also propose a novel diversity-aware regularization (DA-Reg) term that acts on the feature maps to maximize independence among elements.
To demonstrate the superiority of the proposed Re$3$-ConvSet and DA-Reg, we apply them to various HS image processing and analysis tasks.
arXiv Detail & Related papers (2023-01-15T16:19:18Z) - Exploring Disordered Quantum Spin Models with a Multi-Layer
Multi-Configurational Approach [0.0]
We employ a numerical technique referred to as multi-layer multi-configuration time-dependent Hartree (ML-MCTDH) to evaluate the ground state of several disordered spin models.
We exploit the inherent flexibility of the method to present results in one and two spatial dimensions and treat challenging setups that incorporate long-range interactions as well as disorder.
arXiv Detail & Related papers (2022-12-05T13:26:41Z) - Affinity Feature Strengthening for Accurate, Complete and Robust Vessel
Segmentation [48.638327652506284]
Vessel segmentation is crucial in many medical image applications, such as detecting coronary stenoses, retinal vessel diseases and brain aneurysms.
We present a novel approach, the affinity feature strengthening network (AFN), which jointly models geometry and refines pixel-wise segmentation features using a contrast-insensitive, multiscale affinity approach.
arXiv Detail & Related papers (2022-11-12T05:39:17Z) - Joint Learning of Salient Object Detection, Depth Estimation and Contour
Extraction [91.43066633305662]
We propose a novel multi-task and multi-modal filtered transformer (MMFT) network for RGB-D salient object detection (SOD)
Specifically, we unify three complementary tasks: depth estimation, salient object detection and contour estimation. The multi-task mechanism promotes the model to learn the task-aware features from the auxiliary tasks.
Experiments show that it not only significantly surpasses the depth-based RGB-D SOD methods on multiple datasets, but also precisely predicts a high-quality depth map and salient contour at the same time.
arXiv Detail & Related papers (2022-03-09T17:20:18Z) - Extending the Unmixing methods to Multispectral Images [2.40297985932927]
The research concerning the unmixing of multispectral images is relatively scarce.
We have created two simulated multispectral datasets from two hyperspectral datasets whose ground truths are given.
By comparing and analyzing the results, we have been able to demonstrate some interesting results for the utilization of VCA, NMF, and N-FINDR with multispectral datasets.
arXiv Detail & Related papers (2021-11-23T14:10:36Z) - Interaction-free imaging of multi-pixel objects [58.720142291102135]
Quantum imaging is well-suited to study sensitive samples which require low-light conditions, like biological tissues.
In this context, interaction-free measurements (IFM) allow us infer the presence of an opaque object without the photon interacting with the sample.
Here we extend the IFM imaging schemes to multi-pixel, semi-transparent objects, by encoding the information about the pixels into an internal degree of freedom.
arXiv Detail & Related papers (2021-06-08T06:49:19Z) - A Multiscale Graph Convolutional Network for Change Detection in
Homogeneous and Heterogeneous Remote Sensing Images [12.823633963080281]
Change detection (CD) in remote sensing images has been an ever-expanding area of research.
In this paper, a novel CD method based on the graph convolutional network (GCN) and multiscale object-based technique is proposed for both homogeneous and heterogeneous images.
arXiv Detail & Related papers (2021-02-16T09:26:31Z) - Spectrally multimode integrated SU(1,1) interferometer [50.591267188664666]
The presented interferometer includes a polarization converter between two photon sources and utilizes a continuous-wave (CW) pump.
We show that this configuration results in almost perfect destructive interference at the output and supersensitivity regions below the classical limit.
arXiv Detail & Related papers (2020-12-07T14:42:54Z) - Semantic Change Detection with Asymmetric Siamese Networks [71.28665116793138]
Given two aerial images, semantic change detection aims to locate the land-cover variations and identify their change types with pixel-wise boundaries.
This problem is vital in many earth vision related tasks, such as precise urban planning and natural resource management.
We present an asymmetric siamese network (ASN) to locate and identify semantic changes through feature pairs obtained from modules of widely different structures.
arXiv Detail & Related papers (2020-10-12T13:26:30Z) - Single-shot Hyperspectral-Depth Imaging with Learned Diffractive Optics [72.9038524082252]
We propose a compact single-shot monocular hyperspectral-depth (HS-D) imaging method.
Our method uses a diffractive optical element (DOE), the point spread function of which changes with respect to both depth and spectrum.
To facilitate learning the DOE, we present a first HS-D dataset by building a benchtop HS-D imager.
arXiv Detail & Related papers (2020-09-01T14:19:35Z) - Hyperspectral-Multispectral Image Fusion with Weighted LASSO [68.04032419397677]
We propose an approach for fusing hyperspectral and multispectral images to provide high-quality hyperspectral output.
We demonstrate that the proposed sparse fusion and reconstruction provides quantitatively superior results when compared to existing methods on publicly available images.
arXiv Detail & Related papers (2020-03-15T23:07:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.