Seeing Through Smoke: Surgical Desmoking for Improved Visual Perception

• URL: http://arxiv.org/abs/2603.25867v1
• Date: Thu, 26 Mar 2026 19:49:49 GMT
• Title: Seeing Through Smoke: Surgical Desmoking for Improved Visual Perception
• Abstract summary: Minimally invasive and robot-assisted surgery relies heavily on endoscopic imaging.<n>We present a transformer-based surgical desmoking model with a physics-inspired desmoking head that jointly predicts smoke-free image and corresponding smoke map.
• Score: 8.788053679150911
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Minimally invasive and robot-assisted surgery relies heavily on endoscopic imaging, yet surgical smoke produced by electrocautery and vessel-sealing instruments can severely degrade visual perception and hinder vision-based functionalities. We present a transformer-based surgical desmoking model with a physics-inspired desmoking head that jointly predicts smoke-free image and corresponding smoke map. To address the scarcity of paired smoky-to-smoke-free training data, we develop a synthetic data generation pipeline that blends artificial smoke patterns with real endoscopic images, yielding over 80,000 paired samples for supervised training. We further curate, to our knowledge, the largest paired surgical smoke dataset to date, comprising 5,817 image pairs captured with the da Vinci robotic surgical system, enabling benchmarking on high-resolution endoscopic images. Extensive experiments on both a public benchmark and our dataset demonstrate state-of-the-art performance in image reconstruction compared to existing dehazing and desmoking approaches. We also assess the impact of desmoking on downstream stereo depth estimation and instrument segmentation, highlighting both the potential benefits and current limitations of digital smoke removal methods.

Related papers

• Laparoscopic Image Desmoking Using the U-Net with New Loss Function and Integrated Differentiable Wiener Filter [5.747172898125006]
  Laparoscopic surgeries often suffer from reduced visual clarity due to the presence of surgical smoke originated by surgical instruments.<n>In order to remove the surgical smoke, a novel U-Net deep learning with new loss function and integrated differentiable Wiener filter (ULW) method is presented.<n> Experimental results show that the proposed ULW method excels in both visual clarity and metric-based evaluation.
  arXiv  Detail & Related papers  (2025-05-27T18:07:06Z)
• Ultrasound Lung Aeration Map via Physics-Aware Neural Operators [78.6077820217471]
  Lung ultrasound is a growing modality in clinics for diagnosing acute and chronic lung diseases.<n>It is complicated by complex reverberations from the pleural interface caused by the inability of ultrasound to penetrate air.<n>We propose LUNA, an AI model that directly reconstructs lung aeration maps from RF data.
  arXiv  Detail & Related papers  (2025-01-02T09:24:34Z)
• LSD3K: A Benchmark for Smoke Removal from Laparoscopic Surgery Images [0.7138611948315257]
  Smoke generated by surgical instruments during laparoscopic surgery can obscure the visual field, impairing surgeons' ability to perform operations accurately and safely. Despite laparoscopic image desmoking has attracted the attention of researchers in recent years, the lack of publicly available high-quality benchmark datasets is the main bottleneck to hamper the development progress of this task. We construct a new high-quality dataset for Laparoscopic Surgery image Desmoking, named LSD3K, consisting of 3,000 paired synthetic non-homogeneous smoke images.
  arXiv  Detail & Related papers  (2024-07-18T03:42:16Z)
• Attention-Aware Laparoscopic Image Desmoking Network with Lightness Embedding and Hybrid Guided Embedding [9.909043664967063]
  A two-stage network is proposed to estimate the smoke distribution and reconstruct a clear, smoke-free surgical scene. The proposed method boasts a Peak Signal to Noise Ratio that is $2.79%$ higher than the state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-04-11T08:36:36Z)
• CathFlow: Self-Supervised Segmentation of Catheters in Interventional Ultrasound Using Optical Flow and Transformers [66.15847237150909]
  We introduce a self-supervised deep learning architecture to segment catheters in longitudinal ultrasound images. The network architecture builds upon AiAReSeg, a segmentation transformer built with the Attention in Attention mechanism. We validated our model on a test dataset, consisting of unseen synthetic data and images collected from silicon aorta phantoms.
  arXiv  Detail & Related papers  (2024-03-21T15:13:36Z)
• Self-Supervised Video Desmoking for Laparoscopic Surgery [48.83900673665993]
  We introduce self-supervised surgery video desmoking (SelfSVD) We observe that the frame captured before the activation of high-energy devices is generally clear (named pre-smoke frame, PS frame) We further feed the valuable information from PS frame into models, where a masking strategy and a regularization term are presented to avoid trivial solutions.
  arXiv  Detail & Related papers  (2024-03-17T12:38:58Z)
• AiAReSeg: Catheter Detection and Segmentation in Interventional Ultrasound using Transformers [75.20925220246689]
  endovascular surgeries are performed using the golden standard of Fluoroscopy, which uses ionising radiation to visualise catheters and vasculature. This work proposes a solution using an adaptation of a state-of-the-art machine learning transformer architecture to detect and segment catheters in axial interventional Ultrasound image sequences.
  arXiv  Detail & Related papers  (2023-09-25T19:34:12Z)
• Adversarial Domain Feature Adaptation for Bronchoscopic Depth Estimation [111.89519571205778]
  In this work, we propose an alternative domain-adaptive approach to depth estimation. Our novel two-step structure first trains a depth estimation network with labeled synthetic images in a supervised manner. The results of our experiments show that the proposed method improves the network's performance on real images by a considerable margin.
  arXiv  Detail & Related papers  (2021-09-24T08:11:34Z)
• Desmoking laparoscopy surgery images using an image-to-image translation guided by an embedded dark channel [3.1706553206969916]
  In laparoscopic surgery, the visibility in the image can be severely degraded by the smoke caused by the $CO$ injection, and dissection tools. In this paper, a novel computational approach to remove the smoke effects is introduced. The proposed method is based on an image-to-image conditional generative adversarial network in which a dark channel is used as an embedded guide mask.
  arXiv  Detail & Related papers  (2020-04-19T19:51:24Z)
• FD-GAN: Generative Adversarial Networks with Fusion-discriminator for Single Image Dehazing [48.65974971543703]
  We propose a fully end-to-end Generative Adversarial Networks with Fusion-discriminator (FD-GAN) for image dehazing. Our model can generator more natural and realistic dehazed images with less color distortion and fewer artifacts. Experiments have shown that our method reaches state-of-the-art performance on both public synthetic datasets and real-world images.
  arXiv  Detail & Related papers  (2020-01-20T04:36:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.