Arthroscopic Multi-Spectral Scene Segmentation Using Deep Learning

• URL: http://arxiv.org/abs/2103.02465v1
• Date: Wed, 3 Mar 2021 15:23:04 GMT
• Title: Arthroscopic Multi-Spectral Scene Segmentation Using Deep Learning
• Abstract summary: Knee arthroscopy is a minimally invasive surgical (MIS) procedure which is performed to treat knee-joint ailment. Lack of visual information of the surgical site obtained from miniaturized cameras make this surgical procedure more complex. In this work we proposed a scene segmentation method that successfully segments multi structures.
• Score: 2.198760145670348
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Knee arthroscopy is a minimally invasive surgical (MIS) procedure which is performed to treat knee-joint ailment. Lack of visual information of the surgical site obtained from miniaturized cameras make this surgical procedure more complex. Knee cavity is a very confined space; therefore, surgical scenes are captured at close proximity. Insignificant context of knee atlas often makes them unrecognizable as a consequence unintentional tissue damage often occurred and shows a long learning curve to train new surgeons. Automatic context awareness through labeling of the surgical site can be an alternative to mitigate these drawbacks. However, from the previous studies, it is confirmed that the surgical site exhibits several limitations, among others, lack of discriminative contextual information such as texture and features which drastically limits this vision task. Additionally, poor imaging conditions and lack of accurate ground-truth labels are also limiting the accuracy. To mitigate these limitations of knee arthroscopy, in this work we proposed a scene segmentation method that successfully segments multi structures.

Related papers

• SurgNarrator: A Generative Retrieval Framework for Surgical Video Understanding [35.05885138023876]
  We propose SurgNarrator, a new generative retrieval framework tailored for surgical video understanding.<n>We construct a well-curated surgery-centric vocabulary from surgical captions to define a clinically meaningful retrieval space.<n>During inference, a hierarchical, procedure-aware retrieval strategy narrows the search space to the relevant procedure type, delivering fast and effective responses.
  arXiv  Detail & Related papers  (2026-08-05T10:39:19Z)
• Attachment Anchors: A Novel Framework for Laparoscopic Grasping Point Prediction in Colorectal Surgery [19.147229560255]
  We introduce attachment anchors, a structured representation that encodes the local geometric and mechanical relationships between tissue and its anatomical attachments in colorectal surgery.<n>This representation reduces uncertainty in grasping point prediction by normalizing surgical scenes into a consistent local reference frame.<n>Experiments on a dataset of 90 colorectal surgeries demonstrate that attachment anchors improve grasping point prediction compared to image-only baselines.
  arXiv  Detail & Related papers  (2026-02-19T12:19:56Z)
• ProstaTD: Bridging Surgical Triplet from Classification to Fully Supervised Detection [54.270188252068145]
  ProstaTD is a large-scale dataset for surgical triplet detection developed from the technically demanding domain of robot-assisted prostatectomy.<n>The dataset comprises 71,775 video frames and 196,490 annotated triplet instances, collected from 21 surgeries performed across multiple institutions.<n>ProstaTD is the largest and most diverse surgical triplet dataset to date, moving the field from simple classification to full detection with precise spatial and temporal boundaries.
  arXiv  Detail & Related papers  (2025-06-01T19:29:39Z)
• Benchmarking Laparoscopic Surgical Image Restoration and Beyond [54.28852320829451]
  In laparoscopic surgery, a clear and high-quality visual field is critical for surgeons to make accurate decisions.<n> persistent visual degradation, including smoke generated by energy devices, lens fogging from thermal gradients, and lens contamination pose risks to patient safety.<n>We introduce a real-world open-source surgical image restoration dataset covering laparoscopic environments, called SurgClean.
  arXiv  Detail & Related papers  (2025-05-25T14:17:56Z)
• OphCLIP: Hierarchical Retrieval-Augmented Learning for Ophthalmic Surgical Video-Language Pretraining [55.15365161143354]
  OphCLIP is a hierarchical retrieval-augmented vision-language pretraining framework for ophthalmic surgical workflow understanding. OphCLIP learns both fine-grained and long-term visual representations by aligning short video clips with detailed narrative descriptions and full videos with structured titles. Our OphCLIP also designs a retrieval-augmented pretraining framework to leverage the underexplored large-scale silent surgical procedure videos.
  arXiv  Detail & Related papers  (2024-11-23T02:53:08Z)
• Procedure-Aware Surgical Video-language Pretraining with Hierarchical Knowledge Augmentation [51.222684687924215]
  Surgical video-language pretraining faces unique challenges due to the knowledge domain gap and the scarcity of multi-modal data. We propose a hierarchical knowledge augmentation approach and a novel Procedure-Encoded Surgical Knowledge-Augmented Video-Language Pretraining framework to tackle these issues.
  arXiv  Detail & Related papers  (2024-09-30T22:21:05Z)
• SURGIVID: Annotation-Efficient Surgical Video Object Discovery [42.16556256395392]
  We propose an annotation-efficient framework for the semantic segmentation of surgical scenes. We employ image-based self-supervised object discovery to identify the most salient tools and anatomical structures in surgical videos. Our unsupervised setup reinforced with only 36 annotation labels indicates comparable localization performance with fully-supervised segmentation models.
  arXiv  Detail & Related papers  (2024-09-12T07:12:20Z)
• CathAction: A Benchmark for Endovascular Intervention Understanding [74.58430707848527]
  CathAction is a large-scale dataset for catheterization understanding. Our dataset encompasses approximately 500,000 annotated frames for catheterization action understanding and collision detection. For each task, we benchmark recent related works in the field.
  arXiv  Detail & Related papers  (2024-08-23T14:54:49Z)
• Vision-Based Neurosurgical Guidance: Unsupervised Localization and Camera-Pose Prediction [41.91807060434709]
  Localizing oneself during endoscopic procedures can be problematic due to the lack of distinguishable textures and landmarks. We present a deep learning method based on anatomy recognition, that constructs a surgical path in an unsupervised manner from surgical videos.
  arXiv  Detail & Related papers  (2024-05-15T14:09:11Z)
• Action Recognition in Video Recordings from Gynecologic Laparoscopy [4.002010889177872]
  Action recognition is a prerequisite for many applications in laparoscopic video analysis. In this study, we design and evaluate a CNN-RNN architecture as well as a customized training-inference framework.
  arXiv  Detail & Related papers  (2023-11-30T16:15:46Z)
• Gravity Network for end-to-end small lesion detection [50.38534263407915]
  This paper introduces a novel one-stage end-to-end detector specifically designed to detect small lesions in medical images. Precise localization of small lesions presents challenges due to their appearance and the diverse contextual backgrounds in which they are found. We refer to this new architecture as GravityNet, and the novel anchors as gravity points since they appear to be "attracted" by the lesions.
  arXiv  Detail & Related papers  (2023-09-22T14:02:22Z)
• Visual-Kinematics Graph Learning for Procedure-agnostic Instrument Tip Segmentation in Robotic Surgeries [29.201385352740555]
  We propose a novel visual-kinematics graph learning framework to accurately segment the instrument tip given various surgical procedures. Specifically, a graph learning framework is proposed to encode relational features of instrument parts from both image and kinematics. A cross-modal contrastive loss is designed to incorporate robust geometric prior from kinematics to image for tip segmentation.
  arXiv  Detail & Related papers  (2023-09-02T14:52:58Z)
• Learning-Based Keypoint Registration for Fetoscopic Mosaicking [65.02392513942533]
  In Twin-to-Twin Transfusion Syndrome (TTTS), abnormal vascular anastomoses in the monochorionic placenta can produce uneven blood flow between the two fetuses. We propose a learning-based framework for in-vivo fetoscopy frame registration for field-of-view expansion.
  arXiv  Detail & Related papers  (2022-07-26T21:21:12Z)
• Quantification of Robotic Surgeries with Vision-Based Deep Learning [45.165919577877695]
  We propose a unified deep learning framework, entitled Roboformer, which operates exclusively on videos recorded during surgery. We validated our framework on four video-based datasets of two commonly-encountered types of steps within minimally-invasive robotic surgeries.
  arXiv  Detail & Related papers  (2022-05-06T06:08:35Z)
• Towards Robotic Knee Arthroscopy: Multi-Scale Network for Tissue-Tool Segmentation [0.0]
  We present a densely connected shape aware multi-scale segmentation model which captures multi-scale features and integrates shape features to achieve tissue-tool segmentations. With the publicly available polyp dataset our proposed model achieved 5.09 % accuracy improvement.
  arXiv  Detail & Related papers  (2021-10-06T11:20:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.