Freehand 2D Ultrasound Probe Calibration for Image Fusion with 3D MRI/CT
- URL: http://arxiv.org/abs/2303.07714v1
- Date: Tue, 14 Mar 2023 08:55:24 GMT
- Title: Freehand 2D Ultrasound Probe Calibration for Image Fusion with 3D MRI/CT
- Authors: Yogesh Langhe, Katrin Skerl, Adrien Bartoli
- Abstract summary: This will enable us to visualize US image data during surgical procedures using augmented reality.
A near-millimeter accuracy can be achieved with the proposed approach.
- Score: 13.4304925464326
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: The aim of this work is to implement a simple freehand ultrasound (US) probe
calibration technique. This will enable us to visualize US image data during
surgical procedures using augmented reality. The performance of the system was
evaluated with different experiments using two different pose estimation
techniques. A near-millimeter accuracy can be achieved with the proposed
approach. The developed system is cost-effective, simple and rapid with low
calibration error
Related papers
- Deep intra-operative illumination calibration of hyperspectral cameras [73.08443963791343]
Hyperspectral imaging (HSI) is emerging as a promising novel imaging modality with various potential surgical applications.
We show that dynamically changing lighting conditions in the operating room dramatically affect the performance of HSI applications.
We propose a novel learning-based approach to automatically recalibrating hyperspectral images during surgery.
arXiv Detail & Related papers (2024-09-11T08:30:03Z) - 3D Freehand Ultrasound using Visual Inertial and Deep Inertial Odometry for Measuring Patellar Tracking [4.252549987351643]
Patellofemoral joint (PFJ) issues affect one in four people, with 20% experiencing chronic knee pain despite treatment.
Traditional imaging methods like CT and MRI face challenges, including cost and metal artefacts.
A new system to monitor joint motion could significantly improve understanding of PFJ dynamics.
arXiv Detail & Related papers (2024-04-24T12:52:43Z) - Next-generation Surgical Navigation: Marker-less Multi-view 6DoF Pose
Estimation of Surgical Instruments [66.74633676595889]
We present a multi-camera capture setup consisting of static and head-mounted cameras.
Second, we publish a multi-view RGB-D video dataset of ex-vivo spine surgeries, captured in a surgical wet lab and a real operating theatre.
Third, we evaluate three state-of-the-art single-view and multi-view methods for the task of 6DoF pose estimation of surgical instruments.
arXiv Detail & Related papers (2023-05-05T13:42:19Z) - EasyHeC: Accurate and Automatic Hand-eye Calibration via Differentiable
Rendering and Space Exploration [49.90228618894857]
We introduce a new approach to hand-eye calibration called EasyHeC, which is markerless, white-box, and delivers superior accuracy and robustness.
We propose to use two key technologies: differentiable rendering-based camera pose optimization and consistency-based joint space exploration.
Our evaluation demonstrates superior performance in synthetic and real-world datasets.
arXiv Detail & Related papers (2023-05-02T03:49:54Z) - Localizing Scan Targets from Human Pose for Autonomous Lung Ultrasound
Imaging [61.60067283680348]
With the advent of COVID-19 global pandemic, there is a need to fully automate ultrasound imaging.
We propose a vision-based, data driven method that incorporates learning-based computer vision techniques.
Our method attains an accuracy level of 15.52 (9.47) mm for probe positioning and 4.32 (3.69)deg for probe orientation, with a success rate above 80% under an error threshold of 25mm for all scan targets.
arXiv Detail & Related papers (2022-12-15T14:34:12Z) - A Novel Augmented Reality Ultrasound Framework Using an RGB-D Camera and
a 3D-printed Marker [0.3061098887924466]
Our goal is to develop a simple and low cost augmented reality echography framework using a standard RGB-D Camera.
Prototype system consisted of an Occipital Structure Core RGB-D camera, a specifically-designed 3D marker, and a fast point cloud registration algorithm FaVoR.
Prototype probe was calibrated on a 3D-printed N-wire phantom using the software PLUS toolkit.
arXiv Detail & Related papers (2022-05-09T14:54:47Z) - Comparison of Depth Estimation Setups from Stereo Endoscopy and Optical
Tracking for Point Measurements [1.1084983279967584]
To support minimally-invasive mitral valve repair, quantitative measurements from the valve can be obtained using an infra-red tracked stylus.
Hand-eye calibration is required that links both coordinate systems and is a prerequisite to project the points onto the image plane.
A complementary approach to this is to use a vision-based endoscopic stereo-setup to detect and triangulate points of interest, to obtain the 3D coordinates.
Preliminary results indicate that 3D landmark estimation, either labeled manually or through partly automated detection with a deep learning approach, provides more accurate triangulated depth measurements when performed with a tailored image-based method than
arXiv Detail & Related papers (2022-01-26T10:15:46Z) - Three-dimensional multimodal medical imaging system based on free-hand
ultrasound and structured light [0.0]
We propose a 3D multimodal medical imaging system that combines freehand ultrasound and structured light 3D reconstruction in a single coordinate system without requiring registration.
The system complements the internal 3D information acquired with ultrasound, with the external surface measured with the structure light technique.
arXiv Detail & Related papers (2021-05-29T18:50:00Z) - 3D Reconstruction and Alignment by Consumer RGB-D Sensors and Fiducial
Planar Markers for Patient Positioning in Radiation Therapy [1.7744342894757368]
This paper proposes a fast and cheap patient positioning method based on inexpensive consumer level RGB-D sensors.
The proposed method relies on a 3D reconstruction approach that fuses, in real-time, artificial and natural visual landmarks recorded from a hand-held RGB-D sensor.
arXiv Detail & Related papers (2021-03-22T20:20:59Z) - Automatic Extrinsic Calibration Method for LiDAR and Camera Sensor
Setups [68.8204255655161]
We present a method to calibrate the parameters of any pair of sensors involving LiDARs, monocular or stereo cameras.
The proposed approach can handle devices with very different resolutions and poses, as usually found in vehicle setups.
arXiv Detail & Related papers (2021-01-12T12:02:26Z) - Tattoo tomography: Freehand 3D photoacoustic image reconstruction with
an optical pattern [49.240017254888336]
Photoacoustic tomography (PAT) is a novel imaging technique that can resolve both morphological and functional tissue properties.
A current drawback is the limited field-of-view provided by the conventionally applied 2D probes.
We present a novel approach to 3D reconstruction of PAT data that does not require an external tracking system.
arXiv Detail & Related papers (2020-11-10T09:27:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.