Poster: Real-Time Object Substitution for Mobile Diminished Reality with Edge Computing

• URL: http://arxiv.org/abs/2310.14511v1
• Date: Mon, 23 Oct 2023 02:47:25 GMT
• Title: Poster: Real-Time Object Substitution for Mobile Diminished Reality with Edge Computing
• Authors: Hongyu Ke, Haoxin Wang
• Abstract summary: Diminished Reality (DR) is considered as the conceptual counterpart to Augmented Reality (AR) DR allows users to remove physical content from the real world. We propose an end-to-end architecture to facilitate immersive and real-time scene construction for mobile devices with edge computing.
• Score: 2.2299983745857896
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Diminished Reality (DR) is considered as the conceptual counterpart to Augmented Reality (AR), and has recently gained increasing attention from both industry and academia. Unlike AR which adds virtual objects to the real world, DR allows users to remove physical content from the real world. When combined with object replacement technology, it presents an further exciting avenue for exploration within the metaverse. Although a few researches have been conducted on the intersection of object substitution and DR, there is no real-time object substitution for mobile diminished reality architecture with high quality. In this paper, we propose an end-to-end architecture to facilitate immersive and real-time scene construction for mobile devices with edge computing.

Related papers

• Haptic Repurposing with GenAI [5.424247121310253]
  Mixed Reality aims to merge the digital and physical worlds to create immersive human-computer interactions. This paper introduces Haptic Repurposing with GenAI, an innovative approach to enhance MR interactions by transforming any physical objects into adaptive haptic interfaces for AI-generated virtual assets.
  arXiv  Detail & Related papers  (2024-06-11T13:06:28Z)
• RPMArt: Towards Robust Perception and Manipulation for Articulated Objects [56.73978941406907]
  We propose a framework towards Robust Perception and Manipulation for Articulated Objects ( RPMArt) RPMArt learns to estimate the articulation parameters and manipulate the articulation part from the noisy point cloud. We introduce an articulation-aware classification scheme to enhance its ability for sim-to-real transfer.
  arXiv  Detail & Related papers  (2024-03-24T05:55:39Z)
• Recent Trends in 3D Reconstruction of General Non-Rigid Scenes [104.07781871008186]
  Reconstructing models of the real world, including 3D geometry, appearance, and motion of real scenes, is essential for computer graphics and computer vision. It enables the synthesizing of photorealistic novel views, useful for the movie industry and AR/VR applications. This state-of-the-art report (STAR) offers the reader a comprehensive summary of state-of-the-art techniques with monocular and multi-view inputs.
  arXiv  Detail & Related papers  (2024-03-22T09:46:11Z)
• Closing the Visual Sim-to-Real Gap with Object-Composable NeRFs [59.12526668734703]
  We introduce Composable Object Volume NeRF (COV-NeRF), an object-composable NeRF model that is the centerpiece of a real-to-sim pipeline. COV-NeRF extracts objects from real images and composes them into new scenes, generating photorealistic renderings and many types of 2D and 3D supervision.
  arXiv  Detail & Related papers  (2024-03-07T00:00:02Z)
• Detection and Pose Estimation of flat, Texture-less Industry Objects on HoloLens using synthetic Training [0.0]
  Current state-of-the-art 6d pose estimation is too compute intensive to be deployed on edge devices. We propose a synthetically trained client-server-based augmented reality application.
  arXiv  Detail & Related papers  (2024-02-07T15:57:28Z)
• Deep Billboards towards Lossless Real2Sim in Virtual Reality [20.7032774699291]
  We develop Deep Billboards that model 3D objects implicitly using neural networks. Our system, connecting a commercial VR headset with a server running neural rendering, allows real-time high-resolution simulation of detailed rigid objects. We augment Deep Billboards with physical interaction capability, adapting classic billboards from screen-based games to immersive VR.
  arXiv  Detail & Related papers  (2022-08-08T16:16:29Z)
• Object Scene Representation Transformer [56.40544849442227]
  We introduce Object Scene Representation Transformer (OSRT), a 3D-centric model in which individual object representations naturally emerge through novel view synthesis. OSRT scales to significantly more complex scenes with larger diversity of objects and backgrounds than existing methods. It is multiple orders of magnitude faster at compositional rendering thanks to its light field parametrization and the novel Slot Mixer decoder.
  arXiv  Detail & Related papers  (2022-06-14T15:40:47Z)
• Class-agnostic Reconstruction of Dynamic Objects from Videos [127.41336060616214]
  We introduce REDO, a class-agnostic framework to REconstruct the Dynamic Objects from RGBD or calibrated videos. We develop two novel modules. First, we introduce a canonical 4D implicit function which is pixel-aligned with aggregated temporal visual cues. Second, we develop a 4D transformation module which captures object dynamics to support temporal propagation and aggregation.
  arXiv  Detail & Related papers  (2021-12-03T18:57:47Z)
• ObjectFolder: A Dataset of Objects with Implicit Visual, Auditory, and Tactile Representations [52.226947570070784]
  We present Object, a dataset of 100 objects that addresses both challenges with two key innovations. First, Object encodes the visual, auditory, and tactile sensory data for all objects, enabling a number of multisensory object recognition tasks. Second, Object employs a uniform, object-centric simulations, and implicit representation for each object's visual textures, tactile readings, and tactile readings, making the dataset flexible to use and easy to share.
  arXiv  Detail & Related papers  (2021-09-16T14:00:59Z)
• HDR Environment Map Estimation for Real-Time Augmented Reality [7.6146285961466]
  We present a method to estimate an HDR environment map from a narrow field-of-view LDR camera image in real-time. This enables perceptually appealing reflections and shading on virtual objects of any material finish, from mirror to diffuse, rendered into a real physical environment using augmented reality.
  arXiv  Detail & Related papers  (2020-11-21T01:01:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.