Selfie Taking with Facial Expression Recognition Using Omni-directional Camera

• URL: http://arxiv.org/abs/2405.15996v1
• Date: Sat, 25 May 2024 01:07:29 GMT
• Title: Selfie Taking with Facial Expression Recognition Using Omni-directional Camera
• Authors: Kazutaka Kiuchi, Shimpei Imamura, Norihiko Kawai,
• Abstract summary: We propose a method to take selfies with multiple people using an omni-directional camera. Specifically, a user takes a few seconds of video with an omni-directional camera, followed by face detection on all frames. After performing facial expression recognition on all the frames, the proposed method finally extracts the frame in which the participants are happiest.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Recent studies have shown that visually impaired people have desires to take selfies in the same way as sighted people do to record their photos and share them with others. Although support applications using sound and vibration have been developed to help visually impaired people take selfies using smartphone cameras, it is still difficult to capture everyone in the angle of view, and it is also difficult to confirm that they all have good expressions in the photo. To mitigate these issues, we propose a method to take selfies with multiple people using an omni-directional camera. Specifically, a user takes a few seconds of video with an omni-directional camera, followed by face detection on all frames. The proposed method then eliminates false face detections and complements undetected ones considering the consistency across all frames. After performing facial expression recognition on all the frames, the proposed method finally extracts the frame in which the participants are happiest, and generates a perspective projection image in which all the participants are in the angle of view from the omni-directional frame. In experiments, we use several scenes with different number of people taken to demonstrate the effectiveness of the proposed method.

Related papers

• Audio-Visual Camera Pose Estimation with Passive Scene Sounds and In-the-Wild Video [49.263724131046466]
  We show that passive scene sounds provide complementary cues for relative camera pose estimation for in-the-wild videos.<n>We introduce a simple but effective audio-visual framework that integrates direction-of-arrival (DOA) spectra and embedded embeddings into a state-of-the-art pose estimation model.
  arXiv  Detail & Related papers  (2025-12-13T04:14:52Z)
• Two Deep Learning Solutions for Automatic Blurring of Faces in Videos [0.8287206589886879]
  In this paper we present two deep-learning based options to tackle the problem of face blurring in surveillance videos. First, a direct approach, consisting of a classical object detector trained to detect faces, which are subsequently blurred. Second, an indirect approach, in which a Unet-like segmentation network is trained to output a version of the input image in which all the faces have been blurred.
  arXiv  Detail & Related papers  (2024-09-23T08:59:44Z)
• Real-Time Simulated Avatar from Head-Mounted Sensors [70.41580295721525]
  We present SimXR, a method for controlling a simulated avatar from information (headset pose and cameras) obtained from AR / VR headsets. To synergize headset poses with cameras, we control a humanoid to track headset movement while analyzing input images to decide body movement. When body parts are seen, the movements of hands and feet will be guided by the images; when unseen, the laws of physics guide the controller to generate plausible motion.
  arXiv  Detail & Related papers  (2024-03-11T16:15:51Z)
• SecurePose: Automated Face Blurring and Human Movement Kinematics Extraction from Videos Recorded in Clinical Settings [0.0]
  Face blurring can be used to de-identify videos, but this process is often manual and time-consuming. We have developed an open-source software called SecurePose that can both achieve reliable face blurring and automated kinematic extraction. SecurePose was validated on gait videos recorded in outpatient clinic visits of 116 children with cerebral palsy.
  arXiv  Detail & Related papers  (2024-02-21T21:55:29Z)
• Empowering Visually Impaired Individuals: A Novel Use of Apple Live Photos and Android Motion Photos [3.66237529322911]
  We advocate for the use of Apple Live Photos and Android Motion Photos technologies. Our findings reveal that both Live Photos and Motion Photos outperform single-frame images in common visual assisting tasks.
  arXiv  Detail & Related papers  (2023-09-14T20:46:35Z)
• People Tracking in Panoramic Video for Guiding Robots [2.092922495279074]
  A guiding robot aims to effectively bring people to and from specific places within environments that are possibly unknown to them. During this operation the robot should be able to detect and track the accompanied person, trying never to lose sight of her/him. A solution to minimize this event is to use an omnidirectional camera: its 360deg Field of View (FoV) guarantees that any framed object cannot leave the FoV if not occluded or very far from the sensor. We propose a set of targeted methods that allow to effectively adapt to panoramic videos a standard people detection and tracking pipeline originally designed for perspective cameras
  arXiv  Detail & Related papers  (2022-06-06T16:44:38Z)
• OPOM: Customized Invisible Cloak towards Face Privacy Protection [58.07786010689529]
  We investigate the face privacy protection from a technology standpoint based on a new type of customized cloak. We propose a new method, named one person one mask (OPOM), to generate person-specific (class-wise) universal masks. The effectiveness of the proposed method is evaluated on both common and celebrity datasets.
  arXiv  Detail & Related papers  (2022-05-24T11:29:37Z)
• Real-Time Neural Character Rendering with Pose-Guided Multiplane Images [75.62730144924566]
  We propose pose-guided multiplane image (MPI) synthesis which can render an animatable character in real scenes with photorealistic quality. We use a portable camera rig to capture the multi-view images along with the driving signal for the moving subject.
  arXiv  Detail & Related papers  (2022-04-25T17:51:38Z)
• HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video [44.58519508310171]
  We introduce a free-viewpoint rendering method -- HumanNeRF -- that works on a given monocular video of a human performing complex body motions. Our method enables pausing the video at any frame and rendering the subject from arbitrary new camera viewpoints.
  arXiv  Detail & Related papers  (2022-01-11T18:51:21Z)
• Watch Those Words: Video Falsification Detection Using Word-Conditioned Facial Motion [82.06128362686445]
  We propose a multi-modal semantic forensic approach to handle both cheapfakes and visually persuasive deepfakes. We leverage the idea of attribution to learn person-specific biometric patterns that distinguish a given speaker from others. Unlike existing person-specific approaches, our method is also effective against attacks that focus on lip manipulation.
  arXiv  Detail & Related papers  (2021-12-21T01:57:04Z)
• Egocentric Videoconferencing [86.88092499544706]
  Videoconferencing portrays valuable non-verbal communication and face expression cues, but usually requires a front-facing camera. We propose a low-cost wearable egocentric camera setup that can be integrated into smart glasses. Our goal is to mimic a classical video call, and therefore, we transform the egocentric perspective of this camera into a front facing video.
  arXiv  Detail & Related papers  (2021-07-07T09:49:39Z)
• From two rolling shutters to one global shutter [57.431998188805665]
  We explore a surprisingly simple camera configuration that makes it possible to undo the rolling shutter distortion. Such a setup is easy and cheap to build and it possesses the geometric constraints needed to correct rolling shutter distortion. We derive equations that describe the underlying geometry for general and special motions and present an efficient method for finding their solutions.
  arXiv  Detail & Related papers  (2020-06-02T22:18:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.