MeRoPE: Metric Rotary Position Embedding for Camera-Controlled Video Generation

• URL: http://arxiv.org/abs/2609.01252v1
• Date: Tue, 01 Sep 2026 13:48:31 GMT
• Title: MeRoPE: Metric Rotary Position Embedding for Camera-Controlled Video Generation
• Abstract summary: MeRoPE (Metric Rotary Position Embedding) is a norm-preserving relative camera encoding for attention.<n>Across nuScenes and PanShot, MeRoPE achieves stronger camera control than prior encodings.
• Score: 29.69634930299998
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In camera-controlled video generation, geometry-aware positional encodings condition tokens on camera extrinsics and per-token viewing rays. Existing schemes, however, have a scale-dependent failure mode on real-world metric camera trajectories: homogeneous projective encodings cause attention logits and feature norms to grow unbounded with physical translation baselines. We propose MeRoPE (Metric Rotary Position Embedding), a norm-preserving relative camera encoding for attention. MeRoPE encodes relative orientations between calibrated viewing rays with orthogonal rotation blocks, maps raw metric displacements into multi-frequency rotary phases, and adds a disparity-anchored correspondence prior along the epipolar arc. This design strictly preserves feature norms, bounds pre-softmax attention logits regardless of the physical translation scale, and maintains exact invariance to global rigid coordinate changes. Across nuScenes and PanShot, which cover large-baseline trajectories and diverse camera optics, respectively, MeRoPE achieves stronger camera control than prior encodings, with the best consistency between generated camera motion and conditioning poses in both rotation and translation. Code will be made publicly available.

Related papers

• CameraAnything: Refilming Videos with Arbitrary Camera Control [104.67227614978822]
  We introduce CameraAnything, the first unified framework for camera controlled video editing.<n>It enables joint control of both intrinsic and extrinsic camera parameters.<n>With a tailored training strategy, CameraAnything enables expressive video reshooting with arbitrary viewpoint control, focal length adjustment, resolution adaptation, and multi-shot transitions within a single generation process.
  arXiv  Detail & Related papers  (2026-07-27T15:55:08Z)
• CRePE: Curved Ray Expectation Positional Encoding for Unified-Camera-Controlled Video Generation [48.95338161181985]
  We propose Ray Expectation Positional Controlled (CRePE) for camera-conditioned video generation.<n>CRePE represents each image token as a depth-aware positional distribution along its source ray, capturing the projected-path geometry induced by wide-angle and fisheye cameras.<n>Design leads to more stable camera control and improves several geometry-aware and perceptual-quality metrics.
  arXiv  Detail & Related papers  (2026-05-13T03:18:26Z)
• GimbalDiffusion: Gravity-Aware Camera Control for Video Generation [30.697985626973665]
  We introduce a framework that enables camera control grounded in physical-world coordinates, using gravity as a global reference.<n>We leverage panoramic 360-degree videos to construct a wide variety of camera trajectories, well beyond the predominantly straight, forward-facing trajectories seen in conventional video data.<n>We establish a benchmark for camera-aware video generation by rebalancing SpatialVID-HQ for comprehensive evaluation under wide camera pitch variation.
  arXiv  Detail & Related papers  (2025-12-09T20:54:35Z)
• Unified Camera Positional Encoding for Controlled Video Generation [48.5789182990001]
  Transformers have emerged as a universal backbone across 3D perception, video generation, and world models for autonomous driving and embodied AI.<n>We introduce Relative Ray, a geometry-consistent representation that unifies complete camera information, including 6-DoF poses, intrinsics, and lens distortions.<n>To facilitate systematic training and evaluation, we construct a large video dataset covering a wide range of camera motions and lens types.
  arXiv  Detail & Related papers  (2025-12-08T07:34:01Z)
• Two-Stage Camera Calibration Method for Multi-Camera Systems Using Scene Geometry [52.27010615715154]
  This paper presents a novel two-stage calibration method for multi-camera tracking systems.<n>In the first stage, partial calibration of individual cameras is performed based on an operator's annotation of natural geometric primitives.<n>In the second stage, precise system calibration is achieved through interactive manipulation of the projected Effective Field of View.
  arXiv  Detail & Related papers  (2025-12-04T16:47:39Z)
• ReDirector: Creating Any-Length Video Retakes with Rotary Camera Encoding [60.574308105414026]
  ReDirector is a camera-controlled video generation method for dynamically captured variable-length.<n>We introduce Rotary Camera.<n>RoCE, a camera that integrates RoPE and retake-conditioned cameras.<n>Our method generalizes to out-of-distribution camera trajectories and video lengths, yielding improved dynamic object localization and static background preservation.
  arXiv  Detail & Related papers  (2025-11-25T01:38:56Z)
• Cameras as Relative Positional Encoding [37.675563572777136]
  Multi-view transformers must use camera geometry to ground visual tokens in 3D space.<n>We show how relative camera conditioning improves performance in feedforward novel view synthesis.<n>We then verify that these benefits persist for different tasks, stereo depth estimation and discriminative cognition, as well as larger model sizes.
  arXiv  Detail & Related papers  (2025-07-14T17:22:45Z)
• TransCamP: Graph Transformer for 6-DoF Camera Pose Estimation [77.09542018140823]
  We propose a neural network approach with a graph transformer backbone, namely TransCamP, to address the camera relocalization problem. TransCamP effectively fuses the image features, camera pose information and inter-frame relative camera motions into encoded graph attributes.
  arXiv  Detail & Related papers  (2021-05-28T19:08:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.