Online waveform selection for cognitive radar
- URL: http://arxiv.org/abs/2410.10591v1
- Date: Mon, 14 Oct 2024 15:01:41 GMT
- Title: Online waveform selection for cognitive radar
- Authors: Thulasi Tholeti, Avinash Rangarajan, Sheetal Kalyani,
- Abstract summary: We propose adaptive algorithms that select waveform parameters in an online fashion.
We propose three reinforcement learning algorithms: bandwidth scaling, Q-learning, and Q-learning lookahead.
Our proposed algorithms achieve the dual objectives of minimizing range error and maintaining continuous tracking without losing the target.
- Score: 8.187445866881637
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Designing a cognitive radar system capable of adapting its parameters is challenging, particularly when tasked with tracking a ballistic missile throughout its entire flight. In this work, we focus on proposing adaptive algorithms that select waveform parameters in an online fashion. Our novelty lies in formulating the learning problem using domain knowledge derived from the characteristics of ballistic trajectories. We propose three reinforcement learning algorithms: bandwidth scaling, Q-learning, and Q-learning lookahead. These algorithms dynamically choose the bandwidth for each transmission based on received feedback. Through experiments on synthetically generated ballistic trajectories, we demonstrate that our proposed algorithms achieve the dual objectives of minimizing range error and maintaining continuous tracking without losing the target.
Related papers
- SSP-GNN: Learning to Track via Bilevel Optimization [3.1889516673296807]
We propose a graph-based tracking formulation for multi-object tracking (MOT)
Our method applies a successive shortest paths (SSP) algorithm to a tracking graph defined over a batch of frames.
The edge costs in this tracking graph are computed via a message-passing network, a graph neural network (GNN) variant.
arXiv Detail & Related papers (2024-07-05T07:23:51Z) - Unsupervised Domain Adaptation for Self-Driving from Past Traversal
Features [69.47588461101925]
We propose a method to adapt 3D object detectors to new driving environments.
Our approach enhances LiDAR-based detection models using spatial quantized historical features.
Experiments on real-world datasets demonstrate significant improvements.
arXiv Detail & Related papers (2023-09-21T15:00:31Z) - Semantic Segmentation of Radar Detections using Convolutions on Point
Clouds [59.45414406974091]
We introduce a deep-learning based method to convolve radar detections into point clouds.
We adapt this algorithm to radar-specific properties through distance-dependent clustering and pre-processing of input point clouds.
Our network outperforms state-of-the-art approaches that are based on PointNet++ on the task of semantic segmentation of radar point clouds.
arXiv Detail & Related papers (2023-05-22T07:09:35Z) - Neural Network Algorithm for Intercepting Targets Moving Along Known
Trajectories by a Dubins' Car [0.0]
The task of intercepting a target moving along a rectilinear or circular trajectory by a Dubins' car is formulated as a time-optimal control problem.
neural network methods of unsupervised learning based on the Deep Deterministic Policy Gradient algorithm are used.
The effectiveness of using neural network methods for the synthesis of interception trajectories for given classes of target movements is shown.
arXiv Detail & Related papers (2023-04-12T21:52:39Z) - Online Bayesian Meta-Learning for Cognitive Tracking Radar [9.805913930878]
We develop an online meta-learning approach for waveform-agile tracking.
We exploit inherent similarity across tracking scenes, attributed to common physical elements such as target type or clutter.
arXiv Detail & Related papers (2022-07-07T20:21:54Z) - Feeling of Presence Maximization: mmWave-Enabled Virtual Reality Meets
Deep Reinforcement Learning [76.46530937296066]
This paper investigates the problem of providing ultra-reliable and energy-efficient virtual reality (VR) experiences for wireless mobile users.
To ensure reliable ultra-high-definition (UHD) video frame delivery to mobile users, a coordinated multipoint (CoMP) transmission technique and millimeter wave (mmWave) communications are exploited.
arXiv Detail & Related papers (2021-06-03T08:35:10Z) - A Novel Look at LIDAR-aided Data-driven mmWave Beam Selection [24.711393214172148]
We propose a lightweight neural network (NN) architecture along with the corresponding LIDAR preprocessing.
Our NN-based beam selection scheme can achieve 79.9% throughput without any beam search overhead and 95% by searching among as few as 6 beams.
arXiv Detail & Related papers (2021-04-29T18:07:31Z) - XAI-N: Sensor-based Robot Navigation using Expert Policies and Decision
Trees [55.9643422180256]
We present a novel sensor-based learning navigation algorithm to compute a collision-free trajectory for a robot in dense and dynamic environments.
Our approach uses deep reinforcement learning-based expert policy that is trained using a sim2real paradigm.
We highlight the benefits of our algorithm in simulated environments and navigating a Clearpath Jackal robot among moving pedestrians.
arXiv Detail & Related papers (2021-04-22T01:33:10Z) - SelfVoxeLO: Self-supervised LiDAR Odometry with Voxel-based Deep Neural
Networks [81.64530401885476]
We propose a self-supervised LiDAR odometry method, dubbed SelfVoxeLO, to tackle these two difficulties.
Specifically, we propose a 3D convolution network to process the raw LiDAR data directly, which extracts features that better encode the 3D geometric patterns.
We evaluate our method's performances on two large-scale datasets, i.e., KITTI and Apollo-SouthBay.
arXiv Detail & Related papers (2020-10-19T09:23:39Z) - Risk-Averse MPC via Visual-Inertial Input and Recurrent Networks for
Online Collision Avoidance [95.86944752753564]
We propose an online path planning architecture that extends the model predictive control (MPC) formulation to consider future location uncertainties.
Our algorithm combines an object detection pipeline with a recurrent neural network (RNN) which infers the covariance of state estimates.
The robustness of our methods is validated on complex quadruped robot dynamics and can be generally applied to most robotic platforms.
arXiv Detail & Related papers (2020-07-28T07:34:30Z) - A Machine Learning Solution for Beam Tracking in mmWave Systems [33.1010771477611]
We explore a machine learning-based approach to track the angle of arrival (AoA) for specific paths in realistic scenarios.
We propose methods to train the network in sequential data, and study the performance of our proposed solution in comparison to an extended Kalman filter based solution.
arXiv Detail & Related papers (2019-12-29T06:18:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.