A Robust Deep Learning Framework for Bangla License Plate Recognition Using YOLO and Vision-Language OCR

• URL: http://arxiv.org/abs/2603.10267v1
• Date: Tue, 10 Mar 2026 22:55:59 GMT
• Title: A Robust Deep Learning Framework for Bangla License Plate Recognition Using YOLO and Vision-Language OCR
• Abstract summary: The detection of Bangla license plates remains challenging because of the complicated character scheme and uneven layouts.<n>This paper presents a robust Bangla License Plate Recognition system that integrates a deep learning-based object detection model for license plate localization with Optical Character Recognition for text extraction.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: An Automatic License Plate Recognition (ALPR) system constitutes a crucial element in an intelligent traffic management system. However, the detection of Bangla license plates remains challenging because of the complicated character scheme and uneven layouts. This paper presents a robust Bangla License Plate Recognition system that integrates a deep learning-based object detection model for license plate localization with Optical Character Recognition for text extraction. Multiple object detection architectures, including U-Net and several YOLO (You Only Look Once) variants, are compared for license plate localization. This study proposes a novel two-stage adaptive training strategy built upon the YOLOv8 architecture to improve localization performance. The proposed approach outperforms the established models, achieving an accuracy of 97.83% and an Intersection over Union (IoU) of 91.3%. The text recognition problem is phrased as a sequence generation problem with a VisionEncoderDecoder architecture, with a combination of encoder-decoders evaluated. It was demonstrated that the ViT + BanglaBERT model gives better results at the character level, with a Character Error Rate of 0.1323 and Word Error Rate of 0.1068. The proposed system also shows a consistent performance when tested on an external dataset that has been curated for this study purpose. The dataset offers completely different environment and lighting conditions compared to the training sample, indicating the robustness of the proposed framework. Overall, our proposed system provides a robust and reliable solution for Bangla license plate recognition and performs effectively across diverse real-world scenarios, including variations in lighting, noise, and plate styles. These strengths make it well suited for deployment in intelligent transportation applications such as automated law enforcement and access control.

Related papers

• An Embedded Real-Time License Plate Recognition System for Complex Traffic Scenes [0.0]
  We present an embedded real-time license plate recognition system customized for developing countries.<n>Our method consists of license plate detection on a multi-vehicle image, followed by character recognition on the detected license plates.<n>We introduce the SL-LPR dataset of Sri Lankan road images, which contains a variety of vehicle types and traffic conditions.
  arXiv  Detail & Related papers  (2026-06-26T06:58:56Z)
• Neural Sentinel: Unified Vision Language Model (VLM) for License Plate Recognition with Human-in-the-Loop Continual Learning [0.0]
  This research presents Neural Sentinel, a novel unified approach that attributes license plate recognition, state classification, and vehicle extraction through a single forward pass.<n>Our primary contribution lies in demonstrating that a fine-tuned PaliGemma 3B model, adapted via Low-Rank Adaptation (LoRA), can simultaneously answer multiple visual questions about vehicle images.<n>The system achieves a mean inference latency of 152ms with an Expected Error (ECE) of 0.048, indicating well confidence estimates.
  arXiv  Detail & Related papers  (2026-02-04T16:04:15Z)
• Efficient License Plate Recognition via Pseudo-Labeled Supervision with Grounding DINO and YOLOv8 [0.29949629644252374]
  ALPR is vital in traffic control, parking, vehicle tracking, toll collection, and law enforcement applications.<n>This paper proposes a deep learning strategy using YOLOv8 for license plate detection and recognition tasks.<n>It achieved an impressive recall rate of 94% on the dataset from the Center for Pattern Recognition and Machine Intelligence (CENPARMI) and 91% on the UFPR-ALPR dataset.
  arXiv  Detail & Related papers  (2025-10-28T23:21:00Z)
• Layout-Independent License Plate Recognition via Integrated Vision and Language Models [6.302166748545872]
  This work presents a pattern-aware framework for automatic license plate recognition (ALPR)<n>It is designed to operate reliably across diverse plate layouts and challenging real-world conditions.<n> Experimental results demonstrate superior accuracy and robustness compared to recent segmentation-free approaches.
  arXiv  Detail & Related papers  (2025-10-12T10:25:21Z)
• Knowledge Regularized Negative Feature Tuning of Vision-Language Models for Out-of-Distribution Detection [54.433899174017185]
  Out-of-distribution (OOD) detection is crucial for building reliable machine learning models.<n>We propose a novel method called Knowledge Regularized Negative Feature Tuning (KR-NFT)<n>NFT applies distribution-aware transformations to pre-trained text features, effectively separating positive and negative features into distinct spaces.<n>When trained with few-shot samples from ImageNet dataset, KR-NFT not only improves ID classification accuracy and OOD detection but also significantly reduces the FPR95 by 5.44%.
  arXiv  Detail & Related papers  (2025-07-26T07:44:04Z)
• A Hybrid Framework for Statistical Feature Selection and Image-Based Noise-Defect Detection [55.2480439325792]
  This paper presents a hybrid framework that integrates both statistical feature selection and classification techniques to improve defect detection accuracy.<n>We present around 55 distinguished features that are extracted from industrial images, which are then analyzed using statistical methods.<n>By integrating these methods with flexible machine learning applications, the proposed framework improves detection accuracy and reduces false positives and misclassifications.
  arXiv  Detail & Related papers  (2024-12-11T22:12:21Z)
• A Dataset and Model for Realistic License Plate Deblurring [17.52035404373648]
  We introduce the first large-scale license plate deblurring dataset named License Plate Blur (LPBlur) Then, we propose a License Plate Deblurring Generative Adversarial Network (LPDGAN) to tackle the license plate deblurring. Our proposed model outperforms other state-of-the-art motion deblurring methods in realistic license plate deblurring scenarios.
  arXiv  Detail & Related papers  (2024-04-21T14:36:57Z)
• Bridging the Gap Between End-to-End and Two-Step Text Spotting [88.14552991115207]
  Bridging Text Spotting is a novel approach that resolves the error accumulation and suboptimal performance issues in two-step methods. We demonstrate the effectiveness of the proposed method through extensive experiments.
  arXiv  Detail & Related papers  (2024-04-06T13:14:04Z)
• End-to-End High Accuracy License Plate Recognition Based on Depthwise Separable Convolution Networks [0.0]
  We propose a novel segmentation-free framework for license plate recognition and introduce NP-ALPR dataset. The proposed network model consists of the latest deep learning methods and state-of-the-art ideas, and benefits from a novel network architecture. We evaluate the effectiveness of the proposed method on three different datasets and show a recognition accuracy of over 99% and over 70 fps.
  arXiv  Detail & Related papers  (2022-02-21T14:45:03Z)
• Learnable Online Graph Representations for 3D Multi-Object Tracking [156.58876381318402]
  We propose a unified and learning based approach to the 3D MOT problem. We employ a Neural Message Passing network for data association that is fully trainable. We show the merit of the proposed approach on the publicly available nuScenes dataset by achieving state-of-the-art performance of 65.6% AMOTA and 58% fewer ID-switches.
  arXiv  Detail & Related papers  (2021-04-23T17:59:28Z)
• Automatic Counting and Identification of Train Wagons Based on Computer Vision and Deep Learning [70.84106972725917]
  The proposed solution is cost-effective and can easily replace solutions based on radiofrequency identification (RFID) The system is able to automatically reject some of the train wagons successfully counted, as they have damaged identification codes.
  arXiv  Detail & Related papers  (2020-10-30T14:56:54Z)
• Generalized Iris Presentation Attack Detection Algorithm under Cross-Database Settings [63.90855798947425]
  Presentation attacks pose major challenges to most of the biometric modalities. We propose a generalized deep learning-based presentation attack detection network, MVANet. It is inspired by the simplicity and success of hybrid algorithm or fusion of multiple detection networks.
  arXiv  Detail & Related papers  (2020-10-25T22:42:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.