Evaluation and Comparison Semantics for ODRL

• URL: http://arxiv.org/abs/2509.05139v1
• Date: Fri, 05 Sep 2025 14:30:41 GMT
• Title: Evaluation and Comparison Semantics for ODRL
• Abstract summary: We consider the problem of evaluating, and comparing computational policies in the Open Digital Rights Language (ODRL)<n>We provide a simple and intuitive formal semantics for ODRL that is based on query answering.
• Score: 0.12314765641075437
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We consider the problem of evaluating, and comparing computational policies in the Open Digital Rights Language (ODRL), which has become the de facto standard for governing the access and usage of digital resources. Although preliminary progress has been made on the formal specification of the language's features, a comprehensive formal semantics of ODRL is still missing. In this paper, we provide a simple and intuitive formal semantics for ODRL that is based on query answering. Our semantics refines previous formalisations, and is aligned with the latest published specification of the language (2.2). Building on our evaluation semantics, and motivated by data sharing scenarios, we also define and study the problem of comparing two policies, detecting equivalent, more restrictive or more permissive policies.

Related papers

• A Formally Grounded ODRL Evaluator: Implementation and Comparison [0.06524460254566902]
  We present the first ODRL Evaluator with transparent formal semantics and supporting all rule types.<n>We experimentally measure its performance, analysing different scalability dimensions related to policy complexity and size of the data on which a policy is evaluated.
  arXiv  Detail & Related papers  (2026-07-17T14:24:06Z)
• ODRL Policy Comparison Through Normalisation [0.07646713951724009]
  The ODRL language has become the standard for representing policies and regulations for digital rights.<n>Its complexity is a barrier to its usage, which has caused many related theoretical and practical works to focus on different, and not interoperable, fragments of ODRL.<n>We tackle these problems by proposing an approach that involves a parametrised normalisation of ODRL policies into its minimal components.
  arXiv  Detail & Related papers  (2026-03-13T12:09:22Z)
• Natural Language-based Assessment of L2 Oral Proficiency using LLMs [5.931245606235828]
  Natural language-based assessment (NLA) is an approach to second language assessment that uses instructions expressed in the form of can-do descriptors.<n>In this work, we explore the use of such descriptors with an open-source LLM, Qwen 2.5 72B, to assess responses from the publicly available S&I Corpus.<n>Our results show that this approach achieves competitive performance: while it does not outperform state-of-the-art speech LLMs fine-tuned for the task, it surpasses a BERT-based model trained specifically for this purpose.
  arXiv  Detail & Related papers  (2025-07-14T12:13:50Z)
• Assessing the Performance Gap Between Lexical and Semantic Models for Information Retrieval With Formulaic Legal Language [1.3499500088995462]
  This study investigates the task of retrieving legal passages or paragraphs from decisions of the Court of Justice of the European Union (CJEU)<n>Our experiments show that BM25 is a strong baseline, surpassing off-the-shelf dense models in 4 out of 7 performance metrics.<n>Fine-tuning a dense model on domain-specific data led to improved performance, surpassing BM25 in most metrics.
  arXiv  Detail & Related papers  (2025-06-15T15:53:38Z)
• SANDWiCH: Semantical Analysis of Neighbours for Disambiguating Words in Context ad Hoc [1.0309408988485051]
  We present a simple yet computationally efficient framework for multilingual Word Sense Disambiguation (WSD)<n>Our approach reframes the WSD task as a cluster discrimination analysis over a semantic network refined from BabelNet using group algebra.<n>We validate our methodology across multiple WSD benchmarks, achieving a new state of the art for all languages and tasks, as well as in individual assessments by part of speech.
  arXiv  Detail & Related papers  (2025-03-07T21:52:32Z)
• SEOE: A Scalable and Reliable Semantic Evaluation Framework for Open Domain Event Detection [70.23196257213829]
  We propose a scalable and reliable Semantic-level Evaluation framework for Open domain Event detection.<n>Our proposed framework first constructs a scalable evaluation benchmark that currently includes 564 event types covering 7 major domains.<n>We then leverage large language models (LLMs) as automatic evaluation agents to compute a semantic F1-score, incorporating fine-grained definitions of semantically similar labels.
  arXiv  Detail & Related papers  (2025-03-05T09:37:05Z)
• Few-shot Policy (de)composition in Conversational Question Answering [54.259440408606515]
  We propose a neuro-symbolic framework to detect policy compliance using large language models (LLMs) in a few-shot setting.<n>We show that our approach soundly reasons about policy compliance conversations by extracting sub-questions to be answered, assigning truth values from contextual information, and explicitly producing a set of logic statements from the given policies.<n>We apply this approach to the popular PCD and conversational machine reading benchmark, ShARC, and show competitive performance with no task-specific finetuning.
  arXiv  Detail & Related papers  (2025-01-20T08:40:15Z)
• Open Digital Rights Enforcement Framework (ODRE): from descriptive to enforceable policies [1.3927943269211591]
  This paper introduces the Open Digital Rights Enforcement (ODRE) framework, whose goal is to provide ODRL with enforcement capabilities. The framework includes an enforcement algorithm for ODRL policies and two open-source implementations in Python and Java.
  arXiv  Detail & Related papers  (2024-09-26T07:36:49Z)
• A Controlled Study on Long Context Extension and Generalization in LLMs [85.4758128256142]
  Broad textual understanding and in-context learning require language models that utilize full document contexts. Due to the implementation challenges associated with directly training long-context models, many methods have been proposed for extending models to handle long contexts. We implement a controlled protocol for extension methods with a standardized evaluation, utilizing consistent base models and extension data.
  arXiv  Detail & Related papers  (2024-09-18T17:53:17Z)
• APOLLO: A Simple Approach for Adaptive Pretraining of Language Models for Logical Reasoning [73.3035118224719]
  We propose APOLLO, an adaptively pretrained language model that has improved logical reasoning abilities. APOLLO performs comparably on ReClor and outperforms baselines on LogiQA.
  arXiv  Detail & Related papers  (2022-12-19T07:40:02Z)
• Entity Disambiguation with Entity Definitions [50.01142092276296]
  Local models have recently attained astounding performances in Entity Disambiguation (ED) Previous works limited their studies to using, as the textual representation of each candidate, only its Wikipedia title. In this paper, we address this limitation and investigate to what extent more expressive textual representations can mitigate it. We report a new state of the art on 2 out of 6 benchmarks we consider and strongly improve the generalization capability over unseen patterns.
  arXiv  Detail & Related papers  (2022-10-11T17:46:28Z)
• DINO: A Conditional Energy-Based GAN for Domain Translation [67.9879720396872]
  Domain translation is the process of transforming data from one domain to another while preserving the common semantics. Some of the most popular domain translation systems are based on conditional generative adversarial networks. We propose a new framework, where two networks are simultaneously trained, in a supervised manner, to perform domain translation in opposite directions.
  arXiv  Detail & Related papers  (2021-02-18T11:52:45Z)
• Analysis and Evaluation of Language Models for Word Sense Disambiguation [18.001457030065712]
  Transformer-based language models have taken many fields in NLP by storm. BERT can accurately capture high-level sense distinctions, even when a limited number of examples is available for each word sense. BERT and its derivatives dominate most of the existing evaluation benchmarks.
  arXiv  Detail & Related papers  (2020-08-26T15:07:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.