Gated Multimodal Learning for Interpretable Property Energy Performance Prediction and Retrofit Scenario Analysis

• URL: http://arxiv.org/abs/2605.05088v1
• Date: Wed, 06 May 2026 16:23:11 GMT
• Title: Gated Multimodal Learning for Interpretable Property Energy Performance Prediction and Retrofit Scenario Analysis
• Abstract summary: This study introduces a gated multimodal model to predict Standard Assessment Procedure (SAP) energy efficiency and Environmental Impact (EI) scores.<n>In a Westminster, London case study, the model predicts SAP and EI scores with MAEs of 4.03 and 4.76 points and R2 values of 0.757 and 0.748, respectively.<n>Overall, the framework provides scalable property-level evidence for retrofit screening, intervention prioritisation, and net-zero housing transitions.
• Score: 4.59166421255722
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Achieving resilient and sustainable cities requires scalable approaches to decarbonising residential buildings, which account for about 20% of UK greenhouse gas emissions and 25% of energy-related emissions in the European Union. Energy Performance Certificates (EPCs) support regulation and retrofit planning, but their reliance on on-site inspections limits timely city-scale assessment. This study introduces a gated multimodal model to predict Standard Assessment Procedure (SAP) energy efficiency and Environmental Impact (EI) scores by integrating EPC tabular variables, assessor-written free text, and Geographic Information System (GIS)-derived spatial features describing footprint geometry, height, area, and orientation. Sample-wise gating learns property-specific modality weights, while an auxiliary band classification head stabilises training. In a Westminster, London case study, the model predicts SAP and EI scores with MAEs of 4.03 and 4.76 points and R2 values of 0.757 and 0.748, respectively, achieving a mean MAE of 4.39. Ablation results show that full multimodal fusion outperforms unimodal and bimodal baselines for both score prediction and band-level classification. Interpretability analyses provide decision-relevant evidence: gating weights indicate strong reliance on assessor text; SHAP highlights main fuel, built form, and construction age band; text occlusion prioritises roof and wall fields; and spatial attribution is dominated by height and footprint area, with sensitivity to footprint shape. The validated framework is further applied to retrofit scenarios for wall insulation, roof insulation, and window glazing upgrades, indicating projected improvements in SAP, EI, annual energy cost, and equivalent CO2 emissions. Overall, the framework provides scalable property-level evidence for retrofit screening, intervention prioritisation, and net-zero housing transitions.

Related papers

• Foundation-Model Earth Representations Enable Regional-Scale Forest Aboveground Biomass Monitoring Across the Northeastern United States [0.0]
  Forest aboveground biomass (AGB) is a critical indicator of ecosystem productivity and terrestrial carbon storage.<n>Recent Earth observation foundation models provide globally consistent geospatial representations derived from diverse datasets.<n>We evaluate Google Satellite Embeddings (GSE), generated by the AplphaEarth Foundation Model, for regional-scale AGB estimation.
  arXiv  Detail & Related papers  (2026-06-25T15:07:38Z)
• Latent Performance Profiling of Large Language Models [47.009623327601226]
  We introduce Latent Performance Profiling (LPP) -- a framework that derives task-agnostic diagnostics from hidden activations and output distributions.<n>Unlike static accuracy scores, LPP provides stable, architecture-sensitive signatures across models of similar size.<n>We show that models with similar benchmark scores can exhibit contrasting latent profiles, such as differences in entropy or adaptability.
  arXiv  Detail & Related papers  (2026-05-28T14:41:26Z)
• PEFT-Arena: Understanding Parameter-Efficient Finetuning from a Stability-Plasticity Perspective [52.693471818837395]
  We argue that PEFT should be assessed through the stability-plasticity dilemma.<n>We introduce PEFT-Arena, a benchmark that measures downstream performance and general capability retention.<n>Inspired by this, we present case studies of a post-hoc improvement with path-wise rewinding.
  arXiv  Detail & Related papers  (2026-05-27T17:59:51Z)
• CatalyticMLLM: A Graph-Text Multimodal Large Language Model for Catalytic Materials [61.546562658308005]
  We propose QE-Catalytic-V2, a unified graph--text multimodal large language model for catalytic materials.<n>It integrates property prediction and inverse design within the same model and shared representation space.<n>Under this unified framework, QE-Catalytic-V2 can not only perform reliable property prediction but also generate and screen physically feasible CIF candidates.
  arXiv  Detail & Related papers  (2026-05-17T04:31:46Z)
• Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecasting [52.53742727060265]
  Foundation models (FMs) for the Earth system learn statistical relationships between physical variables across massive datasets.<n>Here, we introduce Earth System Foundation Model (ESFM), a fully open model building on the 3Dwin UNet backbone of the pioneering model.<n>We present findings using dense gridded data (ERA5, CMIP6), regionally masked dense data, sparse gridded MODIS satellite data, and station data.<n>Results demonstrate competitive or superior performance relative to state-of-the-art benchmarks.
  arXiv  Detail & Related papers  (2026-04-20T11:40:39Z)
• Multimodal Modular Chain of Thoughts in Energy Performance Certificate Assessment [2.5501895454488666]
  This paper presents a cost-efficient framework that leverages Vision-Language models for automated EPC pre-assessment from limited visual information.<n>Experiments on a multimodal dataset of 81 residential properties in the United Kingdom show that MMCoT achieves statistically significant improvements over instruction-only prompting.
  arXiv  Detail & Related papers  (2026-02-20T14:46:01Z)
• QE-Catalytic: A Graph-Language Multimodal Base Model for Relaxed-Energy Prediction in Catalytic Adsorption [44.77883047868218]
  We propose QE-Catalytic, a multimodal framework that couples a large language model with an E(3)-equivariant graph Transformer.<n>During prediction, QE-Catalytic jointly leverages three-dimensional structures and structured configuration text, and injects 3D geometric information'' into the language channel.<n>On OC20, QE-Catalytic reduces the MAE of relaxed adsorb energy from 0.713eV to 0.486eV, and consistently outperforms baseline models.
  arXiv  Detail & Related papers  (2025-12-23T06:27:30Z)
• A County-Level Similarity Network of Electric Vehicle Adoption: Integrating Predictive Modeling and Graph Theory [0.0]
  This study introduces a graph-theoretic framework that complements predictive modeling to better capture how county-level characteristics relate to EV adoption.<n>Findings reveal consistent global trends, such as declining median income, educational attainment, and charging-station availability.<n>Some low-adoption groups are rural but not economically disadvantaged, whereas others are urbanized yet experience high poverty rates.
  arXiv  Detail & Related papers  (2025-11-19T00:45:20Z)
• Carbon Price Forecasting with Structural Breaks: A Comparative Study of Deep Learning Models [8.59635419237389]
  Accurately forecasting carbon prices is essential for informed energy market decision-making.<n>Existing studies have attempted to incorporate breakpoints but often treat denoising and modeling as separate processes.<n>This paper proposes a comprehensive hybrid framework that integrates structural break detection (Bai-Perron, ICSS, and PELT algorithms), wavelet signal denoising, and three state-of-the-art deep learning models.
  arXiv  Detail & Related papers  (2025-11-07T05:16:56Z)
• Km-scale dynamical downscaling through conformalized latent diffusion models [45.94979929172337]
  Dynamical downscaling is crucial for deriving high-resolution meteorological fields from coarse-scale simulations.<n>Generative Diffusion models (DMs) have recently emerged as powerful data-driven tools for this task.<n>However, DMs lack finite-sample guarantees against overconfident predictions, resulting in miscalibrated grid-point-level uncertainty estimates.<n>We tackle this issue by augmenting the downscaling pipeline with a conformal prediction framework.
  arXiv  Detail & Related papers  (2025-10-15T08:41:36Z)
• Continual Action Quality Assessment via Adaptive Manifold-Aligned Graph Regularization [53.82400605816587]
  Action Quality Assessment (AQA) quantifies human actions in videos, supporting applications in sports scoring, rehabilitation, and skill evaluation.<n>A major challenge lies in the non-stationary nature of quality distributions in real-world scenarios.<n>We introduce Continual AQA (CAQA), which equips with Continual Learning capabilities to handle evolving distributions.
  arXiv  Detail & Related papers  (2025-10-08T10:09:47Z)
• Solar PV Installation Potential Assessment on Building Facades Based on Vision and Language Foundation Models [11.037550898765502]
  This study introduces SF-SPA (Semantic Facade Solar-PV Assessment), an automated framework that transforms street-view photographs into quantitative PV deployment assessments.<n>The approach combines com puter vision and artificial intelligence techniques to address three key challenges: perspective distortion correction, semantic understanding of facade elements, and spatial reasoning for PV layout optimization.
  arXiv  Detail & Related papers  (2025-10-01T11:51:28Z)
• A New HOPE: Domain-agnostic Automatic Evaluation of Text Chunking [44.47350338664039]
  Document chunking fundamentally impacts Retrieval-Augmented Generation (RAG)<n>There is currently no framework to analyze the impact of different chunking methods.<n>We introduce a novel methodology that defines essential characteristics of the chunking process at three levels.
  arXiv  Detail & Related papers  (2025-05-04T16:22:27Z)
• Explainable AI for building energy retrofitting under data scarcity [40.14307808809578]
  This study presents an Artificial Intelligence (AI) and Machine Learning (ML)-based framework to recommend energy efficiency measures for residential buildings.<n>Using Latvia as a case study, the methodology addresses challenges associated with limited datasets, class imbalance and data scarcity.<n>The evaluation of the approach shows that it notably overcomes data limitations, achieving improvements up to 54% in precision, recall and F1 score.
  arXiv  Detail & Related papers  (2025-04-08T14:00:08Z)
• An Energy and Carbon Footprint Analysis of Distributed and Federated Learning [42.37180749113699]
  Classical and centralized Artificial Intelligence (AI) methods require moving data from producers (sensors, machines) to energy hungry data centers. Emerging alternatives to mitigate such high energy costs propose to efficiently distribute, or federate, the learning tasks across devices. This paper proposes a novel framework for the analysis of energy and carbon footprints in distributed and federated learning.
  arXiv  Detail & Related papers  (2022-06-21T13:28:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.