Forecasting and Visualizing Air Quality from Sky Images with Vision-Language Models

• URL: http://arxiv.org/abs/2509.15076v1
• Date: Thu, 18 Sep 2025 15:36:38 GMT
• Title: Forecasting and Visualizing Air Quality from Sky Images with Vision-Language Models
• Authors: Mohammad Saleh Vahdatpour, Maryam Eyvazi, Yanqing Zhang,
• Abstract summary: Air pollution remains a critical threat to public health and environmental sustainability.<n>This paper proposes an AI-driven agent that predicts ambient air pollution levels from sky images.<n>Our approach combines statistical texture analysis with supervised learning for pollution classification.
• Score: 0.4317207251910848
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Air pollution remains a critical threat to public health and environmental sustainability, yet conventional monitoring systems are often constrained by limited spatial coverage and accessibility. This paper proposes an AI-driven agent that predicts ambient air pollution levels from sky images and synthesizes realistic visualizations of pollution scenarios using generative modeling. Our approach combines statistical texture analysis with supervised learning for pollution classification, and leverages vision-language model (VLM)-guided image generation to produce interpretable representations of air quality conditions. The generated visuals simulate varying degrees of pollution, offering a foundation for user-facing interfaces that improve transparency and support informed environmental decision-making. These outputs can be seamlessly integrated into intelligent applications aimed at enhancing situational awareness and encouraging behavioral responses based on real-time forecasts. We validate our method using a dataset of urban sky images and demonstrate its effectiveness in both pollution level estimation and semantically consistent visual synthesis. The system design further incorporates human-centered user experience principles to ensure accessibility, clarity, and public engagement in air quality forecasting. To support scalable and energy-efficient deployment, future iterations will incorporate a green CNN architecture enhanced with FPGA-based incremental learning, enabling real-time inference on edge platforms.

Related papers

• IoT- and AI-informed urban air quality models for vehicle pollution monitoring [0.4893529843295925]
  We present a real-world pilot deployment at a road intersection in Barcelona's Eixample district.<n>The system captures dynamic traffic conditions and environmental variables, processes them at the edge, and feeds real-time data into a high-performance computing (HPC) simulation pipeline.<n>Results are validated against official air quality measurements of nitrogen dioxide (NO2)<n>This work demonstrates a scalable, adaptive, and privacy-conscious solution for urban pollution monitoring and establishes a foundation for next-generation IoT-driven environmental intelligence.
  arXiv  Detail & Related papers  (2025-10-31T18:47:16Z)
• Synergistic Neural Forecasting of Air Pollution with Stochastic Sampling [50.3911487821783]
  Air pollution remains a leading global health and environmental risk, particularly in regions vulnerable to episodic air pollution spikes due to wildfires, urban haze and dust storms.<n>Here, we present SynCast, a high-resolution neural forecasting model that integrates meteorological and air composition data to improve predictions of both average and extreme pollution levels.
  arXiv  Detail & Related papers  (2025-10-28T01:18:00Z)
• DAWP: A framework for global observation forecasting via Data Assimilation and Weather Prediction in satellite observation space [60.729377189859]
  We propose our DAWP framework to enable AIWPs to operate in a complete observation space.<n>AIDA module applies a mask multi-modality autoencoder for assimilating irregular satellite observation tokens.<n>We show that AIDA significantly improves the roll out and efficiency of AIWP and holds promising potential to be applied in global precipitationresolution forecasting.
  arXiv  Detail & Related papers  (2025-10-13T03:13:35Z)
• CityAQVis: Integrated ML-Visualization Sandbox Tool for Pollutant Estimation in Urban Regions Using Multi-Source Data (Software Article) [1.108292291257035]
  CityAQVis is an interactive machine learning sandbox tool designed to predict and visualize pollutant concentrations at the ground level.<n>Our results highlight the potential of ML-driven visual analytics to improve situational awareness and support data-driven decision-making in air quality management.
  arXiv  Detail & Related papers  (2025-09-13T18:16:29Z)
• DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledge [41.030494146004806]
  We propose DreamVLA, a novel VLA framework that integrates comprehensive world knowledge forecasting to enable inverse dynamics modeling.<n>DreamVLA introduces a dynamic-region-guided world knowledge prediction, integrated with the spatial and semantic cues, which provide compact yet comprehensive representations for action planning.<n>Experiments on both real-world and simulation environments demonstrate that DreamVLA achieves 76.7% success rate on real robot tasks.
  arXiv  Detail & Related papers  (2025-07-06T16:14:29Z)
• Data Augmentation and Resolution Enhancement using GANs and Diffusion Models for Tree Segmentation [49.13393683126712]
  Urban forests play a key role in enhancing environmental quality and supporting biodiversity in cities.<n> accurately detecting trees is challenging due to complex landscapes and the variability in image resolution caused by different satellite sensors or UAV flight altitudes.<n>We propose a novel pipeline that integrates domain adaptation with GANs and Diffusion models to enhance the quality of low-resolution aerial images.
  arXiv  Detail & Related papers  (2025-05-21T03:57:10Z)
• An AI-driven framework for the prediction of personalised health response to air pollution [30.858937705130106]
  Air pollution poses a significant threat to public health, causing or exacerbating many respiratory and cardiovascular diseases.<n>Recent advances in personal sensing have transformed the collection of behavioural and physiological data.<n>We present a novel workflow for predicting personalised health responses to pollution by integrating physiological data from wearable fitness devices with real-time environmental exposures.
  arXiv  Detail & Related papers  (2025-05-15T17:59:07Z)
• Learning Underwater Active Perception in Simulation [51.205673783866146]
  Turbidity can jeopardise the whole mission as it may prevent correct visual documentation of the inspected structures.<n>Previous works have introduced methods to adapt to turbidity and backscattering.<n>We propose a simple yet efficient approach to enable high-quality image acquisition of assets in a broad range of water conditions.
  arXiv  Detail & Related papers  (2025-04-23T06:48:38Z)
• Can Deep Learning Trigger Alerts from Mobile-Captured Images? [0.0594961162060159]
  This research contributes to verification of data augmentation techniques, CNN-based regression modelling for air quality prediction, and user-centric air quality monitoring through mobile technology.<n>The proposed system offers practical solutions for individuals to make informed environmental health and well-being decisions.
  arXiv  Detail & Related papers  (2025-01-07T03:39:43Z)
• Water quality polluted by total suspended solids classified within an Artificial Neural Network approach [0.0]
  Water pollution by suspended solids poses significant environmental and health risks. To address these challenges, we developed a model that leverages a comprehensive dataset of water quality from total suspended solids. A convolutional neural network was trained under a transfer learning approach using data corresponding to different total suspended solids concentrations.
  arXiv  Detail & Related papers  (2024-10-19T01:33:08Z)
• Environmental Insights: Democratizing Access to Ambient Air Pollution Data and Predictive Analytics with an Open-Source Python Package [0.0]
  Environmental Insights is an open-source Python package designed to democratize access to air pollution concentration data. This tool enables users to retrieve historical air pollution data and employ a Machine Learning model for forecasting potential future conditions.
  arXiv  Detail & Related papers  (2024-03-06T12:34:50Z)
• Towards an end-to-end artificial intelligence driven global weather forecasting system [57.5191940978886]
  We present an AI-based data assimilation model, i.e., Adas, for global weather variables. We demonstrate that Adas can assimilate global observations to produce high-quality analysis, enabling the system operate stably for long term. We are the first to apply the methods to real-world scenarios, which is more challenging and has considerable practical application potential.
  arXiv  Detail & Related papers  (2023-12-18T09:05:28Z)
• Conditioned Human Trajectory Prediction using Iterative Attention Blocks [70.36888514074022]
  We present a simple yet effective pedestrian trajectory prediction model aimed at pedestrians positions prediction in urban-like environments. Our model is a neural-based architecture that can run several layers of attention blocks and transformers in an iterative sequential fashion. We show that without explicit introduction of social masks, dynamical models, social pooling layers, or complicated graph-like structures, it is possible to produce on par results with SoTA models.
  arXiv  Detail & Related papers  (2022-06-29T07:49:48Z)
• AirSPEC: An IoT-empowered Air Quality Monitoring System integrated with a Machine Learning Framework to Detect and Predict defined Air Quality parameters [0.0]
  A novel Internet of Things framework is proposed which is easily implementable, semantically distributive, and empowered by a machine learning model. The proposed system is equipped with a NodeRED dashboard which processes, visualizes, and stores the primary sensor data. The dashboard is integrated with a machine-learning model to obtain temporal and geo-spatial air quality predictions.
  arXiv  Detail & Related papers  (2021-11-28T12:13:30Z)
• Federated Learning in the Sky: Aerial-Ground Air Quality Sensing Framework with UAV Swarms [53.38353133198842]
  Air quality significantly affects human health, it is increasingly important to accurately and timely predict the Air Quality Index (AQI) This paper proposes a new federated learning-based aerial-ground air quality sensing framework for fine-grained 3D air quality monitoring and forecasting. For ground sensing systems, we propose a Graph Convolutional neural network-based Long Short-Term Memory (GC-LSTM) model to achieve accurate, real-time and future AQI inference.
  arXiv  Detail & Related papers  (2020-07-23T13:32:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.