Introducing the Swiss Food Knowledge Graph: AI for Context-Aware Nutrition Recommendation
- URL: http://arxiv.org/abs/2507.10156v1
- Date: Mon, 14 Jul 2025 11:12:30 GMT
- Title: Introducing the Swiss Food Knowledge Graph: AI for Context-Aware Nutrition Recommendation
- Authors: Lubnaa Abdur Rahman, Ioannis Papathanail, Stavroula Mougiakakou,
- Abstract summary: We introduce the Swiss Food Knowledge Graph (SwissFKG), the first resource to unite recipes, ingredients, and their substitutions with nutrient data, dietary restrictions, allergen information, and national nutrition guidelines under one graph.<n>Our work lays the foundation for the next generation of dietary assessment tools that blend visual, contextual, and cultural dimensions of eating.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: AI has driven significant progress in the nutrition field, especially through multimedia-based automatic dietary assessment. However, existing automatic dietary assessment systems often overlook critical non-visual factors, such as recipe-specific ingredient substitutions that can significantly alter nutritional content, and rarely account for individual dietary needs, including allergies, restrictions, cultural practices, and personal preferences. In Switzerland, while food-related information is available, it remains fragmented, and no centralized repository currently integrates all relevant nutrition-related aspects within a Swiss context. To bridge this divide, we introduce the Swiss Food Knowledge Graph (SwissFKG), the first resource, to our best knowledge, to unite recipes, ingredients, and their substitutions with nutrient data, dietary restrictions, allergen information, and national nutrition guidelines under one graph. We establish a LLM-powered enrichment pipeline for populating the graph, whereby we further present the first benchmark of four off-the-shelf (<70 B parameter) LLMs for food knowledge augmentation. Our results demonstrate that LLMs can effectively enrich the graph with relevant nutritional information. Our SwissFKG goes beyond recipe recommendations by offering ingredient-level information such as allergen and dietary restriction information, and guidance aligned with nutritional guidelines. Moreover, we implement a Graph-RAG application to showcase how the SwissFKG's rich natural-language data structure can help LLM answer user-specific nutrition queries, and we evaluate LLM-embedding pairings by comparing user-query responses against predefined expected answers. As such, our work lays the foundation for the next generation of dietary assessment tools that blend visual, contextual, and cultural dimensions of eating.
Related papers
- KERL: Knowledge-Enhanced Personalized Recipe Recommendation using Large Language Models [17.705244174235045]
Recent advances in large language models (LLMs) and the abundance of food data have resulted in studies to improve food understanding.<n>We introduce KERL, a unified system that leverages food KGs and LLMs to provide personalized food recommendations.<n>We show that our proposed KG-augmented LLM significantly outperforms existing approaches.
arXiv Detail & Related papers (2025-05-20T17:19:57Z) - Advancing Food Nutrition Estimation via Visual-Ingredient Feature Fusion [69.84988999191343]
We introduce FastFood, a dataset with 84,446 images across 908 fast food categories, featuring ingredient and nutritional annotations.<n>We propose a new model-agnostic Visual-Ingredient Feature Fusion (VIF$2$) method to enhance nutrition estimation.
arXiv Detail & Related papers (2025-05-13T17:01:21Z) - MOPI-HFRS: A Multi-objective Personalized Health-aware Food Recommendation System with LLM-enhanced Interpretation [50.309987904297415]
Major food recommendation platforms such as Yelp prioritize users' dietary preferences over the healthiness of their choices.<n>We develop a novel framework, Multi-Objective Personalized Interpretable Health-aware Food Recommendation System (MOPI-HFRS)<n>It provides food recommendations by jointly optimizing the three objectives: user preference, personalized healthiness and nutritional diversity, along with a large language model (LLM)-enhanced reasoning module.
arXiv Detail & Related papers (2024-12-12T01:02:09Z) - Enhancing FKG.in: automating Indian food composition analysis [2.180451315432493]
This paper presents a novel approach to compute food composition data for Indian recipes using a knowledge graph.<n>The workflow aims to complement FKG.in and iteratively supplement food composition data from verified knowledge bases.<n>It briefly outlines how users can interact with the workflow to obtain diet-based health recommendations.
arXiv Detail & Related papers (2024-12-06T18:27:15Z) - RoDE: Linear Rectified Mixture of Diverse Experts for Food Large Multi-Modal Models [96.43285670458803]
Uni-Food is a unified food dataset that comprises over 100,000 images with various food labels.<n>Uni-Food is designed to provide a more holistic approach to food data analysis.<n>We introduce a novel Linear Rectification Mixture of Diverse Experts (RoDE) approach to address the inherent challenges of food-related multitasking.
arXiv Detail & Related papers (2024-07-17T16:49:34Z) - NutriBench: A Dataset for Evaluating Large Language Models on Nutrition Estimation from Meal Descriptions [6.223619389512576]
NutriBench is the first publicly available natural language meal description nutrition benchmark.<n>It consists of 11,857 meal descriptions generated from real-world global dietary intake data.<n>The data is human-verified and annotated with macro-nutrient labels, including carbohydrates, proteins, fats, and calories.
arXiv Detail & Related papers (2024-07-04T15:10:51Z) - FoodSky: A Food-oriented Large Language Model that Passes the Chef and Dietetic Examination [37.11551779015218]
We introduce Food-oriented Large Language Models (LLMs) to comprehend food data through perception and reasoning.
Considering the complexity and typicality of Chinese cuisine, we first construct one comprehensive Chinese food corpus FoodEarth.
We then propose Topic-based Selective State Space Model (TS3M) and the Hierarchical Topic Retrieval Augmented Generation (HTRAG) mechanism to enhance FoodSky.
arXiv Detail & Related papers (2024-06-11T01:27:00Z) - NutritionVerse-Real: An Open Access Manually Collected 2D Food Scene
Dataset for Dietary Intake Estimation [68.49526750115429]
We introduce NutritionVerse-Real, an open access manually collected 2D food scene dataset for dietary intake estimation.
The NutritionVerse-Real dataset was created by manually collecting images of food scenes in real life, measuring the weight of every ingredient and computing the associated dietary content of each dish.
arXiv Detail & Related papers (2023-11-20T11:05:20Z) - UMDFood: Vision-language models boost food composition compilation [26.5694236976957]
We propose a novel vision-language model, UMDFood-VL, using front-of-package labeling and product images to accurately estimate food composition profiles.
Up to 82.2% of selected products' estimated error between chemical analysis results and model estimation results are less than 10%.
This performance sheds light on generalization towards other food and nutrition-related data compilation and catalyzation.
arXiv Detail & Related papers (2023-05-18T03:18:12Z) - Towards the Creation of a Nutrition and Food Group Based Image Database [58.429385707376554]
We propose a framework to create a nutrition and food group based image database.
We design a protocol for linking food group based food codes in the U.S. Department of Agriculture's (USDA) Food and Nutrient Database for Dietary Studies (FNDDS)
Our proposed method is used to build a nutrition and food group based image database including 16,114 food datasets.
arXiv Detail & Related papers (2022-06-05T02:41:44Z) - Towards Building a Food Knowledge Graph for Internet of Food [66.57235827087092]
We review the evolution of food knowledge organization, from food classification to food to food knowledge graphs.
Food knowledge graphs play an important role in food search and Question Answering (QA), personalized dietary recommendation, food analysis and visualization.
Future directions for food knowledge graphs cover several fields such as multimodal food knowledge graphs and food intelligence.
arXiv Detail & Related papers (2021-07-13T06:26:53Z) - Personalized Food Recommendation as Constrained Question Answering over
a Large-scale Food Knowledge Graph [16.58534326000209]
We propose a novel problem formulation for food recommendation, modeling this task as constrained question answering over a large-scale food knowledge base/graph (KBQA)
Besides the requirements from the user query, personalized requirements from the user's dietary preferences and health guidelines are handled in a unified way.
Our approach significantly outperforms non-personalized counterparts.
arXiv Detail & Related papers (2021-01-05T20:38:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.