Learning to Substitute Ingredients in Recipes
- URL: http://arxiv.org/abs/2302.07960v1
- Date: Wed, 15 Feb 2023 21:49:23 GMT
- Title: Learning to Substitute Ingredients in Recipes
- Authors: Bahare Fatemi, Quentin Duval, Rohit Girdhar, Michal Drozdzal, Adriana
Romero-Soriano
- Abstract summary: Recipe personalization through ingredient substitution has the potential to help people meet their dietary needs and preferences, avoid potential allergens, and ease culinary exploration in everyone's kitchen.
We build a benchmark, composed of a dataset of substitution pairs with standardized splits, evaluation metrics, and baselines.
We introduce Graph-based Ingredient Substitution Module (GISMo), a novel model that leverages the context of a recipe as well as generic ingredient relational information encoded within a graph to rank plausible substitutions.
We show through comprehensive experimental validation that GISMo surpasses the best performing baseline by a large margin in terms of mean reciprocal rank.
- Score: 15.552549060863523
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Recipe personalization through ingredient substitution has the potential to
help people meet their dietary needs and preferences, avoid potential
allergens, and ease culinary exploration in everyone's kitchen. To address
ingredient substitution, we build a benchmark, composed of a dataset of
substitution pairs with standardized splits, evaluation metrics, and baselines.
We further introduce Graph-based Ingredient Substitution Module (GISMo), a
novel model that leverages the context of a recipe as well as generic
ingredient relational information encoded within a graph to rank plausible
substitutions. We show through comprehensive experimental validation that GISMo
surpasses the best performing baseline by a large margin in terms of mean
reciprocal rank. Finally, we highlight the benefits of GISMo by integrating it
in an improved image-to-recipe generation pipeline, enabling recipe
personalization through user intervention. Quantitative and qualitative results
show the efficacy of our proposed system, paving the road towards truly
personalized cooking and tasting experiences.
Related papers
- Enhancing Personalized Recipe Recommendation Through Multi-Class Classification [0.0]
The problem domain involves recipe recommendations, utilizing techniques such as association analysis and classification.
The paper seeks not only to recommend recipes but also to explore the process involved in achieving accurate and personalized recommendations.
arXiv Detail & Related papers (2024-09-16T13:21:09Z) - RoDE: Linear Rectified Mixture of Diverse Experts for Food Large Multi-Modal Models [96.43285670458803]
Uni-Food is a unified food dataset that comprises over 100,000 images with various food labels.
Uni-Food is designed to provide a more holistic approach to food data analysis.
We introduce a novel Linear Rectification Mixture of Diverse Experts (RoDE) approach to address the inherent challenges of food-related multitasking.
arXiv Detail & Related papers (2024-07-17T16:49:34Z) - A topological analysis of the space of recipes [0.0]
We introduce the use of topological data analysis, especially persistent homology, in order to study the space of culinary recipes.
In particular, persistent homology analysis provides a set of recipes surrounding the multiscale "holes" in the space of existing recipes.
arXiv Detail & Related papers (2024-06-12T01:28:16Z) - FIRE: Food Image to REcipe generation [10.45344523054623]
Food computing aims to develop end-to-end intelligent systems capable of autonomously producing recipe information for a food image.
This paper proposes FIRE, a novel methodology tailored to recipe generation in the food computing domain.
We showcase two practical applications that can benefit from integrating FIRE with large language model prompting.
arXiv Detail & Related papers (2023-08-28T08:14:20Z) - Counterfactual Recipe Generation: Exploring Compositional Generalization
in a Realistic Scenario [60.20197771545983]
We design the counterfactual recipe generation task, which asks models to modify a base recipe according to the change of an ingredient.
We collect a large-scale recipe dataset in Chinese for models to learn culinary knowledge.
Results show that existing models have difficulties in modifying the ingredients while preserving the original text style, and often miss actions that need to be adjusted.
arXiv Detail & Related papers (2022-10-20T17:21:46Z) - RecipeMind: Guiding Ingredient Choices from Food Pairing to Recipe
Completion using Cascaded Set Transformer [15.170251924099807]
RecipeMind is a food affinity score prediction model that quantifies the suitability of adding an ingredient to set of other ingredients.
We constructed a large-scale dataset containing ingredient co-occurrence based scores to train and evaluate RecipeMind on food affinity score prediction.
arXiv Detail & Related papers (2022-10-14T06:35:49Z) - Cross-lingual Adaptation for Recipe Retrieval with Mixup [56.79360103639741]
Cross-modal recipe retrieval has attracted research attention in recent years, thanks to the availability of large-scale paired data for training.
This paper studies unsupervised domain adaptation for image-to-recipe retrieval, where recipes in source and target domains are in different languages.
A novel recipe mixup method is proposed to learn transferable embedding features between the two domains.
arXiv Detail & Related papers (2022-05-08T15:04:39Z) - Learning Structural Representations for Recipe Generation and Food
Retrieval [101.97397967958722]
We propose a novel framework of Structure-aware Generation Network (SGN) to tackle the food recipe generation task.
Our proposed model can produce high-quality and coherent recipes, and achieve the state-of-the-art performance on the benchmark Recipe1M dataset.
arXiv Detail & Related papers (2021-10-04T06:36:31Z) - Revamping Cross-Modal Recipe Retrieval with Hierarchical Transformers
and Self-supervised Learning [17.42688184238741]
Cross-modal recipe retrieval has recently gained substantial attention due to the importance of food in people's lives.
We propose a simplified end-to-end model based on well established and high performing encoders for text and images.
Our proposed method achieves state-of-the-art performance in the cross-modal recipe retrieval task on the Recipe1M dataset.
arXiv Detail & Related papers (2021-03-24T10:17:09Z) - Multi-modal Cooking Workflow Construction for Food Recipes [147.4435186953995]
We build MM-ReS, the first large-scale dataset for cooking workflow construction.
We propose a neural encoder-decoder model that utilizes both visual and textual information to construct the cooking workflow.
arXiv Detail & Related papers (2020-08-20T18:31:25Z) - Decomposing Generation Networks with Structure Prediction for Recipe
Generation [142.047662926209]
We propose a novel framework: Decomposing Generation Networks (DGN) with structure prediction.
Specifically, we split each cooking instruction into several phases, and assign different sub-generators to each phase.
Our approach includes two novel ideas: (i) learning the recipe structures with the global structure prediction component and (ii) producing recipe phases in the sub-generator output component based on the predicted structure.
arXiv Detail & Related papers (2020-07-27T08:47:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.