SHARE: a System for Hierarchical Assistive Recipe Editing
- URL: http://arxiv.org/abs/2105.08185v1
- Date: Mon, 17 May 2021 22:38:07 GMT
- Title: SHARE: a System for Hierarchical Assistive Recipe Editing
- Authors: Shuyang Li, Yufei Li, Jianmo Ni, Julian McAuley
- Abstract summary: We introduce SHARE: a System for Hierarchical Assistive Recipe Editing to assist home cooks with dietary restrictions.
Our hierarchical recipe editor makes necessary substitutions to a recipe's ingredients list and re-writes the directions to make use of the new ingredients.
We introduce the novel RecipePairs dataset of 84K pairs of similar recipes in which one recipe satisfies one of seven dietary constraints.
- Score: 5.508365014509761
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: We introduce SHARE: a System for Hierarchical Assistive Recipe Editing to
assist home cooks with dietary restrictions -- a population under-served by
existing cooking resources. Our hierarchical recipe editor makes necessary
substitutions to a recipe's ingredients list and re-writes the directions to
make use of the new ingredients. We introduce the novel RecipePairs dataset of
84K pairs of similar recipes in which one recipe satisfies one of seven dietary
constraints, allowing for supervised training of such recipe editing models.
Experiments on this dataset demonstrate that our system produces convincing,
coherent recipes that are appropriate for a target dietary constraint (contain
no prohibited ingredients). We show that this is a challenging task that cannot
be adequately solved with human-written ingredient substitution rules or
straightforward adaptation of state-of-the-art models for recipe generation. We
further demonstrate through human evaluations and real-world cooking trials
that recipes edited by our system can be easily followed by home cooks to
create delicious and satisfactory dishes.
Related papers
- Large Language Models as Sous Chefs: Revising Recipes with GPT-3 [56.7155146252028]
We focus on recipes as an example of complex, diverse, and widely used instructions.
We develop a prompt grounded in the original recipe and ingredients list that breaks recipes down into simpler steps.
We also contribute an Amazon Mechanical Turk task that is carefully designed to reduce fatigue while collecting human judgment of the quality of recipe revisions.
arXiv Detail & Related papers (2023-06-24T14:42:43Z) - A Graphical Formalism for Commonsense Reasoning with Recipes [3.271550784789976]
We propose a graphical formalization that captures the comestibles (ingredients, intermediate food items, and final products)
We then propose formal definitions for comparing recipes, for composing recipes from subrecipes, and for deconstructing recipes into subrecipes.
We also introduce and compare two formal definitions for substitution into recipes which are required when there are missing ingredients, or some actions are not possible, or because there is a need to change the final product somehow.
arXiv Detail & Related papers (2023-06-15T11:04:30Z) - Counterfactual Recipe Generation: Exploring Compositional Generalization
in a Realistic Scenario [60.20197771545983]
We design the counterfactual recipe generation task, which asks models to modify a base recipe according to the change of an ingredient.
We collect a large-scale recipe dataset in Chinese for models to learn culinary knowledge.
Results show that existing models have difficulties in modifying the ingredients while preserving the original text style, and often miss actions that need to be adjusted.
arXiv Detail & Related papers (2022-10-20T17:21:46Z) - RecipeMind: Guiding Ingredient Choices from Food Pairing to Recipe
Completion using Cascaded Set Transformer [15.170251924099807]
RecipeMind is a food affinity score prediction model that quantifies the suitability of adding an ingredient to set of other ingredients.
We constructed a large-scale dataset containing ingredient co-occurrence based scores to train and evaluate RecipeMind on food affinity score prediction.
arXiv Detail & Related papers (2022-10-14T06:35:49Z) - Assistive Recipe Editing through Critiquing [34.1050269670062]
RecipeCrit is a hierarchical denoising auto-encoder that edits recipes given ingredient-level critiques.
Our work's main innovation is our unsupervised critiquing module that allows users to edit recipes by interacting with the predicted ingredients.
arXiv Detail & Related papers (2022-05-05T05:52:27Z) - Learning Structural Representations for Recipe Generation and Food
Retrieval [101.97397967958722]
We propose a novel framework of Structure-aware Generation Network (SGN) to tackle the food recipe generation task.
Our proposed model can produce high-quality and coherent recipes, and achieve the state-of-the-art performance on the benchmark Recipe1M dataset.
arXiv Detail & Related papers (2021-10-04T06:36:31Z) - Revamping Cross-Modal Recipe Retrieval with Hierarchical Transformers
and Self-supervised Learning [17.42688184238741]
Cross-modal recipe retrieval has recently gained substantial attention due to the importance of food in people's lives.
We propose a simplified end-to-end model based on well established and high performing encoders for text and images.
Our proposed method achieves state-of-the-art performance in the cross-modal recipe retrieval task on the Recipe1M dataset.
arXiv Detail & Related papers (2021-03-24T10:17:09Z) - Structure-Aware Generation Network for Recipe Generation from Images [142.047662926209]
We investigate an open research task of generating cooking instructions based on only food images and ingredients.
Target recipes are long-length paragraphs and do not have annotations on structure information.
We propose a novel framework of Structure-aware Generation Network (SGN) to tackle the food recipe generation task.
arXiv Detail & Related papers (2020-09-02T10:54:25Z) - Multi-modal Cooking Workflow Construction for Food Recipes [147.4435186953995]
We build MM-ReS, the first large-scale dataset for cooking workflow construction.
We propose a neural encoder-decoder model that utilizes both visual and textual information to construct the cooking workflow.
arXiv Detail & Related papers (2020-08-20T18:31:25Z) - Decomposing Generation Networks with Structure Prediction for Recipe
Generation [142.047662926209]
We propose a novel framework: Decomposing Generation Networks (DGN) with structure prediction.
Specifically, we split each cooking instruction into several phases, and assign different sub-generators to each phase.
Our approach includes two novel ideas: (i) learning the recipe structures with the global structure prediction component and (ii) producing recipe phases in the sub-generator output component based on the predicted structure.
arXiv Detail & Related papers (2020-07-27T08:47:50Z) - RecipeGPT: Generative Pre-training Based Cooking Recipe Generation and
Evaluation System [29.150333060513177]
We present RecipeGPT, a novel online recipe generation and evaluation system.
System provides two modes of text generations: instruction generation from given recipe title and ingredients; and ingredient generation from recipe title and cooking instructions.
Back-end text generation module comprises a generative pre-trained language model GPT-2 fine-tuned on a large cooking recipe dataset.
arXiv Detail & Related papers (2020-03-05T09:25:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.