Sequential Gallery for Interactive Visual Design Optimization

• URL: http://arxiv.org/abs/2005.04107v1
• Date: Fri, 8 May 2020 15:24:35 GMT
• Title: Sequential Gallery for Interactive Visual Design Optimization
• Authors: Yuki Koyama, Issei Sato, Masataka Goto
• Abstract summary: We propose a novel user-in-the-loop optimization method that allows users to efficiently find an appropriate parameter set. We also propose using a gallery-based interface that provides options in the two-dimensional subspace arranged in an adaptive grid view. Our experiment with synthetic functions shows that our sequential plane search can find satisfactory solutions in fewer iterations than baselines.
• Score: 51.52002870143971
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Visual design tasks often involve tuning many design parameters. For example, color grading of a photograph involves many parameters, some of which non-expert users might be unfamiliar with. We propose a novel user-in-the-loop optimization method that allows users to efficiently find an appropriate parameter set by exploring such a high-dimensional design space through much easier two-dimensional search subtasks. This method, called sequential plane search, is based on Bayesian optimization to keep necessary queries to users as few as possible. To help users respond to plane-search queries, we also propose using a gallery-based interface that provides options in the two-dimensional subspace arranged in an adaptive grid view. We call this interactive framework Sequential Gallery since users sequentially select the best option from the options provided by the interface. Our experiment with synthetic functions shows that our sequential plane search can find satisfactory solutions in fewer iterations than baselines. We also conducted a preliminary user study, results of which suggest that novices can effectively complete search tasks with Sequential Gallery in a photo-enhancement scenario.

Related papers

• SwipeGANSpace: Swipe-to-Compare Image Generation via Efficient Latent Space Exploration [3.864321514889098]
  We propose a novel approach that uses simple user-swipe interactions to generate preferred images for users. To effectively explore the latent space with only swipe interactions, we apply principal component analysis to the latent space of the StyleGAN. We use a multi-armed bandit algorithm to decide the dimensions to explore, focusing on the preferences of the user.
  arXiv  Detail & Related papers  (2024-04-30T16:37:27Z)
• Ada-Retrieval: An Adaptive Multi-Round Retrieval Paradigm for Sequential Recommendations [50.03560306423678]
  We propose Ada-Retrieval, an adaptive multi-round retrieval paradigm for recommender systems. Ada-Retrieval iteratively refines user representations to better capture potential candidates in the full item space.
  arXiv  Detail & Related papers  (2024-01-12T15:26:40Z)
• The Contemporary Art of Image Search: Iterative User Intent Expansion via Vision-Language Model [4.531548217880843]
  We introduce an innovative user intent expansion framework for image search. Our framework leverages visual-language models to parse and compose multi-modal user inputs. The proposed framework significantly improves users' image search experience.
  arXiv  Detail & Related papers  (2023-12-04T06:14:25Z)
• Self-supervised Multi-view Disentanglement for Expansion of Visual Collections [6.944742823561]
  We consider the setting where a query for similar images is derived from a collection of images. For visual search, the similarity measurements may be made along multiple axes, or views, such as style and color. Our objective is to design a retrieval algorithm that effectively combines similarities computed over representations from multiple views.
  arXiv  Detail & Related papers  (2023-02-04T22:09:17Z)
• Experimental Design for Multi-Channel Imaging via Task-Driven Feature Selection [2.662628670752034]
  We present a new paradigm for experimental design that simultaneously optimize the design (set of image channels) and trains a machine-learning model to execute a user-specified image-analysis task. Results show substantial improvement over classical experimental design, two recent application-specific methods within the new paradigm, and state-of-the-art approaches in supervised feature selection.
  arXiv  Detail & Related papers  (2022-10-13T10:36:24Z)
• Efficient Non-Parametric Optimizer Search for Diverse Tasks [93.64739408827604]
  We present the first efficient scalable and general framework that can directly search on the tasks of interest. Inspired by the innate tree structure of the underlying math expressions, we re-arrange the spaces into a super-tree. We adopt an adaptation of the Monte Carlo method to tree search, equipped with rejection sampling and equivalent- form detection.
  arXiv  Detail & Related papers  (2022-09-27T17:51:31Z)
• iFacetSum: Coreference-based Interactive Faceted Summarization for Multi-Document Exploration [63.272359227081836]
  iFacetSum integrates interactive summarization together with faceted search. Fine-grained facets are automatically produced based on cross-document coreference pipelines.
  arXiv  Detail & Related papers  (2021-09-23T20:01:11Z)
• AutoSTR: Efficient Backbone Search for Scene Text Recognition [80.7290173000068]
  Scene text recognition (STR) is very challenging due to the diversity of text instances and the complexity of scenes. We propose automated STR (AutoSTR) to search data-dependent backbones to boost text recognition performance. Experiments demonstrate that, by searching data-dependent backbones, AutoSTR can outperform the state-of-the-art approaches on standard benchmarks.
  arXiv  Detail & Related papers  (2020-03-14T06:51:04Z)
• Human Preference-Based Learning for High-dimensional Optimization of Exoskeleton Walking Gaits [55.59198568303196]
  This work presents LineCoSpar, a human-in-the-loop preference-based framework to learn user preferences in high dimensions. In simulations and human trials, we empirically verify that LineCoSpar is a sample-efficient approach for high-dimensional preference optimization. This result has implications for exoskeleton gait synthesis, an active field with applications to clinical use and patient rehabilitation.
  arXiv  Detail & Related papers  (2020-03-13T22:02:15Z)
• Using Image Captions and Multitask Learning for Recommending Query Reformulations [11.99358906295761]
  We aim to enhance the query recommendation experience for a commercial image search engine. Our proposed methodology incorporates current state-of-the-art practices from relevant literature.
  arXiv  Detail & Related papers  (2020-03-02T08:22:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.