ComfySearch: Autonomous Exploration and Reasoning for ComfyUI Workflows
- URL: http://arxiv.org/abs/2601.04060v1
- Date: Wed, 07 Jan 2026 16:24:01 GMT
- Title: ComfySearch: Autonomous Exploration and Reasoning for ComfyUI Workflows
- Abstract summary: ComfySearch is an agentic framework that can effectively explore the component space and generate functional ComfyUI pipelines.<n> Experiments demonstrate that ComfySearch substantially outperforms existing methods on complex and creative tasks.
- Score: 19.457904539789663
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: AI-generated content has progressed from monolithic models to modular workflows, especially on platforms like ComfyUI, allowing users to customize complex creative pipelines. However, the large number of components in ComfyUI and the difficulty of maintaining long-horizon structural consistency under strict graph constraints frequently lead to low pass rates and workflows of limited quality. To tackle these limitations, we present ComfySearch, an agentic framework that can effectively explore the component space and generate functional ComfyUI pipelines via validation-guided workflow construction. Experiments demonstrate that ComfySearch substantially outperforms existing methods on complex and creative tasks, achieving higher executability (pass) rates, higher solution rates, and stronger generalization.
Related papers
- Knowledge-Centric Agents for Workflow Generation [73.4340391112949]
We propose a knowledge-centric framework that learns to invert, inject, and infer with knowledge across multiple abstraction levels.<n>Our method produces with richer node diversity, more coherent structures, and higher execution success rates than existing systems.
arXiv Detail & Related papers (2026-07-17T11:03:01Z) - CoStream: Composing Simple Behaviors for Generalizable Complex Manipulation [61.25264898597319]
We show that complex manipulation capabilities can emerge naturally from the composition of simple, independent behaviors.<n>We propose CoStream, a framework orchestrating foundation models and diverse sensing modalities into multiple composable core behaviors.<n>We demonstrate CoStream on 8 real-world tasks spanning everyday manipulation and precision assembly, with the strongest gains in contact-rich assembly and object transfer.
arXiv Detail & Related papers (2026-06-24T22:25:19Z) - Coupled Hierarchical Search over Topology and Execution for Agentic Workflow Synthesis [64.2820121997882]
We introduce HierFlow, a training-free, test-time hierarchical search architecture that automates agentic workflow design.<n> HierFlow maximizes efficiency through an intelligent gating module that selectively triggers execution-level searches based on contextual necessity.<n> Comprehensive testing across question answering, mathematical reasoning, and code generation benchmarks confirms that HierFlow consistently outperforms strong baselines.
arXiv Detail & Related papers (2026-05-20T01:56:11Z) - MiroFlow: Towards High-Performance and Robust Open-Source Agent Framework for General Deep Research Tasks [95.86122998005612]
MiroFlow is an open-source agent framework for large language models (LLMs)<n>It incorporates an agent graph for flexible orchestration, an optional deep reasoning mode to enhance performance, and a robust execution to ensure stable and reproducible performance.<n>It consistently achieves state-of-the-art performance across multiple agent benchmarks, including GAIA, BrowseComp-EN/ZH, HLE, xBench-DeepSearch, and FutureX.
arXiv Detail & Related papers (2026-02-26T09:45:04Z) - Iterative Structured Pruning for Large Language Models with Multi-Domain Calibration [73.40887151631088]
Large Language Models (LLMs) have achieved remarkable success across a wide spectrum of natural language processing tasks.<n>Their ever-growing scale introduces significant barriers to real-world deployment, including substantial computational overhead, memory footprint, and inference latency.<n>In this work, we explore structured pruning, which eliminates entire architectural components and maintains compatibility with standard hardware accelerators.
arXiv Detail & Related papers (2026-01-06T03:09:31Z) - DyFlow: Dynamic Workflow Framework for Agentic Reasoning [79.19799197382478]
DyFlow is a dynamic workflow generation framework that adaptively constructs and adjusts reasoning procedures based on task requirements and real-time intermediate feedback.<n>We systematically evaluate DyFlow across diverse domains, including social reasoning, biomedical tasks, mathematical problem solving, and code generation.<n>Results demonstrate that DyFlow significantly outperforms existing baselines, achieving substantial Pass@k improvements and exhibiting robust generalization across diverse domains.
arXiv Detail & Related papers (2025-09-30T10:36:23Z) - ComfyUI-R1: Exploring Reasoning Models for Workflow Generation [49.09090292453288]
We introduce ComfyUI-R1, first large reasoning model for automated workflow generation.<n>We construct long chain-of-thought (CoT) reasoning data, including node selection, workflow planning, and code-level workflow.<n> Experiments show that our 7B- parameter model achieves a 97% format validity rate, along with high pass rate, node-level and graph-level F1 scores.
arXiv Detail & Related papers (2025-06-11T14:35:15Z) - EIFBENCH: Extremely Complex Instruction Following Benchmark for Large Language Models [64.70546873396624]
We present the Extremely Complex Instruction Following Benchmark (EIFBENCH) for evaluating large language models (LLMs)<n>EIFBENCH includes multi-task scenarios that enable comprehensive assessment across diverse task types concurrently.<n>We also propose the Segment Policy Optimization (SegPO) algorithm to enhance the LLM's ability to accurately fulfill multi-task workflow.
arXiv Detail & Related papers (2025-06-10T02:39:55Z) - ComfyUI-Copilot: An Intelligent Assistant for Automated Workflow Development [45.78818581469798]
ComfyUI-Copilot is a large language model-powered plugin for ComfyUI.<n>It offers intelligent node and model recommendations, along with automated one-click workflow construction.<n>We validate the effectiveness of ComfyUI-Copilot through both offline quantitative evaluations and online user feedback.
arXiv Detail & Related papers (2025-06-05T13:20:50Z) - ComfyMind: Toward General-Purpose Generation via Tree-Based Planning and Reactive Feedback [15.363560226232668]
We present ComfyMind, a collaborative AI system designed to enable robust and scalable general-purpose generation.<n>ComfyMind introduces two core innovations: Semantic Interface (SWI) that abstracts low-level node graphs into callable functional language, and Search Tree Planning mechanism.<n>We evaluate ComfyMind on three public benchmarks: ComfyBench, GenEval, and Reason-Edit, which span generation, editing, and reasoning tasks.
arXiv Detail & Related papers (2025-05-23T13:53:03Z) - Flow State: Humans Enabling AI Systems to Program Themselves [0.24578723416255752]
We introduce Pocketflow, a platform centered on Human-AI co-design.<n>Pocketflow is a Python framework built upon a deliberately minimal yet synergistic set of core abstractions.<n>It provides a robust, vendor-agnostic foundation with very little code that demonstrably reduces overhead.
arXiv Detail & Related papers (2025-04-03T05:25:46Z) - EpiCoder: Encompassing Diversity and Complexity in Code Generation [66.43738008739555]
Existing methods for code generation use code snippets as seed data.<n>We introduce a novel feature tree-based synthesis framework, which revolves around hierarchical code features.<n>Our framework provides precise control over the complexity of the generated code, enabling functionalities that range from function-level operations to multi-file scenarios.
arXiv Detail & Related papers (2025-01-08T18:58:15Z) - Large Language Models to the Rescue: Reducing the Complexity in
Scientific Workflow Development Using ChatGPT [11.410608233274942]
Scientific systems are increasingly popular for expressing and executing complex data analysis pipelines over large datasets.
However, implementing is difficult due to the involvement of many blackbox tools and the deep infrastructure stack necessary for their execution.
We investigate the efficiency of Large Language Models, specifically ChatGPT, to support users when dealing with scientific domains.
arXiv Detail & Related papers (2023-11-03T10:28:53Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.