FuguReport
Browse the latest weekly themes first, then scan the most recent daily reports and archives.
2026-08-14 - 2026-08-20
Benchmarks for Interactive Models and Agents
This week's theme centers on moving model evaluation beyond narrow offline metrics toward executable, task-grounded benchmarks for embodied world models and multimodal GUI agents.
Theme 2Geometry-Aware 3D Reconstruction and Generation
This theme concerns making visual generation and reconstruction explicitly grounded in geometry, camera parameters, and scene structure.
Theme 3Scalable General-Purpose Reinforcement Learning
This week's reinforcement learning work focuses on making RL systems more general, computationally efficient, and stable under demanding training regimes.
Recent Daily Reports
Glass Surface Detection Grounded in 3D Visual Geometry
This paper reframes glass surface detection as a 3D visual geometry-grounded task rather than relying predominantly on 2D appearance cues.
PAWBench: How Far Are We from Probabilistically Aligned World Modeling?
This paper argues that evaluating video generators as visual world models requires assessing the distribution of possible futures under a fixed observation and action, rather than judging only single-rollout plausibility.
TTPO: Test-Time Policy Optimization
This paper introduces Test-Time Policy Optimization (TTPO), a label-free test-time training method for mathematical reasoning models.
TrapVLA: Trapping Vision-Language-Action Models in Configured Failure Modes
This paper studies a new backdoor attack setting for Vision-Language-Action models called Configured Failure Trapping, where a stealthy textual trigger causes a robot to fail in a specific, preconfigured way rather than simply fail arbitrarily.
Self-OPD: On-Policy Distillation for Flow Matching Models without Teacher
This paper presents Self-OPD, a teacher-free on-policy distillation framework for flow matching models.
VoiceMem: Streaming Dual-Brain Memory for Real-Time Interaction
VoiceMem is a memory architecture for real-time spoken interaction that separates memory into a factual "left brain" and an affective/persona-oriented "right brain," connected through streaming memory I/O.
JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolution
This paper presents JIT-Agent, a model trained to generate task-adaptive agent harnesses on demand rather than relying on a fixed, manually engineered scaffold.
Video-IFBench: Evaluating Instruction Following of Multimodal LLMs in Video Understanding Scenarios
Video-IFBench is a benchmark designed to evaluate how well multimodal large language models follow instructions in video understanding settings, rather than only measuring answer correctness.
V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learning
This paper studies visual faithfulness in vision-language model post-training and frames the problem as a credit-assignment issue rather than only an evaluation issue.
Zero-WAM: In-Context World-Action Modeling from Human Videos for Open-Ended Task Generalization
This paper frames zero-shot cross-task robotic manipulation as an in-context learning problem, where an unseen task is specified at deployment time by a human demonstration video rather than only by language.
StepGuard: Learning Step-Level Guardrails with Scalable Supervision and Safety-Utility Balancing
StepGuard is a 4B step-level guard model for LLM agents that supports both pre-execution checking of candidate tool actions and post-hoc auditing of completed trajectories.
Investigating Knowledge Transfer Across Interactive Dialogue Games
This paper studies how knowledge transfers across interactive dialogue games by fine-tuning a common LLM on tasks from the clembench suite and evaluating cross-task performance.
Ockhamareto: Pareto-Gated Segment-Level Credit Assignment for Concise Unit-Test Generation with Reinforcement Learning
Ockhamareto is a single-shot GRPO framework for generating complete unit-test suites while jointly optimizing fault-detection effectiveness and suite conciseness.
Speech-to-SOAP: End-to-End Summarization of Medical Dialogues: KIT@BeTraC 2026
This paper presents KIT's BeTraC 2026 lightweight-track system for generating SOAP clinical notes directly from medical dialogue audio.
MetaCaster: Meta-Harness-Optimized Agent for End-to-End Few-Shot Learning of Lightweight Time Series Forecasters
This paper studies few-shot learning for lightweight time series forecasters, targeting resource-constrained settings where large foundation models are too costly and only small support sets are available.
EarthVerse: Benchmarking Scientific Agents Across Dynamic Earth Systems and Natural Hazards
EarthVerse is a benchmark designed to evaluate scientific agents conducting multi-source investigations across dynamic Earth systems and natural hazards.
ReWorld: An Interactive World Model with Long-Horizon Memory
ReWorld is an interactive streaming world model designed to simultaneously follow user camera actions, preserve memory of previously visited places, and run in real time.
Scaling Reinforcement Learning for Diffusion Models via Velocity Matching
This paper argues that reward fine-tuning for diffusion models does not need likelihood-based policy-gradient machinery and instead can be formulated directly in the model's native velocity representation.
AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Traces
This paper presents AutoSaddler, a framework for automatically improving the external harness of LLM agents on long-horizon tasks.
EMPIRE: Explicit Manipulation Planning as a Learnable Intermediate Representation for Egocentric Hand-Motion Forecasting
EMPIRE is a two-stage framework for egocentric bimanual hand-motion forecasting that inserts an explicit manipulation plan between multimodal observation and motion generation.
Disagree to Explore, Agree to Commit: Routing-Guided Test-Time Scaling for Software Agents
This paper studies whether native mixture-of-experts (MoE) router traces can guide test-time scaling for software-engineering agents without using an external judge or running candidate patches for selection.
Coalition-Aware Skill Reliability for Self-Evolving Agents
This paper investigates whether skills stored in self-evolving LLM agents' skill banks make positive mechanistic contributions rather than merely improving aggregate outcome metrics.
Whitewashing Hate, Smearing Harmless Content: Annotator-Style Rebuttal Attacks on LLM-Based Moderation
This paper studies a post-decision attack surface in LLM-based hate speech moderation: fabricated annotator-style rebuttals that ask a model to reconsider an initially correct judgment.
DeepSAGE: Stage-Aware Reinforcement Learning for Structured CBT Counseling Dialogue
DeepSAGE is a hybrid LLM–DRL framework for conducting the first CBT counseling session as an explicit sequence of eleven stages, each with a therapeutic objective and automated stage-completion criterion.
Autonomous Cyber Defense: Real-Time Attack Detection and Mitigation in Software-Defined Networks Using Machine Learning
This paper presents an automated cyber defense system for software-defined networks that combines real-time traffic monitoring, machine-learning-based attack diagnosis, and automatic mitigation.
ORBIT++: Benchmarking SfM in the Wild with 360° Video
This paper presents ORBIT++, an updated version of the ORBIT benchmark for evaluating structure-from-motion and camera pose estimation on difficult real-world videos derived from online 360° footage.
Revisiting N2DCG: An Empirically Grounded Reformulation of Carousel Recommendation Evaluation
This paper re-examines N2DCG, a two-dimensional adaptation of NDCG for carousel recommendation interfaces, and argues that the original formulation makes assumptions that do not hold in real carousel layouts.
Benchmarking Composable Compression Techniques in Mixture-of-Experts LLMs
This paper introduces MoE-XBench, a benchmark for evaluating compression in mixture-of-experts large language models as an end-to-end deployment workflow rather than as isolated steps.
Beyond Fresh Starts: Stateful Inference for Streaming ASR in Conversational Voice Agents
This paper analyzes how state handling in low-latency streaming ASR affects conversational voice agents, focusing on turn boundaries, long silences, and short backchannel turns.
Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence
This paper provides a comprehensive survey on how LLM-based systems are transitioning from single-agent individual intelligence to multi-component system intelligence to tackle complex, long-horizon tasks.
CIVA: Critic-Induced Value-Subspace Attacks on Visual World-Model Agents
This paper studies white-box, causal, online adversarial attacks against visual world-model agents, focusing on a frozen DreamerV3 victim.
FlatLand: Personalized Graph Federated Learning via Tailored Lorentz Space
FlatLand is a personalized federated learning method for graph data that places each client in a tailored Lorentz-space embedding rather than assuming a shared Euclidean geometry.
Beyond the Traceback: Using LLMs for Adaptive Explanations of Programming Errors
This paper studies whether LLM-rewritten Python error messages help programmers debug more effectively than standard interpreter output.
PhysCaP: Grounding Code-as-Policy Agent with Physics-Informed Exploration
PhysCaP is a physics-informed code-as-policy agent designed for active perception in robotic manipulation tasks where success depends on latent physical properties that cannot be inferred from vision alone.
VGI-BENCH: Probing Visual Intelligence in Video Generation Models
This paper introduces VGI-Bench, a benchmark for evaluating visual intelligence in video generation models through process-sensitive, visually grounded tasks.
Coupled Optimal Transport with Landmark Constraints
This paper addresses a limitation of standard optimal transport: minimizing transport cost alone may fail to identify a geometrically meaningful transformation between distributions.
Pandora's AI Model Routing Box: Efficient Allocation with Costly Value Estimation
This paper studies AI model routing when estimating each candidate specialist’s value is itself costly.
Rethinking the Evaluation and Optimization of LLM-Based Social Simulation
This paper argues that standard accuracy-based evaluation and hard-label training are poorly matched to LLM-based social simulation because human responses are inherently distributional rather than deterministic.
Listening Forward: Next Patch Embedding Prediction Enables Scalable Audio Learners
This paper introduces NAPE, a self-supervised audio learning framework in which a causal Transformer predicts the embedding of the next log-mel spectrogram patch from preceding patches.
DyG$^2$T: Modeling Object Dynamics with 3D Gaussian Temporal-Spatial Particle Graph Transformer
This paper presents DyG2T, a framework for predicting object motion from limited visual observations by combining dynamic 3D Gaussian reconstruction with dynamics modeling over downsampled key points.
VA-Judger: Reward Modeling from Human Preference Feedback for Joint Video-Audio Generation
This paper studies reward modeling for joint video-audio generation using human preference feedback rather than separate automatic metrics.
What is Missing from AI Post-Training AI: An Empirical Analysis
This paper investigates AI agents performing end-to-end post-training of large language models, distinguishing between execution-level capability (iterating within an established pipeline) and strategy-level capability (revising high-level paradigms and workflows based on evidence).
DocClaw: A Unified Agentic System for Intelligent Document Processing
DocClaw is a unified agentic system for intelligent document processing that frames OCR, document question answering, and key information extraction as iterative interactions between an agent and a document.
SkillGate: Training In-Policy Skill Selection in Long-Horizon Agents
This paper studies in-policy skill selection for long-horizon agents that must choose which skill file to read from a candidate slate during an episode.
ASI-Bench: At the Dawn of Artificial Superintelligence
ASI-Bench is a benchmark for evaluating whether AI systems can conduct project-level scientific research as human methodological guidance is progressively reduced.
HarnessRisk: A Lifecycle-Oriented Benchmark for Agent Harness Safety
This paper introduces HarnessRisk, a lifecycle-oriented benchmark for agent harness safety that organizes risks into six operational phases: Harness Configuration, Capability Extension, Runtime Operation, State Persistence, Action Control, and Incident Recovery.
Beyond the Trace: Coupling an Interpretable Reasoning-State Readout to Native MoE Routing
This paper introduces a two-level internal readout for mixture-of-experts reasoning models that aims to expose latent reasoning state beyond what is written in the generated trace.
Primitive-Driven Compositional Forensic Visual Prompting for Open-World Face Anti-Spoofing
This paper studies open-world face anti-spoofing, where models must handle both cross-domain shifts and previously unseen attack types.
Empowering Compact LLMs with Fusion of Layer-wise Exits for Recommendation
This paper studies scalable sequential recommendation with compact large language models under a discriminative, embedding-based ranking setup.
VicEdit: Learning to Edit Videos from Visual In-Context Examples
This paper introduces Visual In-context Editing, a video editing paradigm that supplements text instructions with visual examples in the form of a single image, an image pair, or a video pair.
Archive
Weekly Archive
15インタラクティブモデルとエージェントのためのベンチマーク
This week's theme centers on moving model evaluation beyond narrow offline metrics toward executable, task-grounded benchmarks for embodied world models and multimodal GUI agents.
幾何学を考慮した3D再構成と生成
This theme concerns making visual generation and reconstruction explicitly grounded in geometry, camera parameters, and scene structure.
スケーラブルな汎用強化学習
This week's reinforcement learning work focuses on making RL systems more general, computationally efficient, and stable under demanding training regimes.
科学LLMの評価と適応
This theme centers on how foundation models are being evaluated and improved for scientific and multimodal use, with emphasis on pretraining strategy, data realism, and efficient cross-modal design.
スパースニューラル表面再構成
This week's theme centers on making neural surface reconstruction both generalizable and efficient under sparse-view conditions.
自己進化型LLMマルチエージェントシステム
This theme tracks the shift from static, centrally orchestrated LLM agents toward self-evolving, decentralized multi-agent systems that adapt their roles, memory, tools, and coordination over time.
根拠付きマルチモーダルQAベンチマーク
Benchmarking work is increasingly targeting harder, more credible evaluation settings for multimodal question answering, especially where models must retrieve or ground evidence rather than rely on shallow multiple-choice cues.
コンピュータ操作エージェントの評価
Evaluation for computer-use and GUI agents is shifting from task success measurement toward diagnosis of safety, efficiency, and cross-platform capability.
オンライン模倣学習と世界モデル強化学習
Representative papers converge on a shared limitation of static imitation and standard model-based control: policies struggle with distribution shift, sparse rewards, and weak exploration once they leave the expert data regime.
マルチモーダル推論評価
This theme centers on how increasingly capable language and multimodal models should be evaluated and controlled as they move beyond text-only benchmarks.
マニピュレーションの汎化と評価
This week's theme centers on evaluating and improving embodied manipulation in contact-rich settings where vision-only supervision and narrowly collected robot data are insufficient.
LLMソフトウェア工学評価
This theme centers on evaluating AI coding assistants and software-engineering agents beyond narrow benchmarks or final-output metrics.
LLMコードエージェントの評価
This theme centers on evaluating LLM-based coding agents on realistic software-engineering tasks, especially repository-level issue resolution.
ロボット学習のための身体性世界モデル
This week's theme centers on using embodied world models not just to generate realistic futures, but to evaluate, supervise, and improve robotic policies.
対話型LLM行動評価
This week's theme centers on evaluating LLM behavior in interactive, socially grounded settings rather than judging single-turn text quality alone.