ChunkTrust: 행동 전문가 신호로 로봇 정책의 실행 구간을 조절하는 방법

Abstract

Robot foundation policies predict action chunks, but how many actions to execute before replanning depends on the current task phase. We introduce , which treats the execution horizon as a latent variable inferred from action-expert evidence rather than a fixed hyperparameter. Its training-free Action-aware Horizon Selector (AHS) combines intra-chunk spectral stability of generation traces with inter-chunk continuity between executed history and predicted actions. An online Beta posterior with kernel forgetting tracks horizon preferences across replans. A lightweight Query-based Horizon Adapter (QHA) optionally learns a context-conditioned dense prior from complementary evidence, fused with current evidence and episode-local Beta memory while the base policy remains frozen. Across RoboTwin2.0 and RoboCasa GR1 Tabletop, AHS improves overall task-averaged success for each evaluated base-policy configuration, including gains of +6.80 percentage points on \pi_{0.5} over all 50 RoboTwin2.0 tasks and +9.67 percentage points on Qwen3GR00T in RoboCasa. AHS+QHA raises the gain over Base to +9.44 percentage points on the eight-task \pi_{0.5} evaluation. On four real-world household tasks, AHS improves the equal-task mean normalized process score from 50.4% to 57.5%. Ablations examine the contributions of both evidence terms, temporal memory, and the learned prior.

1 Introduction

Robot foundation policies, including Vision-Language-Action (VLA) models (Black et al., 2024; Intelligence et al., 2025) and World-Action Models (WAMs) (Yuan et al., 2026; Ye et al., 2026b), predict action chunks to amortize inference and maintain temporal coherence. The execution horizon can differ from the generated chunk length, reflecting a trade-off between longer execution that can preserve smooth progress but delays correction and shorter execution that increases feedback frequency but can disrupt coherent motion (Lu et al., 2026). In manipulation, this trade-off changes within an episode: free-space approach may tolerate longer open-loop execution, whereas contact or delicate transport demands earlier replanning. Fig. 1 illustrates this phase dependence in a real rollout and shows that the best fixed horizon varies across task lengths and evaluation settings. The resulting trust boundary problem is to determine how many actions from the current chunk the robot should execute before replanning.

Adaptive chunking methods derive execution horizons from attention structure, action entropy, or cross-horizon agreement (Wang et al., 2026b; Liang et al., 2026; Jing et al., 2026), and increasingly from the policy’s denoising trajectory (Feng et al., 2026; Chen et al., 2026c). Other approaches learn when to replan (Zhao et al., 2026; Xu et al., 2026b) or monitor execution to trigger correction (Pan et al., 2026). These approaches tackle when to replan from different perspectives, yet an internally consistent prediction can still be incompatible with the motion already executed. Meanwhile, evidence at individual replans can be noisy, while similar execution contexts recur within and across episodes. This raises a central question: How can a robot identify complementary evidence native to its action expert and internalize it as reusable knowledge for adaptive execution?

We introduce ChunkTrust, a framework that couples online evidence accumulation with context-conditioned horizon learning (Fig. 3). ChunkTrust evaluates candidate execution prefixes along two complementary dimensions. We assess spectral stability during action generation, drawing on frequency-domain analyses of diffusion and flow models (Si et al., 2024; Huang et al., 2026a). We also assess continuity with recently executed motion, reflecting the importance of cross-chunk consistency in robot control (Liu et al., 2025b; Black et al., 2025). Our retrospective analysis in Fig. 2 provides empirical support for this pairing. Failed episodes exhibit higher median spectral instability and boundary variation, with the highest failure rate observed when both risks are elevated.

ChunkTrust internalizes this evidence through online memory and a learned prior. The Action-aware Horizon Selector (AHS) accumulates evidence in an episode-local Beta state with forgetting, retaining useful horizon preferences while adapting to phase changes. The Query-based Horizon Adapter (QHA) learns context-conditioned horizon preferences from action-expert evidence, enabling their reuse beyond the current episode. At deployment, QHA supplies a dense prior that complements online AHS evidence, combining learned preferences with adaptation to the current rollout.

We evaluate the benefits of online horizon adaptation and learned horizon preferences across RoboTwin2.0, RoboCasa GR1 Tabletop, and four real-world household tasks. AHS improves aggregate success across all evaluated simulation base-policy configurations, including gains of 6.80 percentage points on the complete 50-task RoboTwin2.0 suite and 9.67 percentage points with Qwen3GR00T on RoboCasa. Adding QHA further improves aggregate success on the eight-task evaluation and benefits two tasks excluded from horizon-head training, supporting reuse of the learned preferences beyond the QHA training tasks. On real robots, AHS increases the equal-task mean normalized process score by 7.1 percentage points. Controlled comparisons and ablations examine the contributions of complementary evidence, temporal memory, and the learned prior, alongside alternative horizon selectors and inference costs.

Our contributions are threefold: (1) we formulate execution-horizon adaptation as inference over candidate prefixes, grounded in the action expert’s generation dynamics and compatibility with executed history. (2) we introduce AHS, which integrates dual evidence with a phase-aware Beta posterior, and QHA, which learns a context-conditioned horizon prior that complements online evidence without updating the base policy. (3) we evaluate across policy families, two simulation benchmarks, and real robots, with full task-level results and controlled evidence, memory, transfer, and cost analyses.

2 Related Work

Action generation and reactive execution.

Mobile ALOHA (Fu et al., 2024b) and Diffusion Policy (Chi et al., 2025) use multi-step action predictions for temporal coherence. Flow-based policies such as \pi_{0} (Black et al., 2024) and \pi_{0.5} (Intelligence et al., 2025), and world-action models such as Fast-WAM (Yuan et al., 2026), extend action generation to broader task distributions. FASTER (Lu et al., 2026) prioritizes near-term sampling through horizon-aware scheduling and streaming execution. ChainVLA (Huang et al., 2026b) conditions successive queries on task progress and the unexecuted action suffix. Execution monitors offer another route to reactivity. VLA-Corrector (Pan et al., 2026) uses a learned latent dynamics model to detect persistent execution drift and guide action correction. React When You Need To (Wu et al., 2026) triggers asynchronous inference in response to scene changes. ChunkTrust instead selects a prefix at each replan using evidence already available from the action expert and executed history. It neither modifies the generated actions nor monitors new observations during that prefix.

Evidence-based horizon selection.

BID (Liu et al., 2025b) selects among sampled chunks using backward coherence and forward contrast, targeting consistency across predictions. Horizon adaptation instead changes the executed prefix. Mixture of Horizons (MoH) uses cross-horizon consensus (Jing et al., 2026), AutoHorizon uses action self-attention as a predictive-limit proxy (Wang et al., 2026b), and Adaptive Action Chunking (AAC) uses action entropy (Liang et al., 2026). HiPolicy combines multi-frequency chunk generation with entropy-guided execution (Zhang et al., 2026b). More recent methods expand the available signals. Knowing When to Stop (Xu et al., 2026a) detects entropy plateaus in action-to-observation cross-attention, while DVAC (Feng et al., 2026) measures variation in clean-action estimates during denoising. GeoAAC (Chen et al., 2026c) constructs prefix-wise geometric profiles from a single denoising trajectory. PACE (Nie et al., 2026) instead identifies low-speed transition points directly in the predicted chunk. ChunkTrust pairs spectral variation during generation with speed variation after stitching a candidate prefix to executed history. DVAC uses rolling history to calibrate its variance threshold, whereas AHS maintains horizon-indexed Beta states that accumulate the paired evidence as soft feedback with forgetting.

Learned horizon selection.

DEHP (Zhao et al., 2026) and BCP (Xu et al., 2026b) train horizon or continuation heads through reinforcement learning with frozen base policies. EQRL (Wang et al., 2026a) jointly learns to select the latent input, denoising budget, and chunk length, while Spatial Attention (SA) (Park et al., 2026) learns to forecast observation sensitivity and uses it to allocate execution horizons. QHA instead learns a context-conditioned horizon prior from complementary action-expert evidence and combines it with current evidence and episode-local Beta memory at deployment. Appendix G discusses additional connections.

3 Horizon-Aware Evidence from the Action Expert

3.1 Preliminaries

At replan step t, a frozen policy conditions on visual observation o_{t}, proprioceptive state \mathbf{x}_{t}^{\mathrm{prop}}, and instruction \ell. Its backbone produces context tokens \mathbf{C}_{t}=f_{\theta}(o_{t},\mathbf{x}_{t}^{\mathrm{prop}},\ell), and the action expert predicts

\hat{\mathbf{A}}_{t}=[\hat{\mathbf{a}}_{t,1},\ldots,\hat{\mathbf{a}}_{t,H}]\in\mathbb{R}^{H\times d_{a}}.

The controller executes a prefix of length K_{t}\in\{1,\ldots,H\} before re-observation. We score candidates k\in\mathcal{K}\subseteq\{1,\ldots,H\} using internal generation stability and compatibility with executed history. The expected-round rule in Sec. 4 can select intermediate integer lengths rather than only grid points.

A single policy call with trace recording returns (\hat{\mathbf{A}}_{t},\mathcal{F}_{t})=\pi_{\theta}(o_{t},\mathbf{x}_{t}^{\mathrm{prop}},\ell). For flow-based action experts (Lipman et al., 2023), \mathcal{F}_{t} contains velocity predictions recorded during generation, without changing the actions. We write the trace and executed history as

\mathcal{F}_{t}=\{\mathbf{v}_{t,\tau}\in\mathbb{R}^{H\times d_{a}}\}_{\tau=0}^{T-1},\qquad\mathcal{H}_{t}=[\mathbf{a}^{\mathrm{exec}}_{n_{t}-N_{t}+1},\ldots,\mathbf{a}^{\mathrm{exec}}_{n_{t}}],

where \tau indexes sampling steps, n_{t} counts actions executed before replan t, and N_{t} is the available history length. The following evidence terms use \mathcal{F}_{t} and (\mathcal{H}_{t},\hat{\mathbf{A}}_{t}), respectively.

3.2 Intra-Chunk Spectral Stability

We measure variation in the velocity-prefix spectrum during generation. Specifically, we apply the Fourier transform along the action horizon at each denoising step and compare the resulting spectra across steps. For each candidate k, we pad its velocity prefix to length H and apply a one-dimensional Fourier transform along the action-horizon axis, separately for action dimensions j\in\{1,\ldots,d_{a}\} and nonnegative frequencies \omega\in\Omega:

\widehat{\mathbf{V}}^{(k)}_{t,\tau}(\omega,j)=\operatorname{FFT}_{h}\!\left(\bar{\mathbf{v}}^{(k)}_{t,\tau}[:,j]\right)_{\omega},\quad\text{where}\quad\bar{\mathbf{v}}^{(k)}_{t,\tau}=\operatorname{Pad}_{H}\!\left(\mathbf{v}_{t,\tau,1:k,:}\right)\in\mathbb{R}^{H\times d_{a}},

Let \Omega_{\mathrm{hi}}\subset\Omega contain frequencies above cutoff fraction c_{\mathrm{cut}} of the discrete frequency grid. The fraction of energy in this band, aggregated across action dimensions, is

r_{\mathrm{hi},t,\tau}(k)=\frac{\sum_{\omega\in\Omega_{\mathrm{hi}}}\sum_{j=1}^{d_{a}}\left|\widehat{\mathbf{V}}^{(k)}_{t,\tau}(\omega,j)\right|^{2}}{\sum_{\omega\in\Omega}\sum_{j=1}^{d_{a}}\left|\widehat{\mathbf{V}}^{(k)}_{t,\tau}(\omega,j)\right|^{2}}.

High-frequency energy reflects rapid variation along the future-action axis. To track changes during generation, we define an early baseline \bar{r}_{\mathrm{hi},t,0}(k)=\frac{1}{W_{\tau}}\sum_{\tau=0}^{W_{\tau}-1}r_{\mathrm{hi},t,\tau}(k) from the first W_{\tau} sampling steps. The raw intra-chunk instability is its root mean square (RMS) deviation over all denoising steps, including the baseline window:

z_{\mathrm{intra},t}(k)=\left[\frac{1}{T}\sum_{\tau=0}^{T-1}\left(r_{\mathrm{hi},t,\tau}(k)-\bar{r}_{\mathrm{hi},t,0}(k)\right)^{2}\right]^{1/2}.

The early window supplies a reference rather than being discarded from the RMS calculation. The score measures deviation from this reference, not simply the final chunk’s high-frequency energy. Because raw scales vary across tasks, policies, and action normalizations, we min-max normalize this score within \mathcal{K} and set q_{\mathrm{intra},t}(k)=\exp[-\alpha_{\mathrm{intra}}\tilde{z}_{\mathrm{intra},t}(k)], where \alpha_{\mathrm{intra}}>0 controls the penalty strength. Larger spectral deviations thus receive lower quality. Normalization makes this a relative comparison among candidate prefixes at the current replan. The resulting quality need not be comparable in absolute scale across unrelated episodes. Fig. 2(a) uses the episode mean \bar{z}_{\mathrm{intra}}(k) of this same replan-level score, with the exact aggregation specified in the caption.

3.3 Inter-Chunk Continuity

An internally stable prefix may still be incompatible with recent motion. For continuity window W_{h}, we concatenate the available history suffix and candidate future prefix:

\mathbf{S}_{t}^{(k)}=\left[\operatorname{Suffix}_{(W_{h}-k)_{+}}(\mathcal{H}_{t}),\hat{\mathbf{a}}_{t,1},\ldots,\hat{\mathbf{a}}_{t,k}\right].

Here (x)_{+}=\max(0,x). Let \delta_{i}^{(k)}=\lVert\mathbf{S}_{t,i+1}^{(k)}-\mathbf{S}_{t,i}^{(k)}\rVert_{2} denote first-difference speed along the stitched trajectory. The raw inter-chunk discontinuity is the speed coefficient of variation:

u_{\mathrm{inter},t}(k)=\operatorname{Std}\left(\{\delta_{i}^{(k)}\}_{i}\right)/\operatorname{Mean}\left(\{\delta_{i}^{(k)}\}_{i}\right).

This proxy penalizes irregular speed, including boundary jumps and stop-and-go motion. A smaller value indicates a more uniform stitched trajectory, whereas a larger value can reflect an abrupt correction despite a smooth candidate viewed in isolation. As above, we min-max normalize within \mathcal{K} and set q_{\mathrm{inter},t}(k)=\exp[-\beta_{\mathrm{inter}}\tilde{u}_{\mathrm{inter},t}(k)], with \beta_{\mathrm{inter}}>0. Fig. 2(b) reports the corresponding episode mean \bar{u}_{\mathrm{inter}}(k) over valid replans. Failed episodes have higher median raw scores for both evidence terms across the candidate horizons. The shaded bands show interquartile ranges.

3.4 Dual-Evidence Fusion

We combine internal stability and compatibility with recent motion into

q_{\mathrm{mix},t}(k)=(1-\lambda)q_{\mathrm{intra},t}(k)+\lambda q_{\mathrm{inter},t}(k),\qquad\lambda\in[0,1].

The default is \lambda=0.5, with \lambda=0 and \lambda=1 recovering the intra-only and inter-only ablations. This score supplies action-expert evidence for horizon inference, not a deterministic execution rule or a calibrated task-success probability.

Fig. 2(c) summarizes episode risks by the 75th percentiles of 1-q_{\mathrm{intra}} and 1-q_{\mathrm{inter}} over replans, then splits each risk at its median. Failure rises from 50.2% when both risks are low to 97.4% when both are high, with intermediate rates when only one is high. These associations motivate combining the evidence, but they do not establish that a low-risk prefix guarantees success. The diagnostic episodes use fixed K=H=50, so the comparison characterizes the association of evidence with outcomes without selecting trajectories based on AHS decisions. Full distributions and aggregation details are reported in Appendix B.

4 Action-aware Horizon Selection and Query-based Adaptation

AHS uses the candidate quality q_{\mathrm{mix},t}(k) from Sec. 3 to maintain an online reliability posterior. QHA optionally learns a context-conditioned dense horizon prior from the same evidence (Fig. 3). Neither updates the base action generator.

4.1 Action-aware Horizon Selector

Online reliability posterior.

Manipulation alternates between phases such as approach, contact, transport, and placement. A horizon that was useful in a stable phase may become undesirable after a contact change, motivating memory that can also forget. To retain information across noisy replans, AHS maintains a Beta state for each k\in\mathcal{K}, initialized by a_{0}(k)=b_{0}(k)=1. This is episode-local memory of evidence-derived reliability, not a supervised task-success model. Following Thompson sampling (Russo et al., 2018), we draw a sample and combine it with the current quality:

\hat{\xi}_{t}(k)\sim\operatorname{Beta}(a_{t}(k),b_{t}(k)),\qquad s_{t}(k)=\hat{\xi}_{t}(k)\,q_{\mathrm{mix},t}(k).

Here q_{\mathrm{mix},t} measures the current chunk, while sampled reliability reflects accumulated episode-local evidence. Their product combines both. Except for uniform exploration with probability \epsilon_{\mathrm{exp}}, temperature scaling and expected-round selection give:

\mu_{t}(k)\propto s_{t}(k)^{1/T_{\mathrm{sel}}},\quad\sum_{k\in\mathcal{K}}\mu_{t}(k)=1,\qquad K_{t}=\operatorname{clip}_{[1,H_{t}^{\mathrm{avail}}]}\operatorname{round}\!\Bigl[\sum_{k\in\mathcal{K}}k\,\mu_{t}(k)\Bigr].

Here H_{t}^{\mathrm{avail}} is the available chunk length. If all scores degenerate, \mu_{t} falls back to uniform over valid candidates. Expected-round combines candidate preferences; exploration samples one valid candidate uniformly. Clipping keeps the prefix within the available prediction. AHS executes \hat{\mathbf{a}}_{t,1:K_{t}}, appends the executed actions to \mathcal{H}, and replans from the next observation.

Posterior update with kernel forgetting.

After execution, the soft feedback is y_{t}=\sum_{k\in\mathcal{K}}\mu_{t}(k)q_{\mathrm{mix},t}(k), or the sampled candidate quality on exploration steps. A Gaussian kernel w_{t}(k)\propto\exp[-(k-K_{t})^{2}/(2\sigma_{K}^{2})], normalized over \mathcal{K}, shares feedback among nearby horizons. Exponential forgetting (Raj and Kalyani, 2017) updates the state:

\displaystyle a_{t+1}(k) \\ \displaystyle=\rho_{f}a_{t}(k)+\eta\,w_{t}(k)y_{t}, \\ \displaystyle b_{t+1}(k) \\ \displaystyle=\rho_{f}b_{t}(k)+\eta\,w_{t}(k)(1-y_{t}),

where \rho_{f}, \eta, and \sigma_{K} control forgetting, update strength, and neighborhood sharing. Decaying old evidence lets the selector adapt as the task changes phase. The feedback comes from action-expert quality, not an observed task-success label. Neighboring candidates receive shared soft evidence rather than independent rollout outcomes. Kernel sharing couples nearby lengths; forgetting discounts earlier phases.

4.2 Training-Time Query-Based Horizon Adapter

QHA predicts a dense distribution p_{\phi}(K_{t}=h\mid\mathbf{C}_{t},\mathbf{Z}_{t}^{A}) for h\in\{1,\ldots,H\} from VLM context tokens \mathbf{C}_{t} and action-latent tokens \mathbf{Z}_{t}^{A}. With a sparse candidate grid, AHS explicitly scores each candidate, while QHA predicts a preference for every action step in one forward pass. Learned horizon queries use bridge cross-attention over both token streams (Fig. 3). Architecture and teacher construction are specified in Appendix A.6. The teacher normalizes dense evidence without online Beta memory:

\mu_{t}^{\star}(h)\propto q_{\mathrm{mix},t}(h)^{1/T_{\mathrm{teach}}},\qquad\sum_{h=1}^{H}\mu_{t}^{\star}(h)=1,\qquad h=1,\ldots,H.

Only QHA is trained, minimizing \mathcal{L}_{\mathrm{QHA}}=\operatorname{KL}(\mu_{t}^{\star}\,\|\,p_{\phi}). QHA thus encodes horizon preferences across training episodes in its parameters, providing cross-episode memory that complements AHS’s episode-local state. At deployment, let \tilde{q}_{\mathrm{mix},t}(h) denote quality on the dense grid, interpolated from sparse evidence or scored directly on that grid. QHA supplies a prior, combined with dense Beta reliability samples as

s_{\mathrm{eff},t}(h)=\hat{\xi}_{t}(h)\,\tilde{q}_{\mathrm{mix},t}(h)\,p_{\phi}(K_{t}=h\mid\mathbf{C}_{t},\mathbf{Z}_{t}^{A})^{\gamma},\qquad h=1,\ldots,H,

where \gamma\geq 0 controls prior strength. Applying temperature scaling and the selection rule above to this dense score yields AHS+QHA, combining learned preferences with current episode evidence. The dense prior supplies a context-conditioned preference before the episode-local state has accumulated much evidence. It does not remove the need to record generation traces or evaluate AHS candidates in the hybrid setting, as those computations provide the online correction to the prior.

5 Experiments

We evaluate on RoboTwin2.0 (Chen et al., 2025), RoboCasa GR1 Tabletop (Nasiriany et al., 2024), and real robots. Each Base–AHS comparison fixes the policy checkpoint. AHS changes execution without updating policy weights. Simulation tables report success rates (%). In Tabs. 1 and 2, tasks are weighted equally after averaging Easy and Hard within each RoboTwin2.0 task. Rounding follows aggregation. Easy and Hard denote clean and randomized settings. Appendix A specifies checkpoints, candidate horizons, and evaluation protocols.

5.1 AHS across Simulation Benchmarks

Tab. 1 tests AHS across benchmarks and training regimes. Its task scope and training recipe distinguish evaluation coverage from checkpoint provenance. Absolute scores across regimes are not matched-policy comparisons. The evaluation spans task-specific post-training, multitask post-training, and zero-shot deployment on the target benchmark. Gains in these regimes test whether execution adaptation remains useful across the evaluated backbones. They do not imply that AHS repairs every failed task or replaces policy training.

RoboTwin2.0.

The full-suite evaluation uses one multitask-post-trained \pi_{0.5} (Intelligence et al., 2025) checkpoint on 50 tasks, with 20 rollouts per task and setting. AHS improves success from 56.70% to 63.50% (+6.80 percentage points). The eight-task evaluation uses task-specific \pi_{0} (Black et al., 2024) and \pi_{0.5} checkpoints and multitask Fast-WAM (Yuan et al., 2026), with 100 rollouts per task and setting. All three improve in aggregate. These are distinct checkpoint and evaluation cohorts, not subset and full-suite results for one policy. Fast-WAM improves from 86.81% to 88.13%, showing that execution adaptation can still help a stronger baseline, although its aggregate gain is smaller than those of the task-specific policies. Appendix Tabs. 8 and 9 retain full per-task outcomes, including regressions.

RoboCasa GR1 Tabletop.

We evaluate all 24 tasks; the \pi_{0.5} control uses 50 rollouts per task. The multitask-post-trained \pi_{0.5} and Qwen3GR00T (Ye et al., 2026a; Community, 2026) improve from 40.08% to 42.50% and from 47.83% to 57.50%, respectively. Both zero-shot Isaac-GR00T baselines (Bjorck et al., 2025) also improve in aggregate. All four use \mathcal{K}=\{4,8,12,16\}. Appendix Tab. 10 provides the complete breakdown. Fixed-horizon, action-only, temporal-memory, and AAC (Liang et al., 2026) comparisons appear in Appendix C.5.

5.2 QHA Augmentation and Transfer

Augmentation on QHA training tasks.

Each policy family uses one QHA head trained on eight tasks with the base policies frozen (Tab. 2A). AHS+QHA improves overall success over AHS from 21.38% to 24.88% for \pi_{0} and from 36.25% to 39.06% for \pi_{0.5}. Both Easy and Hard means improve, but \pi_{0.5} regresses on Handover Block in both settings. This may reflect a mismatch between the shared horizon prior and the feedback timing required during bimanual object transfer.

Transfer to tasks held out from QHA training.

A separate \pi_{0.5} head trains on six tasks and tests on two held-out tasks (Tab. 2B). AHS+QHA improves the equal-task mean from 40.00% to 42.75%. Blocks Ranking RGB improves from 38.50% to 43.50%, compared with 41.50% to 42.00% on Place Bread Basket. Only the horizon head is task-held-out: base policies remain task-specific. Appendix C.1 gives the split, per-setting results, QHA-only control, and decision agreement.

5.3 Real-World Deployment

We deploy \pi_{0.5} on the AgileX COBOT Magic ALOHA-style bimanual platform, comparing fixed K=25 with AHS over 15 rollouts on each of four household tasks (Fig. 4). Object positions vary across rollouts to test spatial generalization. Scores average predefined sub-steps and rollouts to measure partial progress, rather than binary success (Appendix A.1). AHS raises the equal-task mean from 50.4% to 57.5%, with the largest gain on Duck Toy to Drawer: 50.0% to 63.3%.

5.4 Ablation Studies

All three studies use Place A2B Left, Place Bread Basket, Place Bread Skillet, and Place Can Basket, with 100 rollouts per task and condition. All three studies include Easy and Hard.

Candidate-set scaling.

On \pi_{0.5}, five candidates raise success from 22.0% with fixed K=50 to 33.0%, versus 34.9% with 50 candidates (Tab. 3). Added per-replan cost rises from 0.67 to 3.45 ms, or 0.70–3.60% of policy inference time. Sparse candidates thus capture most of the gain. The table’s episode times cover successes only, so they do not establish all-attempt cost. Appendix D.1 reports all-episode costs for additional cohorts. Appendix E gives hyperparameter sweeps.

Component ablation.

On \pi_{0}, combining both evidence terms without memory gives 14.6% overall but 3.75% on Hard (Tab. 4). Full AHS reaches 15.0% overall and the best Hard result, 5.75%, supporting temporal memory. QHA raises overall success to 15.8% while Hard falls to 4.00%. Appendix C.5 compares memory designs with shared evidence and candidates.

Latency and asynchronous execution.

We combine AHS with real-time chunking (RTC; Black et al., 2025) on task-specific \pi_{0.5} policies (Fig. 5). All predict H=50 actions. Fixed uses target budget K=40, and AHS scores candidates in \{10,20,30,40\} without QHA. At +200 ms, RTC reduces AHS waiting from 7.893 to 0.344 s/episode on Hard and from 6.310 to 0.344 s on Easy. Within RTC, AHS lowers mean observation age from 4.92 to 3.07 s on Hard and from 5.00 to 3.18 s on Easy, while SR rises from 22.00% to 26.75% and from 39.00% to 42.75%, respectively. This requires more policy calls and model computation (Appendix D.2). RTC does not uniformly improve SR over synchronous AHS: at +200 ms on Easy, SR is 42.75% versus 44.75%.

6 Conclusion

ChunkTrust adapts robot-policy execution horizons using action-expert evidence. AHS combines spectral stability, inter-chunk continuity, and online temporal memory, while QHA learns a context-conditioned horizon prior from the same evidence without changing the base policy. Experiments support aggregate gains across two simulation benchmarks and real-world manipulation, while transfer, ablation, and cost analyses characterize where adaptation helps. The method requires accessible generation traces, and gains are not uniform across tasks. The evaluation also separates per-replan overhead from episode-level cost: a small selector cost does not imply identical total rollout time. Task breakdowns likewise expose regressions that aggregate gains can conceal, particularly when a learned prior is combined with online evidence. Future work includes multi-chunk horizon inference, cross-policy transfer of the learned prior, and broader real-world validation across hardware and domain shifts.

References

1. Bai et al. (2025) S. Bai, Y. Cai, R. Chen, K. Chen, X. Chen, Z. Cheng, L. Deng, W. Ding, C. Gao, C. Ge, et al. Qwen3-vl technical report. arXiv preprint arXiv:2511.21631.
2. Bi et al. (2025) H. Bi, H. Tan, S. Xie, Z. Wang, S. Huang, H. Liu, R. Zhao, Y. Feng, C. Xiang, Y. Rong, et al. Motus: a unified latent action world model. arXiv preprint arXiv:2512.13030.
3. Bjorck et al. (2025) J. Bjorck, F. Castañeda, N. Cherniadev, X. Da, R. Ding, L. Fan, Y. Fang, D. Fox, F. Hu, S. Huang, et al. Gr00t n1: an open foundation model for generalist humanoid robots. arXiv preprint arXiv:2503.14734.
4. Black et al. (2024) K. Black, N. Brown, D. Driess, A. Esmail, M. Equi, C. Finn, N. Fusai, L. Groom, K. Hausman, B. Ichter, et al. \pi_{0}: A vision-language-action flow model for general robot control. arXiv preprint arXiv:2410.24164.
5. Black et al. (2025) K. Black, M. Galliker, and S. Levine Real-time execution of action chunking flow policies. In Advances in Neural Information Processing Systems, Vol. 38, Main Conference, pp. 33383–33407. External Links: Document, Link
6. Brohan et al. (2023) A. Brohan, N. Brown, J. Carbajal, Y. Chebotar, J. Dabis, C. Finn, K. Gopalakrishnan, K. Hausman, A. Herzog, J. Hsu, J. Ibarz, B. Ichter, A. Irpan, T. Jackson, S. Jesmonth, N. Joshi, R. Julian, D. Kalashnikov, Y. Kuang, I. Leal, K. Lee, S. Levine, Y. Lu, U. Malla, D. Manjunath, I. Mordatch, O. Nachum, C. Parada, J. Peralta, E. Perez, K. Pertsch, J. Quiambao, K. Rao, M. S. Ryoo, G. Salazar, P. R. Sanketi, K. Sayed, J. Singh, S. Sontakke, A. Stone, C. Tan, H. Tran, V. Vanhoucke, S. Vega, Q. H. Vuong, F. Xia, T. Xiao, P. Xu, S. Xu, T. Yu, and B. Zitkovich RT-1: Robotics Transformer for Real-World Control at Scale. In Proceedings of Robotics: Science and Systems, Daegu, Republic of Korea. External Links: Document
7. Chen et al. (2026a) F. Chen, X. Wang, Y. Chen, B. Li, Y. He, Z. Zhang, and Y. Wu Dynamic Execution Commitment of Vision-Language-Action Models. arXiv preprint arXiv:2605.11567. External Links: Link
8. Chen et al. (2025) T. Chen, Z. Chen, B. Chen, Z. Cai, Y. Liu, Q. Liang, Z. Li, X. Lin, Y. Ge, Z. Gu, et al. RoboTwin 2.0: a scalable data generator and benchmark with strong domain randomization for robust bimanual robotic manipulation. arXiv preprint arXiv:2506.18088.
9. Chen et al. (2026b) W. Chen, K. Zhang, C. Lin, Z. Zhang, Y. She, Y. Liu, R. A. Yeh, S. Mou, and Y. Gu DREAM-Chunk: Reactive Action Chunking with Latent World Model. arXiv preprint arXiv:2606.18589. External Links: Link
10. Chen et al. (2026c) X. Chen, S. Chen, Y. Ding, J. Liu, G. Wang, W. Ye, H. T. Shen, and Y. Bin GeoAAC: Geometry-Based Adaptive Action Chunking from Denoising Trajectories in VLA Policies. arXiv preprint arXiv:2609.20776. External Links: Link
11. Chi et al. (2025) C. Chi, Z. Xu, S. Feng, E. Cousineau, Y. Du, B. Burchfiel, R. Tedrake, and S. Song Diffusion policy: visuomotor policy learning via action diffusion. The International Journal of Robotics Research 44 (10-11), pp. 1684–1704.
12. Community (2026) S. Community StarVLA: a lego-like codebase for vision-language-action model developing. arXiv preprint arXiv:2604.05014.
13. Driess et al. (2023) D. Driess, F. Xia, M. S. M. Sajjadi, C. Lynch, A. Chowdhery, B. Ichter, A. Wahid, J. Tompson, Q. Vuong, T. Yu, W. Huang, Y. Chebotar, P. Sermanet, D. Duckworth, S. Levine, V. Vanhoucke, K. Hausman, M. Toussaint, K. Greff, A. Zeng, I. Mordatch, and P. Florence PaLM-e: an embodied multimodal language model. In Proceedings of the 40th International Conference on Machine Learning, A. Krause, E. Brunskill, K. Cho, B. Engelhardt, S. Sabato, and J. Scarlett (Eds.), Proceedings of Machine Learning Research, Vol. 202, pp. 8469–8488. External Links: Link
14. Feng et al. (2026) X. Feng, Y. Cheng, C. Shi, B. Han, Y. Yan, Y. Hong, Z. Tian, and L. Jiang Denoising Tells When to Replan: Denoising-Variance Adaptive Chunking for Flow-Based Robot Policies. arXiv preprint arXiv:2606.03847. External Links: Link
15. Fu et al. (2024a) Z. Fu, T. Z. Zhao, and C. Finn Mobile aloha: learning bimanual mobile manipulation using low-cost whole-body teleoperation. In 8th Annual Conference on Robot Learning,
16. Fu et al. (2024b) Z. Fu, T. Z. Zhao, and C. Finn Mobile ALOHA: learning bimanual mobile manipulation using low-cost whole-body teleoperation. In 8th Annual Conference on Robot Learning, External Links: Link
17. Ghosh et al. (2024) D. Ghosh, H. R. Walke, K. Pertsch, K. Black, O. Mees, S. Dasari, J. Hejna, T. Kreiman, C. Xu, J. Luo, Y. L. Tan, L. Y. Chen, Q. Vuong, T. Xiao, P. R. Sanketi, D. Sadigh, C. Finn, and S. Levine Octo: An Open-Source Generalist Robot Policy. In Proceedings of Robotics: Science and Systems, Delft, Netherlands. External Links: Document
18. Guo et al. (2026) J. Guo, F. Chen, Z. Mao, W. L. H. Kenny, Z. Wu, Y. Li, Y. Cai, Y. Chen, Y. Ban, K. Chen, et al. Frequency-Aware Flow Matching for Continuous and Consistent Robotic Action Generation. In Advances in Neural Information Processing Systems,
19. Guo and Guo (2026) T. Guo and M. Guo Action ControlNet: A Lightweight Delay-Aware Adapter for Smooth Asynchronous Control in Vision-Language-Action Models. arXiv preprint arXiv:2606.25985. External Links: Link
20. He et al. (2026) Q. He, Z. Yang, W. Liang, C. Hao, N. Sebe, and J. Tian FocalPolicy: Frequency-Optimized Chunking and Locally Anchored Flow Matching for Coherent Visuomotor Policy. In Proceedings of the 43rd International Conference on Machine Learning,
21. Hu et al. (2022) E. J. Hu, yelong shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen LoRA: low-rank adaptation of large language models. In International Conference on Learning Representations, External Links: Link
22. Huang et al. (2026a) G. Huang, J. Mao, F. Huang, F. Liu, X. Luo, Y. Liang, J. Lu, X. Wang, P. Liu, R. Fu, R. Huang, and S. Huang Exposure bias can alleviate itself via directional and frequency rectification in flow matching. In European Conference on Computer Vision (ECCV), External Links: Link
23. Huang et al. (2026b) Y. Huang, W. Bu, Z. Xiong, J. Wu, F. Huang, J. Jiang, and Z. Wang ChainVLA: chaining vision-language-action queries through a unified execution state for long-horizon manipulation. arXiv preprint arXiv:2608.02326.
24. Intelligence et al. (2025) P. Intelligence, K. Black, N. Brown, J. Darpinian, K. Dhabalia, D. Driess, A. Esmail, M. Equi, C. Finn, N. Fusai, et al. \pi_{0.5}: A vision-language-action model with open-world generalization. arXiv preprint arXiv:2504.16054.
25. Jing et al. (2026) D. Jing, G. Wang, J. Liu, W. Tang, Z. Sun, Y. Yao, Z. Wei, Y. Liu, Z. Lu, and M. Ding Mixture of horizons in action chunking. In Proceedings of the 43rd International Conference on Machine Learning, Proceedings of Machine Learning Research, Vol. 306, pp. 54350–54370. External Links: Link
26. Kim et al. (2024) M. J. Kim, K. Pertsch, S. Karamcheti, T. Xiao, A. Balakrishna, S. Nair, R. Rafailov, E. P. Foster, P. R. Sanketi, Q. Vuong, T. Kollar, B. Burchfiel, R. Tedrake, D. Sadigh, S. Levine, P. Liang, and C. Finn OpenVLA: an open-source vision-language-action model. In 8th Annual Conference on Robot Learning, External Links: Link
27. Lazzati et al. (2026) F. Lazzati, K. Stachowicz, W. Chen, A. M. Metelli, A. Wagenmaker, and S. Levine Why Does Action Chunking Improve Behavioral Cloning Performance in Robotic Control?. arXiv preprint arXiv:2608.02547. External Links: Link
28. Liang et al. (2026) Y. Liang, X. Wang, K. Wang, S. Wang, X. Peng, H. Chen, D. K. H. Chua, and P. Vadakkepat Adaptive action chunking at inference-time for vision-language-action models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 20802–20811.
29. Lipman et al. (2023) Y. Lipman, R. T. Chen, H. Ben-Hamu, M. Nickel, and M. Le Flow matching for generative modeling. In The Eleventh International Conference on Learning Representations,
30. Liu et al. (2025a) S. Liu, L. Wu, B. Li, H. Tan, H. Chen, Z. Wang, K. Xu, H. Su, and J. Zhu RDT-1b: a diffusion foundation model for bimanual manipulation. In The Thirteenth International Conference on Learning Representations, External Links: Link
31. Liu et al. (2025b) Y. Liu, J. I. Hamid, A. Xie, Y. Lee, M. Du, and C. Finn Bidirectional decoding: improving action chunking via guided test-time sampling. In International Conference on Learning Representations, External Links: Link
32. Liu et al. (2026) Y. Liu, H. Yu, J. Zhao, B. Li, D. Zhang, M. Li, W. Wu, Y. Hu, J. Xie, J. Guo, D. Wang, and Y. Gao Learning Native Continuation for Action Chunking Flow Policies. In Proceedings of Robotics: Science and Systems, Sydney, Australia. External Links: Document
33. Lu et al. (2026) Y. Lu, Z. Liu, X. Fan, Z. Yang, J. Hou, J. Li, K. Ding, and H. Zhao FASTER: rethinking real-time flow VLAs. arXiv preprint arXiv:2603.19199.
34. Nasiriany et al. (2024) S. Nasiriany, A. Maddukuri, L. Zhang, A. Parikh, A. Lo, A. Joshi, A. Mandlekar, and Y. Zhu RoboCasa: large-scale simulation of everyday tasks for generalist robots. In RSS 2024 Workshop: Data Generation for Robotics,
35. Nie et al. (2026) J. Nie, J. Li, C. Liu, J. Lao, J. Zhang, T. Zhang, L. Lin, and S. Huang PACE: Phase-Aware Chunk Execution for Robot Policies with Action Chunking. arXiv preprint arXiv:2606.00537. External Links: Link
36. O’Neill et al. (2024) A. O’Neill, A. Rehman, A. Maddukuri, A. Gupta, A. Padalkar, A. Lee, A. Pooley, A. Gupta, A. Mandlekar, A. Jain, et al. Open x-embodiment: robotic learning datasets and rt-x models: open x-embodiment collaboration 0. In 2024 IEEE International Conference on Robotics and Automation (ICRA), pp. 6892–6903.
37. Pan et al. (2026) Y. Pan, M. Pan, Q. Lu, J. Huang, M. Zhang, S. Huang, X. Li, J. Zhang, Y. Shen, X. Zhang, and W. Zhang VLA-Corrector: Lightweight Detect-and-Correct Inference for Adaptive Action Horizon. In Advances in Neural Information Processing Systems (NeurIPS),
38. Park et al. (2026) C. Park, J. Ha, J. Fu, and F. C. Park Spatial Attention: Adapting Execution Horizons for Diffusion Policies via Observation Sensitivity. arXiv preprint arXiv:2607.04739. External Links: Link
39. Raj and Kalyani (2017) V. Raj and S. Kalyani Taming non-stationary bandits: a Bayesian approach. Note: arXiv preprint arXiv:1707.09727 External Links: 1707.09727, Link
40. Russo et al. (2018) D. J. Russo, B. Van Roy, A. Kazerouni, I. Osband, and Z. Wen A tutorial on thompson sampling. Foundations and Trends in Machine Learning 11 (1), pp. 1–96.
41. Sendai et al. (2025) K. Sendai, M. Alvarez, T. Matsushima, Y. Matsuo, and Y. Iwasawa Leave No Observation Behind: Real-time Correction for VLA Action Chunks. arXiv preprint arXiv:2509.23224. External Links: Link
42. Si et al. (2024) C. Si, Z. Huang, Y. Jiang, and Z. Liu FreeU: free lunch in diffusion U-Net. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4733–4743. External Links: Link
43. So et al. (2026) J. So, C. Lee, S. Lee, J. Ok, and E. Park Improving generative behavior cloning via self-guidance and adaptive chunking. In The Thirty-ninth Annual Conference on Neural Information Processing Systems, External Links: Link
44. Team et al. (2025) B. R. Team, M. Cao, H. Tan, Y. Ji, X. Chen, M. Lin, Z. Li, Z. Cao, P. Wang, E. Zhou, et al. Robobrain 2.0 technical report. arXiv preprint arXiv:2507.02029.
45. Vaswani et al. (2017) A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin Attention is all you need. Advances in neural information processing systems 30.
46. Wang et al. (2026a) G. Wang, X. Tan, X. Li, M. Luo, C. Yao, S. Yan, J. Yang, F. Feng, H. Cai, X. Wang, Z. Mai, Y. Zhao, Y. Han, and Z. Li Elastic Queries Reinforcement Learning: Self-Aware Policy Execution for VLA Models. arXiv preprint arXiv:2606.14375. External Links: Link
47. Wang et al. (2026b) H. Wang, G. Zhang, Y. Yan, R. R. Kompella, and G. Liu VLA knows its limits. arXiv preprint arXiv:2602.21445.
48. Wang et al. (2026c) H. Wang, G. Zhang, Y. Yan, Y. Shang, R. Kompella, and G. Liu Real-Time Robot Execution with Masked Action Chunking. In International Conference on Learning Representations, pp. 120161–120179.
49. Wang et al. (2026d) R. Wang, Y. Zhang, C. Chen, J. Lin, Z. Wang, and X. Qi When to Trust Imagination: Adaptive Action Execution for World Action Models. arXiv preprint arXiv:2605.06222. External Links: Link
50. Wang et al. (2026e) Z. Wang, Z. Lin, R. Li, Y. Zhang, X. Yang, S. Mi, and X. Wei Open-Loop Planning, Closed-Loop Verification: Speculative Verification for VLA. arXiv preprint arXiv:2604.02965. External Links: Link
51. Wen et al. (2025) J. Wen, Y. Zhu, J. Li, Z. Tang, C. Shen, and F. Feng DexVLA: vision-language model with plug-in diffusion expert for general robot control. In 9th Annual Conference on Robot Learning,
52. Wu et al. (2026) Y. Wu, H. Li, T. Hou, L. Chen, and A. Knoll React When You Need To: Event-Triggered Asynchronous Inference for VLA Policies. arXiv preprint arXiv:2609.22587. External Links: Link
53. Xu et al. (2026a) R. Xu, X. Shan, S. Dai, Y. Wang, and J. Yu Knowing When to Stop: Adaptive Action Chunking via Internal Cross-Attention Dynamics in VLAs. arXiv preprint arXiv:2609.00908. External Links: Link
54. Xu et al. (2026b) W. Xu, Z. Liu, L. Luo, Y. Liang, C. Yao, Q. Mei, J. Cao, X. Cao, X. Zhang, J. Yang, and B. Guo Continue or Replan? Bernoulli-Continuation Policy Learning for Adaptive Horizon Execution. arXiv preprint arXiv:2608.03483. External Links: Link
55. Yang et al. (2026) Z. Yang, Y. Shi, M. Yao, W. Xue, Y. Jueluo, and L. Liu ChunkFlow: Towards Continuity-Consistent Chunked Policy Learning. arXiv preprint arXiv:2607.12992. External Links: Link
56. Ye et al. (2026a) J. Ye, N. Gao, S. Yang, J. Zheng, Z. Wang, Y. Chen, P. Chen, Y. Chen, S. Liu, and J. Jia StarVLA-\alpha: reducing complexity in vision-language-action systems. arXiv preprint arXiv:2604.11757.
57. Ye et al. (2026b) S. Ye, Y. Ge, K. Zheng, S. Gao, S. Yu, G. Kurian, S. Indupuru, Y. L. Tan, C. Zhu, J. Xiang, A. N. Malik, K. Lee, W. Liang, N. R. Arachchige, J. Gu, Y. Xu, G. Wang, F. Hu, A. Narayan, J. Bjorck, J. Wang, G. Kim, D. Niu, R. Zheng, Y. Xie, J. Wu, Q. Wang, D. Xu, Y. Du, R. Julian, Y. Chebotar, S. Reed, J. Kautz, Y. Zhu, L. Fan, and J. Jang World action models are zero-shot policies. In ICLR 2026 the 2nd Workshop on World Models: Understanding, Modelling and Scaling, External Links: Link
58. Yuan et al. (2026) T. Yuan, Z. Dong, Y. Liu, and H. Zhao Fast-wam: do world action models need test-time future imagination?. arXiv preprint arXiv:2603.16666.
59. Zeng et al. (2026) M. Zeng, A. Agarwal, A. Bati, B. Lee, S. Ancha, and R. Tedrake Revisiting Open-Loop Execution in Robotics: Toward Reactive, Higher-Performing Policies. arXiv preprint arXiv:2608.15938. External Links: Link
60. Zhan et al. (2026) D. Zhan, X. Xu, J. Li, and J. Tang SEAM: Smooth Execution of Action-Chunked Motion for Vision-Language-Action Policies. arXiv preprint arXiv:2607.04609. External Links: Link
61. Zhang et al. (2026a) J. Zhang, R. Liu, Y. Zhang, and Y. Yang TraceFlow: Guiding Frozen Flow-Matching Robot Policies with Success and Failure Traces. arXiv preprint arXiv:2609.20646. External Links: Link
62. Zhang et al. (2026b) J. Zhang, Z. Han, J. Wang, X. Wu, S. Lin, J. Li, H. Fan, R. Wu, D. Li, and H. Dong HiPolicy: hierarchical multi-frequency action chunking for policy learning. arXiv preprint arXiv:2604.06067.
63. Zhao et al. (2026) Y. Zhao, M. Bogdanovic, A. Sohal, L. Tao, K. Darvish, A. Aspuru-Guzik, F. Shkurti, and A. Garg Dynamic Execution Horizon Prediction for Chunk-based Robot Policies. arXiv preprint arXiv:2606.11408. External Links: Link
64. Zheng et al. (2026) J. Zheng, J. Li, Z. Wang, D. Liu, X. Kang, Y. Feng, Y. Zheng, J. Zou, Y. Chen, J. Zeng, T. Wang, Y. Zhang, J. Liu, and X. Zhan X-VLA: soft-prompted transformer as scalable cross-embodiment vision-language-action model. In The Fourteenth International Conference on Learning Representations, External Links: Link
65. Zhou et al. (2026) Y. Zhou, R. Qiu, Y. Chen, J. Cui, and W. Zhi PATCH: Action-Chunk-Conditioned Latent Patch Innovation Monitoring for Robot Manipulation. arXiv preprint arXiv:2606.16690. External Links: Link
66. Zitkovich et al. (2023) B. Zitkovich, T. Yu, S. Xu, P. Xu, T. Xiao, F. Xia, J. Wu, P. Wohlhart, S. Welker, A. Wahid, Q. Vuong, V. Vanhoucke, H. Tran, R. Soricut, A. Singh, J. Singh, P. Sermanet, P. R. Sanketi, G. Salazar, M. S. Ryoo, K. Reymann, K. Rao, K. Pertsch, I. Mordatch, H. Michalewski, Y. Lu, S. Levine, L. Lee, T. E. Lee, I. Leal, Y. Kuang, D. Kalashnikov, R. Julian, N. J. Joshi, A. Irpan, B. Ichter, J. Hsu, A. Herzog, K. Hausman, K. Gopalakrishnan, C. Fu, P. Florence, C. Finn, K. A. Dubey, D. Driess, T. Ding, K. M. Choromanski, X. Chen, Y. Chebotar, J. Carbajal, N. Brown, A. Brohan, M. G. Arenas, and K. Han RT-2: vision-language-action models transfer web knowledge to robotic control. In Proceedings of The 7th Conference on Robot Learning, J. Tan, M. Toussaint, and K. Darvish (Eds.), Proceedings of Machine Learning Research, Vol. 229, pp. 2165–2183. External Links: Link

ChunkTrust: Adapting Execution Horizons for Robot Policies with Action-Expert Evidence Appendix

Appendix A Experimental Setup

We specify evaluation cohorts, checkpoints, scoring criteria, and implementation settings for the results in Sec. 5.

A.1 Real-world Experiments

Hardware Setup.

We conduct real-world experiments on an AgileX COBOT Magic platform configured as an ALOHA-style bimanual system (Fu et al., 2024a; Fu et al., 2024b), as shown in Fig. 6. The platform consists of four 6-DoF Piper arms, with two leader arms used for human teleoperation and two follower arms used for data collection and autonomous policy execution. The perception system includes three RealSense D435 cameras: one front-view camera and two wrist-mounted cameras, one on each follower arm.

Tasks and evaluation.

We collect 200 human-teleoperated demonstrations for each of four bimanual tasks and evaluate \pi_{0.5} with fixed K=25 or AHS over 15 rollouts per task. Data are recorded at 30 FPS, with task-relevant object positions varied across evaluation rollouts. Instructions are “Fold the towel with both arms,” “Move the bread to the plate with both arms,” “Move the drink to the basket with both arms,” and “Put the duck toy into the drawer with both arms.” These tasks cover approach, contact, transport, alignment, and placement (Fig. 4).

Process scores.

Each sub-step receives 0 for failure, 0.5 for recovered or imperfect completion, and 1 for smooth, accurate completion. We average equally over the task’s sub-steps and its rollouts, reporting the result as a percentage. Table 5 lists the task-specific criteria. Error bars in Fig. 4(b) show \pm s/\sqrt{15}, where s is the sample standard deviation of the 15 normalized rollout scores for each task and method. In the drawer task, the arm assignment depends on the layout: one arm opens/closes the drawer and the other manipulates the toy.

A.2 Simulation Experiments

RoboTwin2.0 (Chen et al., 2025) contains 50 bimanual manipulation tasks with strong domain randomization. The complete-suite evaluation in Tab. 1 uses one multitask \pi_{0.5} checkpoint on all 50 tasks, with 20 rollouts per task, setting, and method (2,000 per method). The eight-task evaluation uses 100 rollouts per task, setting, and method (1,600 per method), on Blocks Ranking RGB, Handover Block, Handover Mic, Hanging Mug, Place A2B Left, Place Bread Basket, Place Bread Skillet, and Place Can Basket. Each task is evaluated under two settings: Easy (clean scenes) and Hard (randomized object poses, lighting, and distractor placement). Results report success rate, averaged equally across the tasks and settings in each cohort.

RoboCasa GR1 Tabletop (Nasiriany et al., 2024) provides 24 pick and-place tasks spanning everyday object categories and novel source–target combinations. We evaluate all 24 tasks, using 50 rollouts per task for the \pi_{0.5} control. Results for the other policies use their respective evaluation budgets and reported numerical precision. Task success is determined by the native RoboCasa success checker.

A.3 Base Policy Checkpoints

For the eight-task RoboTwin2.0 evaluation, checkpoints follow the protocol of each base policy:

• \pi_{0} (Black et al., 2024): we train LoRA adapters (Hu et al., 2022) with the released RoboTwin2.0 fine-tuning protocol. For each evaluated task, one adapter is trained on that task’s clean50 demonstrations and then evaluated. The action chunk size is H=50, with a flow-matching action expert (Lipman et al., 2023) using 10 sampling steps.
• \pi_{0.5} (Intelligence et al., 2025): we use the official RoboTwin2.0 fine-tuning recipe for full-parameter fine-tuning. For each evaluated task, one task-specific checkpoint is trained on clean50 demonstrations and then evaluated. The action chunk size is H=50, with a flow-matching action expert (Lipman et al., 2023).
• X-VLA (Zheng et al., 2026): we evaluate the released X-VLA RoboTwin2.0 checkpoint. The action chunk size is H=30, with a flow-matching action expert.
• Fast-WAM (Yuan et al., 2026): we evaluate the released Fast-WAM multitask RoboTwin2.0 checkpoint on our eight-task subset, rather than post-training a separate policy for each task. The action chunk size is H=32, with a flow-matching action expert.

Multitask \pi_{0.5} checkpoints.

The complete-suite controls initialize from the official pi05_base and use benchmark-specific full-parameter post-training. RoboTwin2.0 uses 50 clean demonstrations per task (2,500 trajectories and 549,787 frames). RoboCasa GR1 uses 24,000 demonstrations and 6,020,058 frames across 24 tasks. Both use task-uniform sampling, one global quantile normalizer per benchmark, global batch size 256, seed 42, and eight H100 GPUs for training, with the checkpoint fixed at step 30,000. RoboTwin uses H=50 and Base K=50, while RoboCasa uses H=16 and Base K=16. The latter maps the raw 44-dimensional GR1 interface to 29 effective absolute controls in the padded policy interface. These controls share a policy architecture, not weights across benchmarks. Within each benchmark, Base and AHS use identical policy weights. Their evaluation runs on one RTX 4090.

For the other RoboCasa policies, Isaac-GR00T N1.5 and Isaac-GR00T N1.6 (Bjorck et al., 2025) use released base checkpoints without additional benchmark post-training. Qwen3GR00T uses the released 24-task multitask-post-trained GR1 checkpoint from StarVLA (Ye et al., 2026a; Community, 2026). Thus, “zero-shot” in Tab. 1 describes benchmark adaptation, not an absence of robot pretraining.

A.4 AHS Hyperparameter Configurations

Candidate sets and continuity windows depend on the policy and benchmark:

The scaling ablation compares \mathcal{K}_{5}=\{10,20,30,40,50\}, \mathcal{K}_{10}=\{5,10,\ldots,50\}, and \mathcal{K}_{50}=\{1,\ldots,50\}. Shared defaults are \alpha_{\mathrm{intra}}=\beta_{\mathrm{inter}}=4, \lambda=0.5, a_{0}=b_{0}=1, \rho_{f}=0.99, \eta=1, and \sigma_{K}=10. The eight-task study uses expected-round selection at T_{\mathrm{sel}}=0.8, with Thompson exploration probability \epsilon_{\mathrm{exp}}=0.05. The 50-task evaluation uses T_{\mathrm{sel}}=1.0, and the RoboCasa \pi_{0.5} control uses 0.8.

Spectral scoring zero-pads each velocity prefix to H before FFT, uses the first W_{\tau}=3 denoising steps as its reference, window RMS for z, and cutoff fraction c_{\mathrm{cut}}=0.25. Without sufficient executed history, AHS uses intra-chunk-only scoring (\lambda=0). Costs appear in Appendix D.1.

A.5 Evaluation Protocol

For every (base policy, task, setting) combination, we run a fixed number of rollouts with AHS enabled. Each rollout starts from the standard initial state distribution of the benchmark. The online AHS posterior is reset to its prior (a_{0}=b_{0}=1) at the beginning of each episode, so its rollout history is episode-local. When QHA is used, its learned weights are reused across episodes without online training. Success is determined by the benchmark’s native success checker. We report the raw success rate (percentage of successful rollouts) and equal-weight averages over the stated task and setting groups. Absolute differences are in percentage points. The \Delta (pp) columns subtract the corresponding success-rate percentages, rather than reporting relative percentage changes.

In the 50-task evaluation, 62 of the 100 task–setting conditions use exact same-seed and instruction pairing between Base and AHS. The other 38 use deterministic, method-specific fallback identities selected without outcome information after repeated scene-construction failures. The full-suite averages include both groups. Identical episode identities are not assumed for the fallback group.

For the main RoboTwin2.0 benchmarks, Fast-WAM inference uses one NVIDIA H100 (80 GB); \pi_{0}, \pi_{0.5}, and X-VLA use one RTX 4090 (24 GB). The RoboCasa \pi_{0.5} control also uses one RTX 4090. Hardware details for separate runtime profiles are discussed in Appendix D.1. Replanning frequency depends on the selected horizon and execution scheduler.

A.6 QHA Training Configurations

Training-task protocol (Tab. 2A).

We train one shared QHA per policy family (\pi_{0} or \pi_{0.5}) across all eight tasks, keeping the task-specific base generators frozen. Training uses their clean50 Aloha-AgileX LeRobot datasets, with task-balanced batches of 256 (32 per task). Inputs comprise three RGB streams, robot state, action windows, VLM context tokens \mathbf{C}_{t} with mask \mathbf{M}_{t}, and action-latent tokens \mathbf{Z}_{t}^{A} from the final chunk. The action-query window includes 64 history and 50 future steps. The frozen checkpoint generates the chunk \hat{\mathbf{A}}_{t}, evidence \mathcal{F}_{t}, and dense teacher \mu_{t}^{\star} online. The teacher follows Eq. 13 over h=1,\ldots,50 at T_{\mathrm{teach}}=1, using current evidence without episode-local Beta memory. The six-task held-out protocol is specified separately in Appendix C.1.

Architecture and optimization.

Context and action tokens are projected into a shared d=256 space with positional encodings. One bridge layer updates eight learned queries by cross-attending to masked context, then action tokens, followed by self-attention, each with residual connections (Vaswani et al., 2017). It uses eight attention heads, zero dropout, and an enabled fusion gate. Query pooling and an MLP produce 50 logits followed by a softmax. We minimize \operatorname{KL}(\mu_{t}^{\star}\|p_{\phi}) with weight 1 and numerical floor 10^{-6}. Only QHA parameters are updated and the base flow-matching loss is zero. AdamW runs for 10,000 steps with batch size 256, global-norm clipping 1, weight decay 10^{-10}, and EMA 0.99. The warmup-cosine schedule uses 1,000 warmup steps, peak learning rate 5\times 10^{-5}, and final rate 5\times 10^{-6}.

Deployment (Tab. 2A).

Each policy family uses its QHA checkpoint saved at step 10,000 after joint training on the eight tasks, with prior strength \gamma=1 in Eq. 14. Online evidence q_{\mathrm{mix},t}(k) is computed on \mathcal{K}=\{10,20,30,40,50\} and interpolated onto \{1,\ldots,H\} before Beta sampling. Both this sparse-evidence variant and the dense-evidence held-out variant maintain dense Beta states and apply temperature scaling, expected-round selection, and uniform exploration as in Sec. 4.1. Posterior feedback uses prior-weighted quality \tilde{q}_{\mathrm{mix},t}(h)p_{\phi}(h)^{\gamma}.

Held-out deployment (Tab. 2B).

This evaluation instead computes dense evidence over h=1,\ldots,50, with \gamma=1 and expected-round selection at T_{\mathrm{sel}}=1. Appendix C.1 specifies the six-task training split and checkpoints.

Appendix B Action-Expert Evidence Diagnostics

B.1 Evidence Distributions and Boundary Profiles

Data and aggregation.

We analyze the same 1,600 \pi_{0} RoboTwin2.0 episodes as Fig. 2: eight tasks, two settings, and 100 episodes per task–setting pair, with 291 successes and 1,309 failures. All episodes execute fixed K=H=50. The candidates k\in\{10,20,30,40,50\} are scored on these recorded traces. They are not five separate executed-horizon experiments.

For each candidate, we average finite scores over replans within an episode, then report medians and IQRs over episode means. The valid counts can differ between the two metrics because inter-chunk evidence requires executed history. The intra score follows Eq. 5, with prefixes zero-padded to H, a three-step baseline, and RMS over all ten denoising steps. Recomputed scores agree with the recorded values within 1.5\times 10^{-8}.

For boundary profiles, we compute first-difference speeds in the W_{h}=60 stitched window of Eq. 6, normalize by the window mean, and average within each episode before summarizing across episodes. This prevents longer episodes receiving extra weight.

B.2 Joint Risk and Episode Outcomes

At the executed K=50, each episode’s intra/inter risk is the 75th percentile of 1-q_{\mathrm{intra},t}(50) or 1-q_{\mathrm{inter},t}(50) over valid replans. Pooled median thresholds are 0.98168436 and 0.96278395, respectively. Values strictly below the threshold are low and ties are high, so group sizes can differ.

The map uses a 23\times 23 grid with 7% range padding and separable kernel [1,4,6,4,1]/16. Success/failure counts are smoothed separately before division (stabilizer 10^{-12}). Opacity scales to the 90th occupancy percentile, hiding cells below 10^{-3}.

Scope of the evidence.

These are pooled, retrospective associations from one policy and a fixed execution horizon. They do not establish causality, calibrated failure prediction, within-task effects independent of task difficulty, or how long a particular prefix remains reliable at the current replan. The benefit of adaptive execution is evaluated separately in the policy comparisons and ablations, not inferred from this heatmap.

Appendix C Full Simulation Benchmark Results

C.1 QHA Transfer to Held-out Tasks

For Tab. 2B, QHA is trained on Handover Block, Handover Mic, Hanging Mug, Place A2B Left, Place Bread Skillet, and Place Can Basket. Blocks Ranking RGB and Place Bread Basket are held out. The QHA head uses step 10,000, and frozen task-specific \pi_{0.5} bases use step-20,000 clean50 checkpoints without quantile normalization. All selectors use \{1,\ldots,50\} and expected-round selection at temperature 1.0. AHS+QHA uses \gamma=1.0. This cohort differs from the eight-task study in Tab. 2A.

AHS, QHA-only, and AHS+QHA share 100 episode identities per task and setting (400 per method). The Base results in Tab. 2B come from a separate evaluation outside this paired cohort. The transfer comparison is AHS+QHA versus AHS. Table 7 retains all four conditions: fusion improves two and reduces success in two. The aggregate gain does not establish uniform improvement or transfer of the base policy.

Same-state decision disagreement.

In AHS+QHA traces, the QHA and AHS component choices differ at 77.02% of 12,573 replans, with a mean absolute gap of 1.83 action steps. Easy contributes 5,533 replans (77.17%, 1.84 steps) and Hard 7,040 (76.90%, 1.82 steps). This measures differences at the same states, without establishing complementarity or explaining success gains.

C.2 Complete 50-task RoboTwin2.0 Evaluation

Table 8 expands the multitask \pi_{0.5} row of Tab. 1. Base and AHS succeed in 1,134 and 1,270 of 2,000 episodes, respectively, giving 56.70% and 63.50% overall. Easy success increases from 65.40% to 73.10%, and Hard from 48.00% to 53.90%. All 50 tasks are retained, including nine tasks with a negative change after averaging the two settings.

Statistical robustness and pairing scope.

The full-matrix gain is 6.80 percentage points, with a task-cluster 95% bootstrap interval of [3.75,\,9.95]. This interval resamples the 50 tasks, retaining both settings and methods within each task. Only 62 of 100 task–setting cells preserve exact seed-and-instruction pairing, while the remaining 38 cells use deterministic, outcome-blind, method-specific fallback identities after scene-construction failures. The 1,240 exact episode pairs yield a gain of 7.58 percentage points with a paired 95% interval of [5.08,\,10.08], resampling episodes within these cells. Both intervals use 10,000 bootstrap draws, but their statistical units and populations differ: the paired interval applies only to the exact-identity subset, not the full matrix.

C.3 Eight-task Policy-family Evaluation

The task-specific \pi_{0} and \pi_{0.5} matrices appear in Tab. 2A. Table 9 provides the corresponding Base–AHS breakdown for Fast-WAM and X-VLA (Zheng et al., 2026), evaluated on the same eight tasks with 100 rollouts per task and setting. Both use \mathcal{K}=\{10,20,30\}. Each Base–AHS comparison uses the same released policy checkpoint. Fast-WAM’s overall success increases from 86.81% to 88.13%. For X-VLA, AHS slightly improves overall success from 47.44% to 47.75%: Easy increases from 74.50% to 75.75%, while Hard decreases from 20.38% to 19.75%. Individual task regressions are retained for both policies.

C.4 RoboCasa GR1 Tabletop

Table 10 reports the full 24-task RoboCasa GR1 Tabletop breakdown for \pi_{0.5} and the three GR00T-family policies summarized in Tab. 1. QwenFAST (discrete tokens) and QwenPI (flow-matching action expert) are additional StarVLA baselines (Ye et al., 2026a; Community, 2026), both using Qwen3VL (Bai et al., 2025). Neither has an AHS counterpart in this table. For \pi_{0.5}, the 24-task means are 40.08% for Base and 42.50% for AHS, matching Tab. 1.

C.5 Horizon-selection Comparisons

Table 11 reports additional controls for horizon selection, separately from the cross-policy results in Tab. 1.

Fixed, action-only, and evidence-update selectors.

The \pi_{0} study uses Place A2B Left, Place Bread Basket, Place Bread Skillet, and Place Can Basket under Easy and Hard settings, with 16 paired episodes per task and setting (128 per selector). Instantaneous is a separate reference. This cohort differs from the 100-rollout studies in Tabs. 3 and 4. The global fixed horizon K=20 is selected retrospectively from previous evaluations, not from a held-out validation set. Jerk-min uses an action-only smoothness criterion on \mathcal{K}=\{10,20,30,40,50\}.

The evidence-update variants share this candidate grid and the same instantaneous evidence, using expected-round selection with temperature 0.8. Instantaneous uses q_{\mathrm{mix},t}(k), whereas EMA maintains m_{t}(k)=\rho_{\mathrm{EMA}}m_{t-1}(k)+(1-\rho_{\mathrm{EMA}})q_{\mathrm{mix},t}(k) with \rho_{\mathrm{EMA}}=0.99. Neither comparator uses Beta counts or kernel neighborhood sharing. Full Beta is the shared AHS reference. Results describe success and call-count trade-offs without exact compute matching. The paired 95% SR-difference interval between AHS and Jerk-min includes zero, so this compact study does not establish an SR advantage.

AAC-core on RoboCasa.

We evaluate a joint-space adapter of AAC (Liang et al., 2026) on Qwen3GR00T over 24 tasks with 50 rollouts per task. Each replan draws 20 action-head samples under the same observation and instruction. A prefix-entropy elbow and a movement guard determine K\in\{2,\ldots,16\}, and the first sampled chunk supplies the executed actions. The adapter operates on the policy’s native 29-dimensional absolute joint targets. It is not an exact reproduction of the published Cartesian-action implementation. AAC-core obtains 52.58% success. Base/AHS values from separate evaluations in Tab. 1 provide non-paired context only. We do not report a paired difference or infer compute equivalence from policy call counts.

Appendix D Runtime and Latency

D.1 Policy-call and Runtime Costs

We group runtime measurements by timing scope. Means include all episodes, including failures. Policy inference excludes separately timed horizon selection, but total inference includes it. Episode wall time includes simulation and within-episode overhead, not physical robot execution time. These are descriptive profiles, not hardware-matched cross-policy rankings.

Compact-selector timings are included with their success rates in Tab. 11.

Shared timing scope for \pi_{0.5}.

Table 12 reports policy-only inference time. Total inference time is unavailable for the 50-task study. QHA selection is outside the policy timer and is not timed separately. The AHS reference in Panel B has a total inference time of 3.49 s per episode. Both QHA variants make fewer calls but have higher policy-inference and wall times than this reference. These timings and the success rates in Tab. 2B come from different cohorts and cannot be combined to estimate success-normalized efficiency. These costs characterize the evaluated implementation, not an intrinsic QHA cost.

AAC-core sampling cost.

On RoboCasa GR1 Tabletop with Qwen3GR00T (24 tasks, 1,200 episodes), AAC-core averages 180.95 calls, 20.98 s of synchronized total inference, and 47.56 s of wall time per episode. Each call samples 20 action chunks, giving 4,342,740 chunks in total. No policy-only timing aggregate is available. Base/AHS references come from separate evaluations and are not paired with the AAC-core measurements. AAC-core, the 50-task study, the four-task selector comparison, and the QHA timing evaluation were run on an NVIDIA RTX 4090 GPU.

D.2 Latency and Asynchronous Execution

The policy prediction horizon is H=50. Fixed K=40 is a target execution budget. RTC can replace a chunk at the first legal waypoint boundary after readiness. The AHS candidates are \{10,20,30,40\}. This cohort uses no QHA and is separate from the K=50 candidate-scaling experiment.

Timing and aggregation.

For episode i, let a_{ij}=t^{\mathrm{start}}_{ij}-t^{\mathrm{obs}}_{ij} be the age of the observation used to generate executed action j. We compute \bar{a}_{i}=n_{i}^{-1}\sum_{j}a_{ij} and average \bar{a}_{i} equally over episodes within each task, then equally over the four tasks, separately for Easy and Hard. Failures are included.

Wait s/ep averages recorded hold time per episode. Wait % is 100\sum_{i}W_{i}/\sum_{i}T_{i}, where T_{i} includes both action execution and waiting. Calls/ep includes requests discarded at episode termination. Infer s/ep reports model computation time per episode, amortized across active batch requests and excluding selector computation.

Success within a time budget.

For T_{i}^{\mathrm{success}}, set the recorded completion time for a successful episode and +\infty for a failed episode. Then

\mathrm{SR}(t)=\frac{100}{4}\sum_{q=1}^{4}\frac{1}{100}\sum_{i\in q}\mathbf{1}\{T_{i}^{\mathrm{success}}\leq t\}.

Here t denotes physical time in seconds. Computed separately for each setting, \mathrm{SR}(t) measures task completion under a time budget, with all attempted episodes retained in the denominator.

Easy and Hard outcomes.

Both settings use the same task checkpoints, execution horizon and AHS candidates; episodes are paired across methods and delays within each setting. At +200 ms, RTC reduces AHS waiting by 94.5% on Easy and 95.6% on Hard. Relative to RTC-Fixed, RTC-AHS achieves higher aggregate SR in all six setting/delay conditions, with observed gains of 3.50–8.25 percentage points. At +200 ms, the paired 95% interval for this gain is [-0.75,8.26] points on Easy and [0.75,8.75] on Hard. Relative to Sync-AHS, RTC-AHS changes final SR by -2.00 points on Easy and +3.00 points on Hard at +200 ms. Thus, reduced waiting does not imply uniformly higher success. Policy calls and model computation remain higher than for RTC-Fixed (Tabs. 13, 14, and 15).