Repository navigation
Commit baf65ee
test(evals): busy preview tab recovery case and an ordinary-timeout control
The busy control reason added for #32849 is new agent-facing tool-result text.
preview-busy-tab-opens-new-tab resumes a thread right after preview_act
returned the busy error, and passes when the first tab-touching preview call
is preview_open with reuseExistingTab=false or t3_preview_close on the stuck
tab. preview-wait-timeout-keeps-tab is its control: after a plain wait_for
timeout the agent keeps working in the same tab.
The runner now replays a prior result that decodes as a contracts
PreviewAutomationError as T3 sends it, an error result carrying the class's
own message, so the case never copies the text. A new firstCall check grades
the first call among a set of tools against alternatives.
Co-Authored-By: Claude Opus 5.5 <[email protected]>1 parent b088b88 commit baf65ee
4 files changed
Lines changed: 56 additions & 3 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
27 | 27 | | |
28 | 28 | | |
29 | 29 | | |
| 30 | + | |
30 | 31 | | |
31 | | - | |
| 32 | + | |
32 | 33 | | |
33 | 34 | | |
34 | 35 | | |
| |||
0 commit comments