Invoke page.hover on agent move action #1456

shrey150 · 2025-12-22T19:17:41Z

why

CUA agents couldn't hover over elements to reveal tooltips without clicking
move action was implemented as a no-op, silently returning success without dispatching mouse events
This was noticed when highlightCursor was set to true

what changed

Modified move case in v3CuaAgentHandler.ts to call page.hover(x, y) instead of just returning success
This dispatches mouseMoved CDP events and triggers CSS :hover states

test plan

Created local test with hover-triggered tooltips
Verified hover_at actions now trigger mouseenter events and display tooltips
Confirmed clicks still work correctly

Summary by cubic

Fix agent move to trigger hover effects, so tooltips and CSS :hover states appear without clicks. Also records hover steps with a selector during recording for replay.

Bug Fixes
- Invoke page.hover(x, y) in the move case of v3CuaAgentHandler when coordinates are provided.
- Emits mouseMoved/mouseenter events; verified tooltips show and clicks still work.
New Features
- When recording, capture the hovered element’s XPath and log a hover action for replay.

^{Written for commit 66d93de. Summary will update automatically on new commits.}

changeset-bot · 2025-12-22T19:17:45Z

🦋 Changeset detected

Latest commit: 66d93de

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 3 packages

Name	Type
@browserbasehq/stagehand	Patch
@browserbasehq/stagehand-evals	Patch
@browserbasehq/stagehand-server	Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

cubic-dev-ai

No issues found across 2 files

greptile-apps · 2025-12-22T19:21:08Z

Greptile Summary

Implements hover functionality for CUA agent move actions by calling page.hover(x, y) instead of silently returning success. This properly dispatches mouse movement events and triggers CSS :hover states, enabling tooltips and hover effects. The implementation includes recording support with XPath capture for replay functionality, following the same pattern as other pointer actions (click, doubleClick, drag).

Confidence Score: 5/5

This PR is safe to merge with minimal risk
The change follows existing patterns in the codebase for pointer actions (click, doubleClick, drag), properly handles edge cases with coordinate validation, and includes both recording and non-recording modes. The implementation is straightforward and addresses a legitimate bug where move actions were no-ops.
No files require special attention

Important Files Changed

Filename	Overview
.changeset/fancy-spies-serve.md	Standard changeset file documenting the patch version change for the hover functionality
packages/core/lib/v3/handlers/v3CuaAgentHandler.ts	Implemented `page.hover(x, y)` for move action with recording support; properly handles coordinates and integrates with replay functionality

Sequence Diagram

sequenceDiagram
    participant Agent as CUA Agent
    participant Handler as V3CuaAgentHandler
    participant Page as Playwright Page
    participant DOM as Browser DOM
    
    Agent->>Handler: execute move action (x, y)
    Handler->>Handler: Check if x, y are numbers
    
    alt Recording Mode
        Handler->>Page: hover(x, y, { returnXpath: true })
        Page->>DOM: Dispatch mouseMoved events
        DOM-->>Page: XPath of hovered element
        Page-->>Handler: XPath string
        Handler->>Handler: ensureXPath(xpath)
        Handler->>Handler: recordCuaActStep(action, stagehandAction)
    else Non-Recording Mode
        Handler->>Page: hover(x, y)
        Page->>DOM: Dispatch mouseMoved events
        DOM-->>Page: Hover complete
    end
    
    DOM->>DOM: Trigger CSS :hover states
    DOM->>DOM: Fire mouseenter events
    Handler-->>Agent: { success: true }

greptile-apps

_{1 file reviewed, 1 comment}

_{Edit Code Review Agent Settings | Greptile}

packages/core/lib/v3/handlers/v3CuaAgentHandler.ts

shrey150 · 2025-12-22T20:34:10Z

@greptileai

greptile-apps · 2025-12-22T20:36:48Z

Greptile's behavior is changing!

From now on, if a review finishes with no comments, we will not post an additional "statistics" comment to confirm that our review found nothing to comment on. However, you can confirm that we reviewed your changes in the status check section.

_{This feature can be toggled off in your Code Review Settings by deselecting "Create a status check for each PR".}

@tkattkat

shrey150 added 2 commits December 22, 2025 11:12

invoke page.hover on move action

0336fa6

Add changeset

50417ac

cubic-dev-ai bot reviewed Dec 22, 2025

View reviewed changes

greptile-apps bot reviewed Dec 22, 2025

View reviewed changes

packages/core/lib/v3/handlers/v3CuaAgentHandler.ts Show resolved Hide resolved

Add replay support

66d93de

seanmcguire12 approved these changes Dec 22, 2025

View reviewed changes

shrey150 merged commit f261051 into main Dec 22, 2025
20 checks passed

This was referenced Dec 22, 2025

Version Packages #1414

Merged

Version Packages shaneholloman/stagehand#1

Open

Version Packages CloudEngineHub/stagehand#1

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Invoke page.hover on agent move action #1456

Invoke page.hover on agent move action #1456

Uh oh!

shrey150 commented Dec 22, 2025 •

edited by cubic-dev-ai bot

Loading

Uh oh!

changeset-bot bot commented Dec 22, 2025 •

edited

Loading

Uh oh!

cubic-dev-ai bot left a comment

Uh oh!

greptile-apps bot commented Dec 22, 2025 •

edited

Loading

Uh oh!

greptile-apps bot left a comment

Uh oh!

Uh oh!

shrey150 commented Dec 22, 2025

Uh oh!

greptile-apps bot commented Dec 22, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Invoke page.hover on agent move action #1456

Invoke page.hover on agent move action #1456

Uh oh!

Conversation

shrey150 commented Dec 22, 2025 • edited by cubic-dev-ai bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

why

what changed

test plan

Summary by cubic

Uh oh!

changeset-bot bot commented Dec 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🦋 Changeset detected

Uh oh!

cubic-dev-ai bot left a comment

Choose a reason for hiding this comment

Uh oh!

greptile-apps bot commented Dec 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Greptile Summary

Confidence Score: 5/5

Important Files Changed

Sequence Diagram

Uh oh!

greptile-apps bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

shrey150 commented Dec 22, 2025

Uh oh!

greptile-apps bot commented Dec 22, 2025

Greptile's behavior is changing!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

shrey150 commented Dec 22, 2025 •

edited by cubic-dev-ai bot

Loading

changeset-bot bot commented Dec 22, 2025 •

edited

Loading

greptile-apps bot commented Dec 22, 2025 •

edited

Loading