Skip to content

Add verify-ui-change-in-cloud and test-warp-ui bundled skills (dogfood-gated)#10203

Merged
cephalonaut merged 1 commit intomasterfrom
matthew/verify-ui-change-in-cloud
May 6, 2026
Merged

Add verify-ui-change-in-cloud and test-warp-ui bundled skills (dogfood-gated)#10203
cephalonaut merged 1 commit intomasterfrom
matthew/verify-ui-change-in-cloud

Conversation

@cephalonaut
Copy link
Copy Markdown
Contributor

Description

Add two new bundled skills gated to dogfood (Local/Dev) builds via resources/channel-gated-skills/dogfood/:

  • verify-ui-change-in-cloud: After a user-facing client change, spawns a cloud agent with computer use via run_agents to verify the change visually. Detects the current repo (warp-internal or warp-external) and selects the correct environment.
  • test-warp-ui: Guides a cloud agent through launching Warp with cargo run and testing UI behavior using the computer_use tool. Used by the cloud agent spawned by verify-ui-change-in-cloud.

No Rust code changes — both skills are auto-discovered by the channel-gated build system.

Testing

  • cargo test -p ai passes (skill parsing tests)

Agent Mode

  • Warp Agent Mode - This PR was created via Warp's AI Agent Mode

Co-Authored-By: Oz [email protected]

@cla-bot cla-bot Bot added the cla-signed label May 5, 2026
@cephalonaut cephalonaut requested a review from danielpeng2 May 5, 2026 23:18
@cephalonaut cephalonaut marked this pull request as ready for review May 5, 2026 23:18
@oz-for-oss
Copy link
Copy Markdown
Contributor

oz-for-oss Bot commented May 5, 2026

@cephalonaut

I'm starting a first review of this pull request.

You can view the conversation on Warp.

I completed the review and no human review was requested for this pull request.

Comment /oz-review on this pull request to retrigger a review (up to 3 times on the same pull request).

Powered by Oz

Copy link
Copy Markdown
Contributor

@oz-for-oss oz-for-oss Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overview

This PR adds two dogfood-gated bundled skills for cloud-based UI verification. The workflow is directionally useful, but the current instructions would not run in the target repository and include an unsafe secret-passing pattern.

Concerns

  • verify-ui-change-in-cloud only recognizes warp-internal and warp-external, so it stops when run from the warpdotdev/warp repository where this PR lands.
  • test-warp-ui expands STAGING_USER_WARP_API_KEY into --api-key, which exposes the key in process arguments; use the supported WARP_API_KEY environment variable instead and update the repeated example.

Security

  • Passing the staging API key via --api-key exposes it through process argv for both cargo and the launched app.

Verdict

Found: 0 critical, 3 important, 0 suggestions

Request changes

Comment /oz-review on this pull request to retrigger a review (up to 3 times on the same pull request).

Powered by Oz

Launch Warp from the repository root with:

```bash
cargo run -- --api-key $STAGING_USER_WARP_API_KEY
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ [IMPORTANT] [SECURITY] Expanding the staging key into --api-key exposes it in process argv for cargo and Warp; use WARP_API_KEY=$STAGING_USER_WARP_API_KEY cargo run instead.


Call the `computer_use` tool with a task description that includes:

- The command to build and launch Warp (typically `cargo run -- --api-key $STAGING_USER_WARP_API_KEY` from the repo root)
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ [IMPORTANT] [SECURITY] This repeats the argv secret pattern; update the example to use WARP_API_KEY=$STAGING_USER_WARP_API_KEY cargo run so the key is not passed as a command-line argument.

- **warp-external** (remote URL contains `warpdotdev/warp-external`):
- Environment: `zCOubHZzfNWbqgxhiEqdC1` (the warp-external Dev Environment)

If the remote URL does not match either repository, warn the user that this skill only supports warp-internal and warp-external and stop.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ [IMPORTANT] This PR targets warpdotdev/warp, but the detection only accepts warp-internal or warp-external, so the skill stops in the repo where it ships; add a warpdotdev/warp mapping or match the actual dogfood remote.

@cephalonaut cephalonaut force-pushed the matthew/verify-ui-change-in-cloud branch 2 times, most recently from d085dab to 21b0710 Compare May 6, 2026 01:10
…d-gated)

Add two new bundled skills gated to dogfood (Local/Dev) builds:

- verify-ui-change-in-cloud: spawns a cloud agent with computer use to
  verify user-facing client changes after they are made
- test-warp-ui: guides a cloud agent through launching Warp and testing
  UI behavior using the computer_use tool

Co-Authored-By: Oz <[email protected]>
@cephalonaut cephalonaut force-pushed the matthew/verify-ui-change-in-cloud branch from 21b0710 to 874e497 Compare May 6, 2026 01:11
@cephalonaut cephalonaut enabled auto-merge (squash) May 6, 2026 01:23
@cephalonaut cephalonaut merged commit fe5a2ed into master May 6, 2026
24 checks passed
@cephalonaut cephalonaut deleted the matthew/verify-ui-change-in-cloud branch May 6, 2026 01:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants