Skip to content

feat(desktop): add inline conversation visualizations - #40582

Closed
Andihu wants to merge 3 commits into
anomalyco:devfrom
Andihu:desktop-visualization
Closed

Andihu wants to merge 3 commits into
anomalyco:devfrom
Andihu:desktop-visualization

Conversation

@Andihu

@Andihu Andihu commented Aug 5, 2026 •

Copy link
Copy Markdown

Issue for this PR

Closes #40583

Type of change

  • Bug fix
  • New feature
  • Refactor / code improvement
  • Documentation

What does this PR do?

Adds Desktop-only inline HTML visualizations to assistant conversations.

The model writes a versioned fragment through visualization_create; the Desktop host supplies a sandboxed srcdoc, transparent/theme-aware canvas, and content-height synchronization. Structured results survive both live V2 projection and history restoration. Web does not enable the renderer and fails closed without executing the HTML.

The iframe uses sandbox="allow-scripts", a network-disabled CSP, bounded/token-checked messages, and Desktop subframe navigation blocking. A visualization can request a follow-up prompt only through a host confirmation dialog. /visualize limits its first turn to the visualization tool, with a DeepSeek V4 fallback for models that reject required tool_choice.

How did you verify your code works?

  • Core visualization tests: 9 passed
  • OpenCode visualization/prompt tests: 59 passed, 1 existing V2-projector test skipped
  • Session UI document/schema/frame tests: 37 passed
  • App projection/follow-up tests: 48 passed
  • Desktop/CLI/UI focused tests: 8 passed
  • Web Playwright regression: 1 passed; no iframe or HTML execution
  • bun turbo typecheck: 30 packages passed in the pre-push hook
  • Prettier passed; targeted oxlint reported 0 errors
  • Built and signed a macOS arm64 package and manually verified live/history rendering, interaction, and transparent canvas behavior

Screenshots / recordings

Manually verified with generated clock and interactive control previews in the macOS Desktop conversation. The canvas matches the conversation background while bounded visualization surfaces keep their own background.

Checklist

  • I have tested my changes locally
  • I have not included unrelated changes in this PR

@github-actions github-actions Bot added needs:compliance This means the issue will auto-close after 2 hours. and removed needs:compliance This means the issue will auto-close after 2 hours. labels Aug 5, 2026
@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Thanks for updating your PR! It now meets our contributing guidelines. 👍

@github-actions

github-actions Bot commented Sep 5, 2026

Copy link
Copy Markdown
Contributor

Automated PR Cleanup

Thank you for contributing to opencode.

Due to the high volume of PRs from users and AI agents, we periodically close older PRs using automated criteria so maintainers can focus review time on the most active and community-supported contributions.

This PR was closed because it matched the following cleanup criteria:

  • The PR was created more than 1 month ago
  • The PR had fewer than 2 positive reactions
  • Positive reactions are counted as thumbs-up, heart, celebration, or rocket reactions on the PR

PRs created within the last month are not affected by this cleanup.

If you believe this PR was closed incorrectly, or if you are still actively working on it, please leave a comment explaining why it should be reopened. A maintainer can review and reopen it if appropriate.

Thanks again for taking the time to contribute.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[FEATURE]: Desktop inline conversation visualizations

1 participant