You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 78212ad
Browse filesBrowse the repository at this point in the historyBrowse files
feat(cua-driver): capture GNOME windows from their own actor (WinRects v10) (trycua#4882)
* feat(cua-driver): capture GNOME windows from their own actor (WinRects v10)
On GNOME Wayland, window screenshots were crops of the Shell stage.
GetRects proves a window's geometry, not that nothing covers it, so a
covered window's screenshot showed the app on top.
The WinRects helper gains two additive methods:
- CaptureWindow(id, pid), API 9: snapshot the window's own actor with
paint_to_content. Covered windows keep their content, nothing is
activated, and a 1x1 transparent clone keeps Mutter painting a fully
covered window for 4 s after the last capture. Refused while locked,
for minimized windows, and above 32 MiB.
- CaptureWindowPreview(id, pid, max), API 10: the same capture,
downscaled on the GPU, returning the full-size dimensions too.
The driver uses CaptureWindow whenever the attested helper reports
API 9 or newer, and then never falls back to a stage crop. Older
helpers keep the stage crop, so users who have not reinstalled the
helper keep window screenshots. A screenshot-only get_window_state
with a size cap uses CaptureWindowPreview (falling back to the full
capture on older helpers), and GNOME's per-capture Creation Time PNG
chunk is removed so unchanged preview frames compare equal.
list_windows asks a verified GNOME helper first instead of probing
other compositor protocols.
Versioning: the UUID stays winrects@cua. One UUID means one installed
copy per user; two UUIDs would race for org.cua.WinRects. API numbers
9 and 10 match T3 Code's bundled helper exactly, so either copy serves
both drivers. install.sh and both cua-driver installers no longer
downgrade a newer installed helper (install.sh --force still does).
The helper README documents the rules and the version table.
Ported from T3 Code's Linux patch to Cua Driver 0.34.0
(pingdotgg/t3code#16975, MIT, Copyright (c) 2026 T3 Tools Inc.). The
stage-crop fallback for older helpers and the no-downgrade installers
are new here.
Co-Authored-By: Claude Opus 5.5 <[email protected]>
* docs(cua-driver): credit every T3 Code Linux port in THIRD_PARTY_NOTICES
Co-Authored-By: Claude Opus 5.5 <[email protected]>
---------
Co-authored-by: Claude Opus 5.5 <[email protected]>
|[trope-cua](https://github.com/voctory/trope-cua)| Copyright (c) 2026 Victor Vannara |`crates/platform-windows` (`src/overlay.rs`, `src/input/`, `src/tools/impl_.rs`); `crates/cursor-overlay/src/motion.rs`, `crates/cursor-overlay/src/bezier.rs` (specific items only) | Windows cursor overlay, background input and layered pixel-click dispatch; in `cursor-overlay`, the `press_duration_ms` knob, the 80 ms dwell default, the former 20 s idle default, the `with_overrides` method shape and the cached 32-point arc-length helper |
17
-
|[Interface-Agent](https://github.com/francedot/Interface-Agent)| Copyright (c) 2024 Francesco Bonacci |`crates/platform-windows` (`src/uia/`, `src/win32/`, `src/tools/impl_.rs`) | Windows UI Automation tree walk, app and window enumeration, InvokePattern click and ValuePattern set-value |
|[QuickJS-ng](https://github.com/quickjs-ng/quickjs)| Copyright (c) 2017-2026 Fabrice Bellard; (c) 2017-2024 Charlie Gordon; (c) 2023-2026 Ben Noordhuis; (c) 2023-2026 Saúl Ibarra Corretgé |`crates/cua-driver-core/src/script_tool/` (compiled in through rquickjs-sys) | The JavaScript engine behind the experimental `run_script` tool |
20
-
|[rquickjs](https://github.com/DelSkayn/rquickjs)| Copyright (c) 2020 Mees Delzenne; (c) 2025 Rquickjs Contributors |`crates/cua-driver-core/src/script_tool/`| Rust bindings to QuickJS-ng |
21
-
|[T3 Code](https://github.com/pingdotgg/t3code)| Copyright (c) 2026 T3 Tools Inc. |`crates/cua-driver-sdk/src/embedded.rs` (`allowed_environment_name` and its test) | Linux fixes ported from T3 Code's patch to Cua Driver 0.34.0 ([pingdotgg/t3code#16975](https://github.com/pingdotgg/t3code/pull/16975), `patches/cua-driver-linux/0.34.0.patch`): the `CUA_DRIVER_RS_ENABLE_WAYLAND` embedded-host pass-through |
| [trope-cua](https://github.com/voctory/trope-cua) | Copyright (c) 2026 Victor Vannara | `crates/platform-windows` (`src/overlay.rs`, `src/input/`, `src/tools/impl_.rs`); `crates/cursor-overlay/src/motion.rs`, `crates/cursor-overlay/src/bezier.rs` (specific items only) | Windows cursor overlay, background input and layered pixel-click dispatch; in `cursor-overlay`, the `press_duration_ms` knob, the 80 ms dwell default, the former 20 s idle default, the `with_overrides` method shape and the cached 32-point arc-length helper |
17
+
| [Interface-Agent](https://github.com/francedot/Interface-Agent) | Copyright (c) 2024 Francesco Bonacci | `crates/platform-windows` (`src/uia/`, `src/win32/`, `src/tools/impl_.rs`) | Windows UI Automation tree walk, app and window enumeration, InvokePattern click and ValuePattern set-value |
| [QuickJS-ng](https://github.com/quickjs-ng/quickjs) | Copyright (c) 2017-2026 Fabrice Bellard; (c) 2017-2024 Charlie Gordon; (c) 2023-2026 Ben Noordhuis; (c) 2023-2026 Saúl Ibarra Corretgé | `crates/cua-driver-core/src/script_tool/` (compiled in through rquickjs-sys) | The JavaScript engine behind the experimental `run_script` tool |
20
+
| [rquickjs](https://github.com/DelSkayn/rquickjs) | Copyright (c) 2020 Mees Delzenne; (c) 2025 Rquickjs Contributors | `crates/cua-driver-core/src/script_tool/` | Rust bindings to QuickJS-ng |
21
+
| [T3 Code](https://github.com/pingdotgg/t3code) | Copyright (c) 2026 T3 Tools Inc. | `crates/cua-driver-sdk/src/embedded.rs` (`allowed_environment_name`); `crates/platform-linux/src/wayland/shell_helper.rs` and `shell_helper/transport.rs`; `crates/platform-linux/src/wayland/libei.rs` (input acknowledgement); `crates/platform-linux/src/wayland/mod.rs` and `src/tools/impl_.rs` (GNOME window capture); `../wayland-helper/winrects@cua/` (`CaptureWindow`, `CaptureWindowPreview`) | Linux fixes ported from T3 Code's patch to Cua Driver 0.34.0 ([pingdotgg/t3code#16975](https://github.com/pingdotgg/t3code/pull/16975), `patches/cua-driver-linux/0.34.0.patch`): the `CUA_DRIVER_RS_ENABLE_WAYLAND` embedded-host pass-through, the persistent session-bus transport for the GNOME helper, waiting for EIS to acknowledge libei input, and per-window GNOME capture with compositor-side preview downscaling (helper API 9 and 10) |
0 commit comments