Skip to content

Commit 5512448

Browse files
Merge main into core-template_entry_structural_detection
One conflict, in packages/core/src/runtime/compositionLoader.ts: both import lines are needed (findSceneTemplate from this branch, wallClearTimeout and wallSetTimeout from main). — Jerrai
2 parents 4c89caa + 7ad2be9 commit 5512448

215 files changed

Lines changed: 11737 additions & 742 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

‎.claude-plugin/plugin.json‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
{
22
"name": "hyperframes",
33
"description": "HyperFrames by HeyGen. Write HTML, render video. Compositions, GSAP and runtime adapter animations, captions, voiceovers, audio-reactive visuals, and website capture for HyperFrames.",
4-
"version": "0.9.19",
4+
"version": "0.9.23",
55
"author": {
66
"name": "HeyGen",
77
"email": "[email protected]",

‎.codex-plugin/plugin.json‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
{
22
"name": "hyperframes",
33
"description": "Write HTML, render video. Compositions, Tailwind v4 styles, GSAP and runtime adapter animations, captions, voiceovers, audio-reactive visuals, and website capture for HyperFrames.",
4-
"version": "0.9.19",
4+
"version": "0.9.23",
55
"author": {
66
"name": "HeyGen",
77
"email": "[email protected]",

‎.cursor-plugin/plugin.json‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33
"name": "hyperframes",
44
"displayName": "HyperFrames by HeyGen",
55
"description": "Write HTML, render video. Compositions, Tailwind v4 styles, GSAP and runtime adapter animations, captions, voiceovers, audio-reactive visuals, and website capture for HyperFrames.",
6-
"version": "0.9.19",
6+
"version": "0.9.23",
77
"author": {
88
"name": "HeyGen",
99
"email": "[email protected]"

‎.github/workflows/ci.yml‎

Lines changed: 10 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1009,6 +1009,8 @@ jobs:
10091009
packages/studio/data/projects/undo-socket-pool
10101010
cp -R packages/studio/tests/e2e/fixtures/aroll-backdrop \
10111011
packages/studio/data/projects/aroll-backdrop
1012+
cp -R packages/studio/tests/e2e/fixtures/preview-video-regression \
1013+
packages/studio/data/projects/preview-video-regression
10121014
- name: Build the base the viewport gate compares against
10131015
# The first parent of the checked-out commit, as in base-file.sh. Measured only when the head misses a budget.
10141016
run: |
@@ -1181,7 +1183,7 @@ jobs:
11811183
- name: Install ffmpeg for the paused-video fixture
11821184
if: success() || failure()
11831185
uses: ./.github/actions/install-ffmpeg-linux
1184-
- name: Undo while paused videos hold the preview's sockets
1186+
- name: Verify paused-video sockets, picture quality and native recovery
11851187
# Counts the undo's wait for a socket, not its total time: unpinned it is 0 ms.
11861188
if: success() || failure()
11871189
run: |
@@ -1200,6 +1202,12 @@ jobs:
12001202
STUDIO_URL="http://localhost:5318/#project/undo-socket-pool" \
12011203
STUDIO_PROJECT_DIR="$PWD/packages/studio/data/projects/undo-socket-pool" \
12021204
node packages/studio/tests/e2e/undo-socket-pool.mjs | tee /tmp/undo-socket-pool.json
1205+
node packages/studio/tests/e2e/fixtures/preview-video-regression/generate.mjs \
1206+
packages/studio/data/projects/preview-video-regression
1207+
STUDIO_URL="http://localhost:5318/#project/preview-video-regression" \
1208+
STUDIO_PROJECT_DIR="$PWD/packages/studio/data/projects/preview-video-regression" \
1209+
OUT_DIR=/tmp/preview-video-regression \
1210+
node packages/studio/tests/e2e/preview-video-regression.mjs
12031211
- name: Upload gate evidence
12041212
# The gate's whole output is machine-readable evidence, and a red run is
12051213
# exactly when someone needs to read it. Keep it on failure too.
@@ -1212,6 +1220,7 @@ jobs:
12121220
/tmp/studio-open-counts.json
12131221
/tmp/inline-text-caret/*.png
12141222
/tmp/undo-socket-pool.json
1223+
/tmp/preview-video-regression/
12151224
if-no-files-found: error
12161225

12171226
# Manual editing accuracy in the built Studio, gated against the base branch's baseline.json. A pull request

‎bun.lock‎

Lines changed: 2 additions & 2 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎docs/changelog.mdx‎

Lines changed: 157 additions & 0 deletions
Large diffs are not rendered by default.

‎docs/packages/cli.mdx‎

Lines changed: 28 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -885,6 +885,12 @@ Sentences come from a transcript: `--transcript <file>`, or
885885
`<recording>.transcript.json` beside the recording. Without one, voice lines
886886
carry no words.
887887

888+
A file you know holds one layer is read whole with `--layer music|sfx|voice`:
889+
no stems are fetched and nothing leaves the machine, whatever `--quality` says.
890+
`music` reads the file as the music bed (sections, tempo, levels), `voice` reads
891+
words and pauses from it, `sfx` finds its effects. The JSON result records the
892+
declared `layer`; without the flag the read is unchanged.
893+
888894
Effects and music are read from stems. At `--quality best` the
889895
recording is separated into vocals, drums, bass, guitar, piano and other by
890896
HeyGen's `/v3/audio/stems`, with your HeyGen credential (see
@@ -1149,6 +1155,13 @@ installed, `open` exits 1 and prints a download link. With `--json`, the result
11491155
names the `reason` and the `downloadUrl`. The hand-off works on macOS, Windows
11501156
and Linux.
11511157

1158+
The app can't edit a project while a preview of it is running, because the
1159+
preview holds the project's edit history. So `open` first stops the project's
1160+
`preview --background` server and says so. It leaves any other preview running,
1161+
such as one started in a terminal, and prints the `preview --stop` command
1162+
instead. With `--json`, the `preview` field reports `none`, `stopped` or
1163+
`left-running`.
1164+
11521165
`catch-up` is the other half of that hand-off. Run it when the person is back
11531166
from the desktop app, before you change anything: it lists what they asked and
11541167
what changed in the app since you last looked, and the files changed since
@@ -1196,6 +1209,12 @@ unless you pass `--verbose`, which keeps output clean for agents and CI.
11961209
`--lint-verbose`, which `render`, `preview` and `publish` use for the same wish, works here and on `check` too.
11971210
`--json` adds `errorCount`, `warningCount`, `infoCount`, and a `findings` array.
11981211

1212+
Only the compositions the project uses are linted: `index.html` and every file it mounts through
1213+
`data-composition-src`, followed through the files they mount. A file under `compositions/` that
1214+
nothing mounts (an installed block you have not placed yet) is left out, and one line says how
1215+
many were; `--include-unmounted` lints them too. `--json` lists them in `unmountedCompositions`.
1216+
`check` lints the same way and takes the same flag.
1217+
11991218
The linter catches missing attributes, missing adapter libraries (GSAP, Lottie,
12001219
Three.js), and structural problems. [Troubleshooting](/help)
12011220
explains each rule.
@@ -1240,6 +1259,7 @@ cover every finding from the full check.
12401259
| -------------------------------------------- | --------------------------------------------------------------------------------------------------------------------------- |
12411260
| `--json` | One aggregated envelope. Every finding carries a selector, `data-*` identity, source file, bbox, and sample time. |
12421261
| `--snapshots` | Save the five audited frames under `.hyperframes/artifacts/snapshots/`, plus a `finding-NN-<code>.png` crop per finding |
1262+
| `--include-unmounted` | Also lint `compositions/` files that `index.html` never mounts (left out by default, with one line saying how many) |
12431263
| `--samples` | Midpoint samples across the duration (default 9) |
12441264
| `--at` | Explicit timestamps in seconds, comma-separated |
12451265
| `--at-transitions` | Also sample every tween start and end, to catch transient overlaps at transition seams |
@@ -1269,6 +1289,10 @@ and ends a copy that makes no progress for 3 minutes (`HYPERFRAMES_PROXY_STALL_M
12691289
For a long project, run `hyperframes check --prepare-media` first, then the check itself finds
12701290
every copy ready.
12711291

1292+
A Chrome that is not ready 3 minutes after the check begins to start it ends the check with a runtime
1293+
finding that says Chrome did not start and how long each step took. On a first run Chrome may still be
1294+
downloading: run `hyperframes browser ensure` once, then run check again.
1295+
12721296
`--caption-zone` and `--frame-check` refuse a ranged check when none of their
12731297
configured seek samples falls inside `--range`; a requested gate never silently
12741298
passes without running.
@@ -1366,6 +1390,10 @@ The check runs alongside the browser pass, up to four files at a time. A clip
13661390
longer than 3 s is first sampled at three 1-second spots and decoded in full
13671391
only if all three are silent.
13681392

1393+
Overlap is judged on the text a viewer can see: a part of a text block that an
1394+
overflow clip, a `clip-path` or a gradient `mask-image` (on the text or an ancestor)
1395+
keeps from painting does not count.
1396+
13691397
#### Mark intentional layout choices
13701398

13711399
When the audit is wrong because the layout is deliberate, say so in the HTML and

‎docs/packages/player.mdx‎

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -100,6 +100,12 @@ console.log(player.duration, player.paused, player.ready);
100100
console.log(player.compositionWidth, player.compositionHeight);
101101
```
102102

103+
In Studio previews, scrubbing keeps the last complete picture visible while video
104+
layers decode at the requested time. Rapid seeks keep only the latest queued
105+
destination, and the captions and video layers appear together once it is ready.
106+
Complete intermediate pictures can appear during a drag. Jumping to a different
107+
clip supersedes an earlier pending seek; failed sources do not hold up the preview.
108+
103109
## Events
104110

105111
```js

‎docs/packages/studio.mdx‎

Lines changed: 27 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -106,6 +106,33 @@ depends on the browser playing in real time, while render captures frames one at
106106
time. A heavy project can therefore stutter during preview and still render every
107107
frame.
108108

109+
Paused video scrubbing decodes and stages the visible video layers before
110+
advancing the composition's animations. Completed frames appear during a drag,
111+
with newer pointer positions coalesced into the next decode. Canvas and GPU
112+
effects consume the same staged pixels. Continuous playback uses native video;
113+
Studio keeps the paused picture visible while those videos catch up before Play.
114+
A native handoff waits for ready frames for up to ten seconds; Pause or a new
115+
seek cancels it. At the deadline, the rest plays while each unready video keeps
116+
its last full-quality picture. During playback, native frame presentation or
117+
playback progress releases that picture; normal transport sync corrects drift.
118+
Paused recovery still waits for its requested frame. A skipped source keeps its
119+
picture on subsequent Play requests until it recovers.
120+
A paused fallback that outlasts its wait retains the presented clock and picture,
121+
while paused sync continues. It can still publish when the video becomes ready;
122+
a new gesture cancels that recovery. Studio requests paused-decoder release
123+
before preparing native playback and reopens readers when paused scrubbing resumes.
124+
Paused-reader release waits up to two seconds for transparent video queries to
125+
drain. After that it cancels their downloads and lets playback continue while
126+
unfinished merges close in the background; input disposal still waits for the
127+
merge to finish. A recovering video more than half a second out of sync with the transport
128+
gets at most one corrective seek per recovery registration before its retained picture is removed.
129+
Scrubbing and paused frame steps decode the original video at source resolution
130+
throughout. Automatic playback quality reductions do not reduce these frames,
131+
and the frame decoder does not substitute re-encoded seek copies. Playback
132+
quality settings do not reduce these paused frames. Browsers or
133+
media that cannot use the frame decoder fall back to native seeking. Long-GOP
134+
sources can take longer to seek, especially backward or across distant cuts.
135+
109136
## Tailwind preset
110137

111138
```typescript

‎gemini-extension.json‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
{
22
"name": "hyperframes",
3-
"version": "0.9.19",
3+
"version": "0.9.23",
44
"description": "HyperFrames by HeyGen. Write HTML, render video. Compositions, GSAP and runtime adapter animations, captions, voiceovers, audio-reactive visuals, and website capture for HyperFrames."
55
}

0 commit comments

Comments
 (0)