Skip to content

Add Latin check to prevent binary data from being treated as UTF-8 text#2719

Merged
jmthomas merged 4 commits intomainfrom
encoding
Jan 10, 2026
Merged

Add Latin check to prevent binary data from being treated as UTF-8 text#2719
jmthomas merged 4 commits intomainfrom
encoding

Conversation

@jmthomas
Copy link
Copy Markdown
Member

@jmthomas jmthomas commented Jan 8, 2026

Binary data like 0xDEAD that happens to be valid UTF-8 (decodes to U+07AD Thaana script) was incorrectly being treated as text. This adds a check to ensure only characters in the Latin range (U+0000-U+00FF) are treated as text, excluding C1 control characters (U+0080-U+009F).

Note: this issue is causing the failure in the Enterprise playwright test command-queue.spec.ts

…F-8 text

Binary data like 0xDEAD that happens to be valid UTF-8 (decodes to U+07AD
Thaana script) was incorrectly being treated as text. This adds a check to
ensure only characters in the Latin range (U+0000-U+00FF) are treated as
text, excluding C1 control characters (U+0080-U+009F).

Co-Authored-By: Claude Opus 4.5 <[email protected]>
@codecov
Copy link
Copy Markdown

codecov bot commented Jan 8, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 79.24%. Comparing base (afc2506) to head (8920e6b).
⚠️ Report is 14 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2719      +/-   ##
==========================================
- Coverage   79.25%   79.24%   -0.02%     
==========================================
  Files         664      664              
  Lines       52845    52882      +37     
  Branches      734      734              
==========================================
+ Hits        41882    41905      +23     
- Misses      10883    10897      +14     
  Partials       80       80              
Flag Coverage Δ
python 81.14% <ø> (-0.03%) ⬇️
ruby-api 84.76% <ø> (-0.06%) ⬇️
ruby-backend 82.16% <100.00%> (-0.01%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@jmthomas jmthomas requested a review from ryanmelt January 9, 2026 16:49
@jmthomas jmthomas merged commit 82af509 into main Jan 10, 2026
47 checks passed
@jmthomas jmthomas deleted the encoding branch January 10, 2026 00:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants