Skip to content

Task log profiler optimizations#8303

Merged
lotas merged 2 commits intomainfrom
feat/task-log-profiler-improvements
Feb 24, 2026
Merged

Task log profiler optimizations#8303
lotas merged 2 commits intomainfrom
feat/task-log-profiler-improvements

Conversation

@lotas
Copy link
Contributor

@lotas lotas commented Feb 20, 2026

feat(web-server): optimize task log profiler memory usage and output size

  • fixes log parse RegExp to match more/all lines
  • using component group for markers (was using log level by mistake)
  • Stream log input line-by-line via lineIterator instead of loading entire log into memory
  • Use Firefox Profiler's unique-string format to store log messages as string table indices, enabling deduplication
  • Use log level (info/warn/error) as marker name instead of component
  • Remove redundant hour/date fields from marker data
  • Add gzip compression to profile response
  • Enforce 200MB log size limit (HTTP 413)
  • Replace readLogFile/fixupLogRows/buildProfileFromLogRows with StreamingProfileBuilder class for single-pass construction

Fixes #8300

@lotas lotas marked this pull request as ready for review February 23, 2026 15:21
@lotas lotas requested a review from a team as a code owner February 23, 2026 15:21
@lotas lotas requested review from matt-boris and petemoore and removed request for a team February 23, 2026 15:21
…size

- Stream log input line-by-line via lineIterator instead of loading
entire log into memory
- Use Firefox Profiler's unique-string format to store log messages as
string table indices, enabling deduplication
- Use log level (info/warn/error) as marker name instead of component
- Remove redundant hour/date fields from marker data
- Add gzip compression to profile response
- Enforce 200MB log size limit (HTTP 413)
- Replace readLogFile/fixupLogRows/buildProfileFromLogRows with
StreamingProfileBuilder class for single-pass construction
@lotas lotas force-pushed the feat/task-log-profiler-improvements branch from 60cf8a9 to 49581f5 Compare February 23, 2026 15:21
@lotas lotas changed the title WIP: Task log profiler optimizations Task log profiler optimizations Feb 23, 2026
@lotas lotas force-pushed the feat/task-log-profiler-improvements branch from 49581f5 to d7db795 Compare February 24, 2026 14:30
Copy link
Contributor

@matt-boris matt-boris left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚢

@lotas lotas enabled auto-merge February 24, 2026 14:33
@lotas lotas disabled auto-merge February 24, 2026 14:33
@lotas lotas enabled auto-merge (squash) February 24, 2026 14:33
@lotas lotas merged commit d569d38 into main Feb 24, 2026
73 checks passed
@lotas lotas deleted the feat/task-log-profiler-improvements branch February 24, 2026 14:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

502's fetching task log profile

2 participants