Skip to content

Add ignore patterns for large binary files to prevent virtual memory … - #2761

Closed
zelenkovsky wants to merge 1 commit into
anomalyco:devfrom
zelenkovsky:fix/ignore-large-binary-files
Closed

zelenkovsky wants to merge 1 commit into
anomalyco:devfrom
zelenkovsky:fix/ignore-large-binary-files

Conversation

@zelenkovsky

Copy link
Copy Markdown

Try to exclude potentially large binary files to avoid memory overcommitement issue (#2585)

  • Added archive files: tar.gz, tgz, tar, zip, 7z, rar, bz2, xz, gz, lz4, zst
  • Added database files: db, sqlite, sqlite3
  • Added binary executables: exe, dll, so, dylib, app, dmg, pkg, msi, deb, rpm
  • Added compiled artifacts: jar, war, ear, class, o, a, pyc, pyo
  • Added media files: mp4, avi, mkv, mov, mp3, wav, flac, pdf
  • Added cache directories: pycache, .cache, cache, .pytest_cache, .tox

This resolves high virtual memory consumption during startup when large archive files are present in the working directory.

Uses a 2x2 matrix approach: Binary vs Text × Large vs Small

BINARY FILES (always ignored):
- Executables: exe, dll, so, dylib, app, dmg, pkg, msi, deb, rpm
- Compiled: jar, war, ear, class, o, a, pyc, pyo, wasm
- Images: jpg, jpeg, png, gif, bmp, tiff, webp, ico
- Media: mp4, avi, mkv, mov, mp3, wav, flac, pdf
- Cache directories: __pycache__, .cache, .pytest_cache, .tox

TEXT FILES (size-filtered):
- Small files (< 1MB): Included in project tree
- Large files (≥ 1MB): Excluded via ripgrep --max-filesize

This approach:
- Preserves small archives (test fixtures, config backups)
- Handles large text files (logs, data dumps)
- Eliminates virtual memory allocation during startup
- Provides precise filtering without performance overhead

Fixes startup memory consumption with large .tar.gz files while
maintaining access to legitimate small binary files.
@github-actions

github-actions Bot commented Feb 2, 2026

Copy link
Copy Markdown
Contributor

Closing this pull request because it has had no updates for more than 60 days. If you plan to continue working on it, feel free to reopen or open a new PR.

@github-actions github-actions Bot closed this Feb 2, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants