Skip to content

Implement docker image compression and squashing#4

Merged
jasonbridges merged 1 commit intomasterfrom
compression-and-squashing-2784198564392557095
Dec 12, 2025
Merged

Implement docker image compression and squashing#4
jasonbridges merged 1 commit intomasterfrom
compression-and-squashing-2784198564392557095

Conversation

@google-labs-jules
Copy link
Copy Markdown

This change implements a mechanism to compress docker images using xz and squash layers to reduce the final image size. It introduces a configurable compression mode, defaulting to high compression and squashing, with an option to revert to fast builds using gzip via SONIC_FAST_BUILD=y. The installer script is also updated to robustly handle different compression formats.


PR created automatically by Jules for task 2784198564392557095 started by @jasonbridges

- Introduce `SONIC_IMAGE_COMPRESSION_MODE` (default: best) in `rules/config`.
- "best" mode uses `xz` compression and squashes docker layers.
- "fast" mode uses `gzip` compression and disables squashing (can be triggered by `SONIC_FAST_BUILD=y`).
- Update `slave.mk` to use `docker-squash` and `xz` when enabled.
- Update `build_debian.sh` to use `xz` for `dockerfs.tar.gz` when enabled.
- Update `installer/install.sh` to use generic `tar x` for auto-detecting compression.
- Update `sonic-slave-bookworm/Dockerfile.j2` to include `xz-utils` and `docker-squash`.
@google-labs-jules
Copy link
Copy Markdown
Author

👋 Jules, reporting for duty! I'm here to lend a hand with this pull request.

When you start a review, I'll add a 👀 emoji to each comment to let you know I've read it. I'll focus on feedback directed at me and will do my best to stay out of conversations between you and other bots or reviewers to keep the noise down.

I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job!

For more direct control, you can switch me to Reactive Mode. When this mode is on, I will only act on comments where you specifically mention me with @jules. You can find this option in the Pull Request section of your global Jules UI settings. You can always switch back!


For security, I will only act on instructions from the user who triggered this task.

New to Jules? Learn more at jules.google/docs.

@jasonbridges jasonbridges marked this pull request as ready for review December 12, 2025 07:50
@jasonbridges jasonbridges merged commit 3ac6353 into master Dec 12, 2025
jasonbridges pushed a commit that referenced this pull request Mar 6, 2026
…net#25643)

* [build] Add build timing report and dependency analysis tools

Add three scripts for build performance instrumentation:

- scripts/build-timing-report.sh: Parse per-package timing from build
  logs (HEADER/FOOTER timestamps), generate sorted duration table,
  phase breakdown, parallelism timeline, and CSV export.

- scripts/build-dep-graph.py: Parse rules/*.mk dependency graph,
  compute critical path, fan-out/fan-in bottleneck analysis, and
  generate DOT/JSON output for visualization.

- scripts/build-resource-monitor.sh: Sample CPU, memory, disk I/O,
  and Docker container count during builds for resource utilization
  analysis.

Add "make build-report" target to slave.mk that runs the timing
report and dependency analysis after a build completes.

Example output from a VS build on 24-core/30GB machine:
- 210 packages built in 53m wall time (173m CPU)
- Max concurrency: 5 (with SONIC_CONFIG_BUILD_JOBS=4)
- Critical path: 14 packages deep (libnl -> libswsscommon -> utilities)
- Top bottleneck: LIBSWSSCOMMON with 48 downstream dependents

Signed-off-by: Rustiqly <[email protected]>

* Address Copilot review: fix 17 bugs in build analysis scripts

- Use free -m with division instead of free -g to avoid rounding (#1)
- Add = and ?= to Makefile dependency regex patterns (#2, sonic-net#7)
- CPU calculation now uses /proc/stat delta (two reads) (#3, sonic-net#14)
- Fix misleading 'critical path estimate' comment (#4)
- Fix parallelism timeline comment (60s not 10s) (sonic-net#5)
- Include after-relationship packages in fan stats (sonic-net#6)
- Guard disk I/O division by zero when INTERVAL<=1 (sonic-net#8)
- Remove unused elapsed_line variable (sonic-net#9)
- Remove redundant LIBSWSSCOMMON_DBG check (sonic-net#10)
- Remove active_make_jobs from CSV header comment (sonic-net#11)
- Wire up _RDEPENDS parsing to build reverse deps (sonic-net#12)
- Remove unnecessary 'if v' filter on rdeps JSON (sonic-net#13)
- Remove unused REPORT_FORMAT parameter (sonic-net#15)
- Add cycle detection to critical path algorithm (sonic-net#16)
- Add execute permission check for companion scripts (sonic-net#17)

Signed-off-by: Rustiqly <[email protected]>

---------

Signed-off-by: Rustiqly <[email protected]>
Co-authored-by: Rustiqly <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant