Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

v0.7.0 Pre-Release: More config options, LDAP/remote auth support, extractor updates, usability and performance improvements, bugfixes #721

Merged
merged 560 commits into from
Nov 8, 2023

Conversation

pirate
Copy link
Member

@pirate pirate commented Apr 24, 2021

DONE:

TODO:

Postpone:

@github-pages github-pages bot temporarily deployed to github-pages April 24, 2021 07:49 Inactive
@github-pages github-pages bot temporarily deployed to github-pages April 24, 2021 07:51 Inactive
@github-pages github-pages bot temporarily deployed to github-pages April 24, 2021 08:06 Inactive
@github-pages github-pages bot temporarily deployed to github-pages April 24, 2021 08:07 Inactive
@github-pages github-pages bot temporarily deployed to github-pages April 24, 2021 08:14 Inactive
@github-pages github-pages bot temporarily deployed to github-pages April 24, 2021 08:22 Inactive
@github-pages github-pages bot temporarily deployed to github-pages April 24, 2021 08:31 Inactive
@github-pages github-pages bot temporarily deployed to github-pages April 24, 2021 08:43 Inactive
@github-pages github-pages bot temporarily deployed to github-pages April 24, 2021 11:09 Inactive
@github-pages github-pages bot temporarily deployed to github-pages April 24, 2021 11:18 Inactive
@github-pages github-pages bot temporarily deployed to github-pages April 24, 2021 11:28 Inactive
@github-pages github-pages bot temporarily deployed to github-pages April 27, 2021 18:51 Inactive
@github-pages github-pages bot temporarily deployed to github-pages April 27, 2021 18:52 Inactive
@github-pages github-pages bot temporarily deployed to github-pages April 27, 2021 18:55 Inactive
@github-pages github-pages bot temporarily deployed to github-pages April 27, 2021 18:58 Inactive
@github-pages github-pages bot temporarily deployed to github-pages April 27, 2021 18:59 Inactive
@github-pages github-pages bot temporarily deployed to github-pages April 27, 2021 19:03 Inactive
@github-pages github-pages bot temporarily deployed to github-pages April 27, 2021 19:05 Inactive
@github-pages github-pages bot temporarily deployed to github-pages April 27, 2021 19:12 Inactive
@github-pages github-pages bot temporarily deployed to github-pages May 7, 2021 11:45 Inactive
@github-pages github-pages bot temporarily deployed to github-pages May 7, 2021 11:51 Inactive
@github-pages github-pages bot temporarily deployed to github-pages May 7, 2021 11:52 Inactive
@github-pages github-pages bot temporarily deployed to github-pages May 7, 2021 12:03 Inactive
@github-pages github-pages bot temporarily deployed to github-pages May 7, 2021 12:13 Inactive
@github-pages github-pages bot temporarily deployed to github-pages May 7, 2021 12:15 Inactive
@github-pages github-pages bot temporarily deployed to github-pages May 7, 2021 12:21 Inactive
@github-pages github-pages bot temporarily deployed to github-pages May 7, 2021 12:27 Inactive
@github-pages github-pages bot temporarily deployed to github-pages May 7, 2021 12:33 Inactive
@github-pages github-pages bot temporarily deployed to github-pages May 7, 2021 12:40 Inactive
@github-pages github-pages bot temporarily deployed to github-pages May 7, 2021 12:43 Inactive
@pirate pirate temporarily deployed to github-pages November 1, 2023 02:12 — with GitHub Pages Inactive
@pirate pirate temporarily deployed to github-pages November 1, 2023 02:17 — with GitHub Pages Inactive
@pirate
Copy link
Member Author

pirate commented Nov 1, 2023

FYI everyone watching this release, I just fixed the Docker build, among many other things. Give it a try!

My apologies, just fixed the build and just pushed dev, (aka 0.7.0, aka latest) for amd64, arm64, and arm/v7 (run ./bin/build_docker.sh to build these yourself).

  • massively increased the speed of all the Docker builds (>20x) by adding granular shared cache mounts for reusable apt and pip caches (--mount=type=cache...)
  • updated the base image to python:3.11-bookworm-slim with bookworm-backports, node v21, yt-dlp 2023.10.13, chrome v119, and all other apt, pip, and npm dependency versions upgraded
  • fixed multi-arch docker builds for amd64, arm64, arm/v7 and updated Dockerfile and ./bin/build_docker.sh with latest config and PDM package manager
  • attempt to autodetect PUID and PGID based on the ownership of existing files within ./data, should prevent unecessary chowns and remove the need to pass PUID/PGID explicitly in many cases
  • with a lot of research, yak-shaving, and trial and error I've managed to get the Docker image down to 500~630mb for all platforms (it was >1GB in the previous version), but I cant promise it'll stay this small forever. It's a lot of work to keep it as small as possible for all architectures!
  • fix issue where error output was writing to >./2 local file instead of >&2 stderr output
  • and added more helpful instructions to clearly show when a user has hit an edge case that requires passing explicit PUID & PGID (like non-compliant NFS/Samba/FUSE mounts or Docker Desktop on some platforms)
  • added new /VERSION.txt file containing build summary, check it on your platform for lots of juicy details about what version you're running
# pull the :latest image from docker hub (also published to ghcr.io/archivebox/archivebox)
docker pull archivebox/archivebox

# get detailed info about the build and dependency versions
docker run archivebox/archivebox cat /VERSION.txt
docker run -it archivebox/archivebox version

# run update to retry any previously failed downloads using the latest extractor versions
docker run -it -v $PWD:/data archivebox/archivebox update

hub.docker.com/layers/archivebox/archivebox/dev/images/sha256-afa301d566a01cab8934aa1141b5f6133a4585ee5b449304c659c765e240575d?context=explore

#1247 (comment)

@pirate pirate merged commit 6fd7d1f into master Nov 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.