@Marthisdil the --mirror option will handle archiving a site without leaving the domain (same as wget's behavior): https://github.com/pirate/ArchiveBox/wiki/Roadmap#--mirror

For everyone else, 😢 please read this issue, there are some major problems with the ArchiveBox security model around how we deal with executing JS in archived content without allowing it to XSS the entire archive. This is a pretty major blocker as I'm not comfortable pushing a new version until it's "secure by default" and doesn't risk exposing people's feeds. I will try to put some time in, but this month and next are going to be very busy for me so PRs helping with the JS security would be very appreciated!

For more details on the security and JS issues, see this PR comment: #207 (comment)
I'll also be updating the readme soon to responsibly disclose the current attack vectors and outline our approach to fixing it (stripping and preventing any JS execution via static archive html and titles and only allowing JS execution via WARC replay).

This architectural problem happened because I originally designed ArchiveBox to only archive public feeds and publicly accessible pages, where leaking the list of pages in the archive was not a concern. When more people started using it for private content, it made sense to support that use case out-of-the-box. But now I need to go back and re-assess the assumptions that were made by the original design, and do it properly. I'll have to sacrifice some of the nice UX of having easily accessible archived files on disk, but unfortunately after talking about it with a few security people over the last weak, it's clear that there cannot be any insecurity by default, even if it does make the UX easier, and we must correct flawed design assumptions ASAP. I'll try and provide config options for people to get the old behavior back, but at this stage it looks like static archives will no longer allow executing JS anymore, breaking any interactive pages and forcing people to use a dedicated WARC replayer if they need that ability. PDFs, Screenshots, and all the other methods will remain unaffected, these changes will only disable JS for the primary wget static html archive.

Hey all, v0.4 is officially released, check it out:

https://github.com/pirate/ArchiveBox/releases/tag/v0.4.9

We've closed over 30 tickets in this sprint, and made a bunch of major improvements to the CLI experience, data integrity, and web UI!

pip install archivebox

cd path/to/your/archive/folder

archivebox init  # doubles as the upgrade command, non-destructive & safe to run multiple times
archviebox add 'https://example.com'
archviebox add 'https://getpocket.com/users/USERNAME/feed/all' --depth=1
archivebox status
# archivebox config --set PUBLIC_INDEX=True      (False=require a login to view the index)
# archivebox config --set PUBLIC_SNAPSHOTS=True  (False=require a login to view individual snapshots)
archivebox server 0.0.0.0:8000
archivebox help

docker run -v $PWD:/data nikisweeting/archivebox init
docker run -v $PWD:/data nikisweeting/archivebox add 'https://example.com'
docker run -v $PWD:/data -it nikisweeting/archivebox manage createsuperuser
docker run -v $PWD:/data -p 8000:8000 nikisweeting/archivebox

I forgot to post here when we released v0.5.3 a couple months ago.

https://github.com/pirate/ArchiveBox/releases/tag/v0.5.3

• ArchiveResult moved to SQLite3 DB for performance @cdvv7788
• lots of assorted bugfixes and improvements courtesy of @cdvv7788 and @jdcaballerov
• new full-text search support with ripgrep and sonic courtesy of @jdcaballerov
• new archivebox oneshot command for downloading a single site without starting a whole collection
• new Pocket API importer courtesy of @mAAdhaTTah
• new Wallabag importer courtesy of @ehainry
• new extractor options on Add page courtesy of @BlipRanger
• new apt/deb/homebrew/pip packaging setup into separate repos under new Github Org https://github.com/ArchiveBox
• new official PPA and Docker Hub accounts https://hub.docker.com/r/archivebox/archivebox (with automatic armv7 builds courtesy of @chrismeller)
• new Snapshot grid view courtesy of @jdcaballerov

FYI: #1082 Attention: I'm considering removing the archivebox oneshot command from ArchiveBox in the next 0.8 release