Your network share has to be able to support FSYNC, if it does not then you'll have to put the index.sqlite3 file on a local drive and only put the archive/ sub-folder on the network drive.

See: https://github.com/ArchiveBox/ArchiveBox#storage-requirements

Most network drives support FSYNC if you configure them to, check the NFS/SAMBA docs to see how to set up FSYNC-compatible shares for your OS/NFS version.

This is for data integrity reasons. Too many users in the past accidentally corrupted their archives by running concurrent archivebox threads on network filesystems that ended up clobbering each other's indexes, so now we require the filesystem where the index is stored to support atomic writes. This is for my own support sanity, and to prevent users from accidentally corrupting their indexes. If you want you can hack around it (see archivebox/system.py:atomic_write), but I cannot officially support those use cases / handhold people toward setting it up (because it's often dangerous).

Note: archive/ contains all the archived assets (and is responsible for the bulk of the disk usage), and can still be on a non-fsync compatible network share. e.g. this should work:

./                               # ArchiveBox data folder
    index.sqlite3                # must be on local SSD/HDD (make sure to back it up still)
    ArchiveBox.conf              # must be on local SSD/HDD
    sources/                     # ok to put on network mount
        ...
    archive/                     # ok to put on network mount
        ...

See here for more info:

• Support for network drives or filesystems that don't implement FSYNC #456
• Question: Docker on Windows archiving to an SMB path that doesn't support FSYNC #722

It's not a bug and there is a work around.

Note I've added a new DB/filesystem troubleshooting area to the wiki that may help people arriving here from Google: https://github.com/ArchiveBox/ArchiveBox/wiki/Upgrading-or-Merging-Archives#database-troubleshooting

Contributions/suggestions welcome there.