Currently we have a bear that check for invalid links: InvalidLinkBear.
It would be good to also submit links to an archiving service like Internet Archive, so there is a backup when the site goes offline.
fossasia/gci16.fossasia.org#922
As this is using external webservices being used in CI, requests should be batched at least per file if possible, and even potentially across CI runs using the coala cache.
It would be best to use a Memento client where possible to do the checking whether a backup exists already.
Currently we have a bear that check for invalid links: InvalidLinkBear.
It would be good to also submit links to an archiving service like Internet Archive, so there is a backup when the site goes offline.
fossasia/gci16.fossasia.org#922
As this is using external webservices being used in CI, requests should be batched at least per file if possible, and even potentially across CI runs using the coala cache.
It would be best to use a Memento client where possible to do the checking whether a backup exists already.