Current state: functional.
It creates ArchiveResult objects based on the index.json detail for every archive (when migrating)
It saves new ArchiveResult objects when an extractor finish.
The icons displayed in index are calculated based on the ArchiveResults for the Snapshot

Missing:

• Remove ArchiveResult schema from the extractor process. Use the ArchiveResult model instead Cannot be done yet. I will leave this for a later PR.
• Add WARC to the list of icons. This requires specific logic.
• Reduce N+1 bottlenecks
• Handle the case where there are several ArchiveResult objects for a Snapshot with the same extractor. - Unnecessary: The presence of a single succeeded ArchiveResult is enough for the icon to show up.
• There are a couple extractors that require special treatment to display the items: warc and archive_org

@pirate Ready for review.

This is great so far, sorry I took so long to review it.

I'm going to merge it into v0.5 then release because I think it's important for the performance gains and I want v0.5 to be the "performance release".

Thanks for the review! I will fix all of those details today (they are all small details).

@pirate implemented all of the fixes. After you approve it, I will rebase-merge it.

@pirate Added two changes you requested. I think this is ready for review.

• Replace charfield with jsonfield
• Re-add icons, even if the related extractors were not used

I also bumped the django version to 3.1