Skip to content

Update ingest so uploads are only processed once #218

Description

@gjreda

The current ingest implementation runs on the entire directory of uploads each time a new file is uploaded. This means that ingest time will increase monotonically as more files are uploaded.

Update ingest to run from a .staging directory rather than on the uploads directory itself, and then clean up any temporary files from .staging once ingest has completed. This will mean that ingest is only run for newly added uploads, rather than all previous uploads.

Metadata

Metadata

Assignees

Labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions