The current ingest implementation runs on the entire directory of uploads each time a new file is uploaded. This means that ingest time will increase monotonically as more files are uploaded.
Update ingest to run from a .staging directory rather than on the uploads directory itself, and then clean up any temporary files from .staging once ingest has completed. This will mean that ingest is only run for newly added uploads, rather than all previous uploads.
The current ingest implementation runs on the entire directory of uploads each time a new file is uploaded. This means that ingest time will increase monotonically as more files are uploaded.
Update ingest to run from a
.stagingdirectory rather than on theuploadsdirectory itself, and then clean up any temporary files from.stagingonce ingest has completed. This will mean that ingest is only run for newly added uploads, rather than all previous uploads.