We want to populate the ReferenceView with metadata once the uploaded references have been parsed: #49
As currently constructed, Reference metadata is not returned until the entire pipeline runs. However, metadata is available as json fairly early on in the pipeline.
Separating embedding creation from the rest of the ingestion pipeline would allow us to return the metadata response sooner and allow things to feel snappier.
We want to populate the ReferenceView with metadata once the uploaded references have been parsed: #49
As currently constructed, Reference metadata is not returned until the entire pipeline runs. However, metadata is available as json fairly early on in the pipeline.
Separating embedding creation from the rest of the ingestion pipeline would allow us to return the metadata response sooner and allow things to feel snappier.