You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A Chat response currently only includes the message text. Ideally, we'd like to cite the References that were used to create the message response.
We should update the response to include metadata about the source References.
Update ingest to use pypdf for text extraction on all PDFs so that text for grobid success/fails are parsed in a consistent way. This will allow us to also include page numbers on our Reference metadata.
Add page number to Chunk metadata
Add reference metadata to ranker context here so that our ranker query returns appropriate metadata
Update chat to include relevant reference metadata in in prompt
Update LLM response to include citations of appropriate references (might need to play around with LLM prompt)
Update CLI params to allow for n_choices to be utilized
A Chat response currently only includes the message text. Ideally, we'd like to cite the References that were used to create the message response.
We should update the response to include metadata about the source References.
pypdffor text extraction on all PDFs so that text for grobid success/fails are parsed in a consistent way. This will allow us to also include page numbers on our Reference metadata.Chunkmetadatan_choicesto be utilized