❓ Questions & Help

How to extract generated strings from RetrievAugLMMarginOutput?

Details

When using RagSequenceForGeneration and retriever separately we can't use model.generate (refer #7829). And calling model.__call__ directly return RetrievAugLMMarginOutput. I not able to to find way to extract generated_ids from it.

A link to original question on the forum/Stack Overflow: