Make the following improvements to better integrate with the latest txtai indexing options.
- Only tokenize text if scoring is set. Transformers models don't need text tokenization and it can hurt performance.
- Only filter sections when indexing if scoring is set. This isn't necessary for Transformers models.
- Check the return type from
embeddings.search and handle both dict content=true and tuple content=false return types.