Skip to content

Unable load a local French DPR model (etalab-ia/dpr-question_encoder-fr_qa-camembert) #1046

@AymericSallet

Description

@AymericSallet

Describe the bug
I tried to save the french DPR model (retriever.save), that's working but i have an error after when i try to load it (retriever.load).

The exact same code work fine with the facebook/dpr-question_encoder-single-nq-base model.

I want to do that to fine-tune the french DPR model.

retriever = DensePassageRetriever(document_store=InMemoryDocumentStore(),
                                          query_embedding_model="etalab-ia/dpr-question_encoder-fr_qa-camembert",
                                          passage_embedding_model="etalab-ia/dpr-ctx_encoder-fr_qa-camembert",
                                          max_seq_len_query=64,
                                          max_seq_len_passage=256,
                                          batch_size=50,
                                          use_gpu=True,
                                          embed_title=False,
                                          use_fast_tokenizers=True,
                                          infer_tokenizer_classes=True,
                                          )

retriever.save("saved_models/test")
retriever = DensePassageRetriever.load("saved_models/test", document_store=None)

ERROR:
TypeError: stat: path should be string, bytes, os.PathLike or integer, not NoneType

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions