This repository was archived by the owner on Apr 8, 2025. It is now read-only.
This repository was archived by the owner on Apr 8, 2025. It is now read-only.
Getting different predictions on different runs with same ELECTRA model. #519
Description
I trained an Electra Model on text classification. 3 Classes.
Saved it with
save_dir = Path("saved_models/bert-german-doc-tutorial")
model.save(save_dir)
processor.save(save_dir)
Now I load Data I want to predict on and getting different results:
1st run:
labal_n 5055
label_i 855
label_e 8
2nd run
labal_n 4609
label_e 990
label_i 319
3rd run
label_i 3355
labal_n 2510
label_e 53
How on earth can that be? Even if the model would be a total crap the prediction should be deterministic - right?