-
Notifications
You must be signed in to change notification settings - Fork 27
Open
Description
Thanks your wonderful work CEDR, it helps to understand the document ranking task a lot!
I tried to use this repo and followed the instruction to train a vanilla_bert with 1-fold and 2-fold data on the Robust04 dataset. However, I obtained the NDCG@20 result as:
vanilla_bert_1fold :0.40704 vanilla_bert_2fold: 0.45290
it is much different from your release checkpoints in #18 :
vanilla_bert_1fold: 0.42185 vanilla_bert_2fold: 0.47948
The hyperparameters are as follows:

Would you please share your setting of hyperparameters during fine-tuning the vanilla-bert ?
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels