metric problem

[CyzSpace]

Hello author, the evaluation metric used by PopQA in your paper is accuracy, but in your code it is match, which I don't understand. Could you please help me explain this? Thank you

[HuskyInSalt]

Hi! The current evaluation method is to match the predicted option with the golden label, which also means the accuracy of the predictions. In fact, the term accuracy we used in the paper and the metric functions in the evaluation code are both consistent with Self-RAG.
In #11 we explained this issue. Thank you!