why pretrain from encoder_q? #142
Description
Yes,i have a question is that：in liner fine turning period，why pretrain from encoder_q instead of encoder_k？
{{ message }}
Yes,i have a question is that：in liner fine turning period，why pretrain from encoder_q instead of encoder_k？