EL-attention GPT-2

[neverix]

Hi,
In the EL-Attention paper, a GPT-2 implementation with 1.8x speedup is mentioned. Will that ever be released publicly?

[feihugis]

cc: @yuyan2do

[tzuhsial]

Same question.