Paper Summary for FNet by Google Research
This paper is about FNet, a GRU-Based method to fuser BERT hidden layers. The paper has been published in ACL conference proceedings.
Annotated paper can be found here and the link to Fourier Transform video
· NLP