Vision Transformers Needs Registers. And Gated MLPs. And +20M params. Tiny modality gap ensues!
-
Updated
Mar 19, 2025 - Python
Vision Transformers Needs Registers. And Gated MLPs. And +20M params. Tiny modality gap ensues!
This paper have been presented in the form of an oral presentation at the IJCNN-2019 conference. The title is "Transformation-gated LSTM: efficient capture of short-term mutation dependencies for multivariate time series prediction tasks".
Vision Transformers Needs Registers. And Gated MLPs. And +20M params. Tiny modality gap ensues!
Add a description, image, and links to the gated topic page so that developers can more easily learn about it.
To associate your repository with the gated topic, visit your repo's landing page and select "manage topics."