A custom Tensorflow implementation of Google's Electra NLP model with compositional embeddings using complementary partitions
-
Updated
May 1, 2021 - Jupyter Notebook
#
efficient-transformers
Here are 21 public repositories matching this topic...
This is the source code of article how to create a chatbot in python . i.e A chatbot using the Reformer, also known as the efficient Transformer, to generate dialogues between two bots.
nlp chat-bot source-code-study chatbots-framework nltk-python efficient-transformers chatbot-notebook
-
Updated
May 22, 2021 - Jupyter Notebook
Master thesis with code investigating methods for incorporating long-context reasoning in low-resource languages, without the need to pre-train from scratch. We investigated if multilingual models could inherit these properties by making it an Efficient Transformer (s.a. the Longformer architecture).
multilingual language-models xlm roberta huggingface multilingual-models longformer huggingface-transformers longformer-models efficient-transformers
-
Updated
Aug 19, 2021 - Jupyter Notebook
Pytorch implementation of LISA (Linear-Time Self Attention with Codeword Histogram for Efficient Recommendation. WWW 2021)
-
Updated
Nov 21, 2021 - Python
Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).
-
Updated
Apr 18, 2022 - Python
Official PyTorch implementation of our ECCV 2022 paper "Sliced Recursive Transformer"
-
Updated
Sep 6, 2022 - Python
Mask Transfiner for High-Quality Instance Segmentation, CVPR 2022
-
Updated
Sep 22, 2022 - Python
[NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"
-
Updated
Nov 15, 2022 - Python
[CVPR 2023] IMP: iterative matching and pose estimation with transformer-based recurrent module
pose-estimation superglue efficient-transformers adaptive-pooling training-graph-matcher fast-superglue geometry-aware-matching
-
Updated
Jun 28, 2023 - Python
Demo code for CVPR2023 paper "Sparsifiner: Learning Sparse Instance-Dependent Attention for Efficient Vision Transformers"
attention-mechanism fast-inference sparse-neural-networks low-rank vision-transformer efficient-transformers sparse-attention efficient-vision-transformers
-
Updated
Jul 4, 2023 - Python
Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"
-
Updated
Sep 26, 2023 - Python
[ICCV 2023] Efficient Video Action Detection with Token Dropout and Context Refinement
-
Updated
Sep 27, 2023 - Python
Gated Attention Unit (TensorFlow implementation)
deep-learning tensorflow transformer attention-mechanism gated-attention tensorflow2 arxiv-papers efficient-transformers
-
Updated
Sep 28, 2023 - Python
[MICCAI 2023] DAE-Former: Dual Attention-guided Efficient Transformer for Medical Image Segmentation
deep-learning pytorch transformer segmentation medical-image-analysis medical-image-segmentation unet-image-segmentation efficient-transformers
-
Updated
Oct 12, 2023 - Python
[NeurIPS'21] "Chasing Sparsity in Vision Transformers: An End-to-End Exploration" by Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang, Zhangyang Wang
pruning model-compression sparse-training vision-transformers efficient-transformers dynamic-sparsity token-slimming
-
Updated
Dec 1, 2023 - Python
[ICLR 2022] "Unified Vision Transformer Compression" by Shixing Yu*, Tianlong Chen*, Jiayi Shen, Huan Yuan, Jianchao Tan, Sen Yang, Ji Liu, Zhangyang Wang
-
Updated
Dec 1, 2023 - Python
Nonparametric Modern Hopfield Models
efficient-transformers efficient-attention modern-hopfield-networks modern-hopfield-model efficient-hopfield-models efficient-hopfield-networks
-
Updated
Jan 8, 2024 - Jupyter Notebook
This repository contains the official code for Energy Transformer---an efficient Energy-based Transformer variant for graph classification
deep-learning neural-network transformer associative-memory hopfield energy-based-model jax graph-neural-networks efficient-transformers energy-transformer
-
Updated
Jan 28, 2024 - Python
Official Implementation of Energy Transformer in PyTorch for Mask Image Reconstruction
-
Updated
Mar 10, 2024 - Python
[CVPR 2022--Oral] Restormer: Efficient Transformer for High-Resolution Image Restoration. SOTA for motion deblurring, image deraining, denoising (Gaussian/real data), and defocus deblurring.
pytorch transformer high-resolution image-restoration image-deblurring motion-deblurring low-level-vision defocus-deblurring image-deraining efficient-transformers cvpr2022
-
Updated
Aug 16, 2024 - Python
Improve this page
Add a description, image, and links to the efficient-transformers topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the efficient-transformers topic, visit your repo's landing page and select "manage topics."