nystrom-attention

Implementation of Nyström Self-attention, from the paper Nyströmformer

Stars

118

Forks

15

Language

Python

Last Updated

Mar 08, 2024

Similar Repos
Repo Language Stars Description Updated At
Python 183 Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient … Jul 26, 2022
Python 16 A PyTorch implementation of the Compact Multi-Head Self-Attention Mechanism from the paper: "Low Rank Factorization … Aug 11, 2022
Jupyter Notebook 19 Pytorch implementation of the paper Stand-Alone Self-Attention in Vision Models Mar 18, 2023
Python 104 Implementation of Deformable Attention in Pytorch from the paper "Vision Transformer with Deformable Attention" Aug 11, 2022
Python 14 The implementation of the paper "Improving Sample Quality of Diffusion Models Using Self-Attention Guidance". Oct 12, 2022
Python 94 TensorFlow implementation for paper Time Interval Aware Self-Attention for Sequential Recommendation. Apr 23, 2023
None 15 Official implementation of the paper "Improving Sample Quality of Diffusion Model Using the Self-Attention Guidance" Oct 05, 2022
None 2 Implementation of the paper "Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanism" Oct 06, 2022
Python 5 This is a Tensorflow implementation of the paper Homogeneous Learning: Self-Attention Decentralized Deep Learning. Mar 30, 2023
Python 16 Pytorch implementation of Self-Attention ConvLSTM May 08, 2023
Python 5 TensorFlow implementation of Self Attention GAN Nov 15, 2020
Python 34 An implementation of (Induced) Set Attention Block, from the Set Transformers paper Aug 10, 2022
Python 115 Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not … Aug 12, 2022
Python 60 Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity) Apr 26, 2023
Python 2 PyTorch Implementation of Self-Attention GAN (SAGAN) Oct 27, 2023
Jupyter Notebook 4 Pytorch implementation of the paper Attention Augmented Convolutional Networks Jan 01, 2023
Python 8 Implementation of the Hybrid Perception Block and Dual-Pruned Self-Attention block from the ITTR paper for … May 23, 2022
Python 9 Implemented the Stand-Alone Self-Attention research paper form scratch in Tensorflow Mar 31, 2022
Python 6 The official implementation of the paper "Syntax-guided Localized Self-attention by Constituency Syntactic Distance"(Findings of EMNLP … May 16, 2023
None 2 The official implementation of the paper "Syntax-guided Localized Self-attention by Constituency Syntactic Distance"(Findings of EMNLP … Oct 31, 2023
Python 31 Implementation of Memory-Compressed Attention, from the paper "Generating Wikipedia By Summarizing Long Sequences" May 26, 2022
Python 74 Implementation of the paper "Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanism" [AAAI-MLPS 2021] May 02, 2023
Python 65 Self-Attention Generative Adversarial Networks Implementation in PyTorch Aug 28, 2022
Python 2 The code of the paper "Wavelet Frequency Division Self-attention Transformer Image Deraining Network" Apr 12, 2023
Python 3 The implementation of transformer as presented in the paper "Attention is all you need" from … Mar 21, 2023
Python 7 Implementation of the paper "Multimodal Transformer With Learnable Frontend and Self Attention for Emotion Recognition" … Jun 28, 2022
Python 76 Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch Aug 01, 2022
Python 5 A PyTorch implementation for Self-Attention Generative Adversarial Networks Mar 25, 2023
Python 2353 Pytorch implementation of Self-Attention Generative Adversarial Networks (SAGAN) May 14, 2023
Python 37 The official TensorFlow implementation of the paper "Action Transformer: A Self-Attention Model for Short-Time Pose-Based … Apr 25, 2023
Python 18 Implementation of our IJCAI2022 oral paper, ER-SAN: Enhanced-Adaptive Relation Self-Attention Network for Image Captioning. May 06, 2023
Python 15 Source code of the paper "Attention as Relation: Learning Supervised Multi-head Self-Attention for Relation Extraction, … Dec 22, 2021
Python 82 TensorFlow implementation of the paper "Hierarchical Attention Networks for Document Classification" Jan 30, 2023
Jupyter Notebook 41 Unofficial PyTorch implementation of the paper "cosFormer: Rethinking Softmax In Attention". Apr 23, 2023
Python 80 The official implementation of ELSA: Enhanced Local Self-Attention for Vision Transformer May 24, 2022
MATLAB 3 An implementation of the Nyström & Holmqvist (2010) event classification algorithm--with extensions Aug 05, 2022
None 3 An unofficial implementation of the σReparam from the "Stabilizing Transformer Training by Preventing Attention Entropy … Apr 13, 2023
Python 93 Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than … May 06, 2022
Jupyter Notebook 4 Official tensorflow implementation of the paper: "Semiconductor Defect Pattern Classification by Self-Proliferation-and-Attention Neural Network (SP&A-Net)" Aug 10, 2022
Python 4 The code and data for our paper "Hierarchical Bi-Directional Self-Attention Networks for Paper Review Rating … Dec 01, 2021
Python 3 codes for paper: What Dense Graph do You Need for Self-attention? May 30, 2022
Python 532 Simple Tensorflow implementation of "Self-Attention Generative Adversarial Networks" (SAGAN) Aug 03, 2022
Python 33 Authors implementation of LieTransformer: Equivariant Self-Attention for Lie Groups Dec 23, 2021
None 2 a pytorch implementation of self-attention with relative position representations May 03, 2023
Python 50 Tensorflow implementation of paper "Recurrent Models of Visual Attention" Apr 05, 2022
None 3 Implementation of the Neural Sequence Chunker, Schmidhuber paper back from 1991, in the context of … May 06, 2022
Python 143 Implementation of TransGanFormer, an all-attention GAN that combines the finding from the recent GanFormer and … Aug 09, 2022
Jupyter Notebook 264 My implementation of the transformer architecture from the Attention is All you need paper applied … May 16, 2023
Python 46 An implementation of the Nyströmformer, using Nystrom method to approximate standard self attention Sep 14, 2022
Python 81 A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks May 19, 2022