halonet-pytorch

Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones

Stars

200

Forks

22

Language

Python

Last Updated

Mar 21, 2024

Similar Repos
Repo Language Stars Description Updated At
Python 2 halonet implementation(Scaling Local Self-Attention for Parameter Efficient Visual Backbones) This is an unofficial implementation.https://arxiv.org/pdf/2103.12731v2.pdf Jul 26, 2023
Python 2 Local self-attention in Transformer for visual question answering Oct 19, 2023
Python 2 Implementation paper Parameter-Efficient Transfer Learning for NLP Oct 29, 2023
Python 85 Implementation of Nyström Self-attention, from the paper Nyströmformer Aug 04, 2022
Python 12 A collection of self-attention modules and pre-trained backbones Aug 22, 2021
Python 4 Paper Implementation for "Parameter-Efficient Transfer Learning for NLP" Apr 08, 2023
Python 115 Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not … Aug 12, 2022
Python 50 Tensorflow implementation of paper "Recurrent Models of Visual Attention" Apr 05, 2022
Python 80 The official implementation of ELSA: Enhanced Local Self-Attention for Vision Transformer May 24, 2022
Python 2 The repository for paper "Uncertainty-aware Parameter-Efficient Self-training for Semi-supervised Language Understanding" Jan 02, 2024
Jupyter Notebook 19 Pytorch implementation of the paper Stand-Alone Self-Attention in Vision Models Mar 18, 2023
Python 10 Keras Layer implementation of Attention Jul 26, 2021
Python 103 [CVPR2022 - Oral] Official Jax Implementation of Learned Queries for Efficient Local Attention May 12, 2023
Python 16 A PyTorch implementation of the Compact Multi-Head Self-Attention Mechanism from the paper: "Low Rank Factorization … Aug 11, 2022
Python 580 Scaling and Benchmarking Self-Supervised Visual Representation Learning Jul 29, 2022
Python 33 Vision Transformers are Parameter-Efficient Audio-Visual Learners Apr 14, 2023
Python 5 Implementation of various parameter efficient methods. Mar 25, 2022
Python 14 The implementation of the paper "Improving Sample Quality of Diffusion Models Using Self-Attention Guidance". Oct 12, 2022
Python 27 Official implementation of AAAI 2023 paper "Parameter-efficient Model Adaptation for Vision Transformers" May 13, 2023
Python 94 TensorFlow implementation for paper Time Interval Aware Self-Attention for Sequential Recommendation. Apr 23, 2023
Python 4 Implementation of attention-augmented convolution layer Jul 18, 2021
Python 33 A Pytorch implementation of Attention on Attention module (both self and guided variants), for Visual … May 06, 2022
Python 33 IPMI2019 paper - Melanoma Recognition via Visual Attention Jul 20, 2022
None 15 Official implementation of the paper "Improving Sample Quality of Diffusion Model Using the Self-Attention Guidance" Oct 05, 2022
None 2 Implementation of the paper "Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanism" Oct 06, 2022
Python 5 This is a Tensorflow implementation of the paper Homogeneous Learning: Self-Attention Decentralized Deep Learning. Mar 30, 2023
Python 73 [ECCV'22] The official PyTorch implementation of our ECCV 2022 paper: "AiATrack: Attention in Attention for … Apr 18, 2023
Python 164 Self-attention、Non-local、SE、SK、CBAM、DANet Sep 21, 2022
Python 16 Pytorch implementation of Self-Attention ConvLSTM May 08, 2023
Python 5 TensorFlow implementation of Self Attention GAN Nov 15, 2020
Python 13 Pytorch implementation of the paper : A Global-local Attention Framework for Weakly Labelled Audio Tagging. Oct 17, 2021
Python 3 CMSEA: Compound Model Scaling with Efficient Attention for Fine-grained Image Classification Apr 16, 2023
Python 21 Implementation of the paper Parameter-Efficient Transfer Learning for NLP, Houlsby [Google], 2019. Published in ICML … Aug 23, 2022
Python 14 Towards a Unified View on Visual Parameter-Efficient Transfer Learning May 04, 2023
Python 60 Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity) Apr 26, 2023
Python 2 PyTorch Implementation of Self-Attention GAN (SAGAN) Oct 27, 2023
Jupyter Notebook 112 Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning" Apr 24, 2023
Python 43 Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning" Apr 20, 2023
Jupyter Notebook 4 Pytorch implementation of the paper Attention Augmented Convolutional Networks Jan 01, 2023
Python 2 PyTorch implemnts `Image Super-Resolution with Cross-Scale Non-Local Attention and Exhaustive Self-Exemplars Mining` paper. Aug 05, 2022
Python 2 Multilayer Perceptron Attention Layer implementation for Relation Extraction Nov 12, 2020
Python 9 Implemented the Stand-Alone Self-Attention research paper form scratch in Tensorflow Mar 31, 2022
Python 21 The project is an official implementation of our paper "POTTER: Pooling Attention Transformer for Efficient … Apr 19, 2023
Python 39 This project is official implementation of 'Efficient Non-Local Contrastive Attention for Image Super-Resolution', AAAI22 Jun 09, 2022
Python 8 Official implementation for "Parameter-Efficient Fine-Tuning Design Spaces" Apr 11, 2023
Python 6 The official implementation of the paper "Syntax-guided Localized Self-attention by Constituency Syntactic Distance"(Findings of EMNLP … May 16, 2023
None 2 The official implementation of the paper "Syntax-guided Localized Self-attention by Constituency Syntactic Distance"(Findings of EMNLP … Oct 31, 2023
Python 1558 TensorFlow Code for paper "Efficient Neural Architecture Search via Parameter Sharing" Sep 28, 2022
Python 74 Implementation of the paper "Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanism" [AAAI-MLPS 2021] May 02, 2023
Python 65 Self-Attention Generative Adversarial Networks Implementation in PyTorch Aug 28, 2022