global-self-attention-network

A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks

Stars

90

Forks

7

Language

Python

Last Updated

Apr 29, 2024

Similar Repos
Repo Language Stars Description Updated At
Python 6 Pytorch implementation of Realtime Global Attention Network Mar 16, 2022
Jupyter Notebook 19 Pytorch implementation of the paper Stand-Alone Self-Attention in Vision Models Mar 18, 2023
Python 16 Pytorch implementation of Self-Attention ConvLSTM May 08, 2023
Python 2 PyTorch Implementation of Self-Attention GAN (SAGAN) Oct 27, 2023
Python 4 Pytorch implementation of graph attention network Jul 11, 2022
Python 438 Implementing Stand-Alone Self-Attention in Vision Models using Pytorch Apr 06, 2023
Python 5 A PyTorch implementation for Self-Attention Generative Adversarial Networks Mar 25, 2023
Python 65 Self-Attention Generative Adversarial Networks Implementation in PyTorch Aug 28, 2022
Python 196 Official PyTorch implementation of Global Context Vision Transformers Aug 12, 2022
Python 76 Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch Aug 01, 2022
Python 2353 Pytorch implementation of Self-Attention Generative Adversarial Networks (SAGAN) May 14, 2023
Python 2 Implementation of Graph Muti-Attention Network with PyTorch Jul 01, 2023
Python 80 The official implementation of ELSA: Enhanced Local Self-Attention for Vision Transformer May 24, 2022
Python 104 Implementation of Deformable Attention in Pytorch from the paper "Vision Transformer with Deformable Attention" Aug 11, 2022
Python 353 Implementation of TabTransformer, attention network for tabular data, in Pytorch Aug 12, 2022
None 2 a pytorch implementation of self-attention with relative position representations May 03, 2023
Jupyter Notebook 15 PyTorch implementation of Data2Vec self-supervised approach for vision use cases. Dec 16, 2022
None 3 Awesome Transformers (self-attention) in Computer Vision Jan 28, 2021
Python 452 Official code for our NeurIPS 2021 Spotlight "Focal Self-attention for Local-Global Interactions in Vision Transformers" Aug 02, 2022
Python 1035 Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository. May 22, 2023
Python 187 Implementation of Segformer, Attention + MLP neural network for segmentation, in Pytorch Aug 09, 2022
Python 9 The Pytorch implementation for Deep Multiscale Siamese Network with Parallel Convolutional Structure and Self-Attention for … Jun 06, 2022
Python 145 pytorch neural network attention mechanism Jan 05, 2024
None 71 A compilation of network architectures for vision and others without usage of self-attention mechanism May 15, 2023
Jupyter Notebook 52 Self-Erasing Network for Integral Object Attention Nov 26, 2021
Python 33 A Pytorch implementation of Attention on Attention module (both self and guided variants), for Visual … May 06, 2022
Python 7 PyTorch Implementation of Backbone of PicoDet Jul 12, 2022
Python 35 Pytorch implementation of RetinaNet using EfficientNets as feature extractor or backbone network. Dec 14, 2021
Python 7 An Interpretable Self-Attention Network with block-attention and attention-attribution. Mar 24, 2023
Python 188 Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch Aug 06, 2022
None 7 Pytorch implementation of PSEnet with Pyramid Attention Network as feature extractor Apr 24, 2023
Python 13 Pytorch implementation of the paper : A Global-local Attention Framework for Weakly Labelled Audio Tagging. Oct 17, 2021
Python 16 A PyTorch implementation of the Compact Multi-Head Self-Attention Mechanism from the paper: "Low Rank Factorization … Aug 11, 2022
Python 35 A Position-aware Bidirectional Attention Network for Aspect-level Sentiment Analysis, PyTorch implementation. Dec 07, 2022
Python 9 YOLOv1 implementation of Pytorch with multi-backbone Mar 26, 2022
Python 65 BERT+Self-attention Encoder ; Biaffine Decoder ; Pytorch Implement Sep 01, 2022
Python 5 TensorFlow implementation of Self Attention GAN Nov 15, 2020
Python 43 Keras implementation of Global Context Attention blocks Mar 23, 2023
Python 7 [ICASSP 2022] Official PyTorch Implementation for "Attention Probe: Vision Transformer Distillation in the Wild" (ICASSP … Mar 23, 2023
Python 44 Heterogeneous Graph Attention Network (HAN) with pytorch Jul 22, 2022
Python 39 Visualize BERT's self-attention layers on text classification tasks Mar 31, 2022
Python 16 Implementation of Kronecker Attention in Pytorch May 06, 2022
Python 18 PyTorch implementation of Graph Attention Networks Jan 09, 2023
Python 151 PyTorch implementation of the CVPR 2019 paper “Pyramid Feature Attention Network for Saliency Detection” May 10, 2023
Jupyter Notebook 19 A PyTorch implementation of RetinaNet with `ResNet` backbone Apr 12, 2023
None 2 File Fragment Classification with Joint Self-Attention Network Apr 21, 2023
Python 22 [ECCV 2022] AMixer: Adaptive Weight Mixing for Self-attention Free Vision Transformers May 11, 2023
Python 145 TRACER: Extreme Attention Guided Salient Object Tracing Network (AAAI 2022) implementation in PyTorch May 22, 2023
Jupyter Notebook 2 TRACER: Extreme Attention Guided Salient Object Tracing Network (AAAI 2022) implementation in PyTorch Jan 24, 2024
Python 20 The PyTorch implementation of ReCoSa(the Relevant Contexts with Self-attention) for dialogue generation using the multi-head … Mar 14, 2022