cosFormer

[ICLR 2022] Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention

Stars

169

Forks

24

Language

Python

Last Updated

Feb 27, 2024

Similar Repos
Repo Language Stars Description Updated At
Jupyter Notebook 41 Unofficial PyTorch implementation of the paper "cosFormer: Rethinking Softmax In Attention". Apr 23, 2023
Python 23 Official implementation for "SimA: Simple Softmax-free Attention for Vision Transformers" May 12, 2023
Jupyter Notebook 89 Official PyTorch implementation of "Rethinking Mobile Block for Efficient Attention-based Models" May 07, 2023
Python 10 The official implementation of Triplet Attention. Aug 10, 2022
None 2 Official Pytorch implementations for "SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentation" (NeurIPS 2022) Apr 12, 2023
Python 7 [ICML 2022] This is the official pytorch implementation of "Rethinking Attention-Model Explainability through Faithfulness Violation … Jul 20, 2022
None 5 Official implementation of the paper "Rethinking Generalization in Few-Shot Classification" Jul 05, 2022
None 4 Official Implementation of CVRecon: Rethinking 3D Geometric Feature Learning For Neural Reconstruction May 04, 2023
Python 75 Adaptive Softmax implementation for PyTorch Aug 08, 2022
Python 38 Sampled Softmax Implementation for PyTorch Apr 13, 2023
Python 424 Rethinking the Truly Unsupervised Image-to-Image Translation - Official PyTorch Implementation (ICCV 2021) Aug 08, 2022
Python 67 Implementing SYNTHESIZER: Rethinking Self-Attention in Transformer Models using Pytorch Apr 10, 2023
Python 5 📝 Official Implementation of "Attention Meets Perturbation: Robust and Interpretable Attention with Adversarial Training" Jul 12, 2022
Python 7 A Keras implementation of Adaptive Softmax Dec 02, 2021
Python 18 Official implementation of Rethinking Class Activation Mapping for Weakly Supervised Object Localization (ECCV 2020) Aug 29, 2022
Jupyter Notebook 7 Tensorflow Sampled Softmax Loss Function - Minimal Implementation Nov 25, 2022
Python 63 Two-Layer Hierarchical Softmax Implementation for PyTorch Mar 09, 2023
None 3 An official implementation of "“Rethinking Collaborative Metric Learning: Toward an Efficient Alternative without Negative Sampling" Jul 12, 2023
Python 12 Official PyTorch implementation of "Rethinking Value Function Learning for Generalization in Reinforcement Learning" (NeurIPS 2022) Oct 24, 2023
Jupyter Notebook 24 Official implementation code for Attention Swin U-Net: Cross-Contextual Attention Mechanism for Skin Lesion Segmentation paper May 09, 2023
Python 42 non-official PyTorch implementation of MobileNeXt from paper [Rethinking Bottleneck Structure for Efficient Mobile Network Design] Jul 07, 2022
None 12 [NeurIPS 2022] Official implementation of the paper "Rethinking Resolution in the Context of Efficient Video … Oct 19, 2022
Python 12 Official implementation of "Clustering as Attention: Unified Image Segmentation with Hierarchical Clustering" Aug 02, 2022
None 3 Official implementation for T-IP submission "Person Re-identification via Attention Pyramid" May 18, 2021
Python 80 The official implementation of ELSA: Enhanced Local Self-Attention for Vision Transformer May 24, 2022
Python 54 Official implementation of "Global and local attention-based free-form image inpainting" Apr 15, 2023
Python 38 The official Pytorch implementation of APNet: Person Re-identification via Attention Pyramid Apr 18, 2023
Python 103 [CVPR2022 - Oral] Official Jax Implementation of Learned Queries for Efficient Local Attention May 12, 2023
Python 2 It contains softmax loss, norm softmax loss, L-softmax loss, A-softmax loss, CosFace loss, ArcFace loss. Dec 01, 2022
Python 73 [ECCV'22] The official PyTorch implementation of our ECCV 2022 paper: "AiATrack: Attention in Attention for … Apr 18, 2023
Jupyter Notebook 3 This is an AM-Softmax tutorial and keras implementation. May 31, 2022
Python 14 Official Pytorch Implementation of "PETA: Photo Albums Event Recognition using Transformers Attention" (2021) Mar 13, 2023
Python 52 Official Implementation of Attention-Guided Pyramid Context Networks for Infrared Small Target Detection May 12, 2023
HTML 2 Interactive softmax Dec 19, 2023
Python 42 Official PyTorch implementation of "The Center of Attention: Center-Keypoint Grouping via Attention for Multi-Person Pose … Sep 14, 2022
C++ 105 Large-Margin Softmax Loss, Angular Softmax Loss, Additive Margin Softmax, ArcFaceLoss And FocalLoss In Tensorflow May 15, 2023
Python 3 Official implementation of “Generative Image Inpainting Based on Wavelet Transform Attention Model”---ISCAS 2020 Aug 14, 2021
Python 19 This is an official implementation for "Attention-based Residual Autoencoder for Video Anomaly Detection". Jun 28, 2022
Python 24 Official implementation for "GLASS: Global to Local Attention for Scene-Text Spotting" (ECCV'22) Aug 23, 2022
Python 100 Official PyTorch implementation of UACANet: Uncertainty Augmented Context Attention for Polyp Segmentation (ACMMM 2021) Apr 27, 2023
Python 23 [CVPR 2021] Official Implementation of VAI: Unsupervised Visual Attention and Invariance for Reinforcement Learning Mar 17, 2023
Jupyter Notebook 19 Official Pytorch Implementation for "Continual Transformers: Redundancy-Free Attention for Online Inference" [ICLR 2023] May 09, 2023
Python 47 Official Pytorch implementation of Multi-Similarity and Attention Guidence for Boosting Few-Shot Segmentation. Jun 23, 2023
Python 147 PyTorch implementation of a Variational Autoencoder with Gumbel-Softmax Distribution Sep 24, 2022
HTML 17 Rethinking the $ May 11, 2022
Python 10 Keras Layer implementation of Attention Jul 26, 2021
Python 2690 Attention mechanism Implementation for Keras. Dec 01, 2022
Python 12 Implementation of various attention mechanisms Mar 22, 2023
Jupyter Notebook 6 Official PyTorch implementation of "Attention-Free Keyword Spotting", M. M. Morshed & A. O. Ahsan, 2021. Jul 10, 2022
Python 6 Official implementation of Memory-Augmented Non-Local Attention for Video Super-Resolution in CVPR 2022 Jul 13, 2022