ELSA

The official implementation of ELSA: Enhanced Local Self-Attention for Vision Transformer

Stars

108

Forks

11

Language

Python

Last Updated

Feb 06, 2024

Similar Repos
Repo Language Stars Description Updated At
Python 19 Official implementation of "Self-slimmed Vision Transformer" (ECCV2022) Jan 03, 2023
Python 41 This is an unofficial implementation of BOAT: Bilateral Local Attention Vision Transformer Jun 17, 2022
Python 2 Local self-attention in Transformer for visual question answering Oct 19, 2023
None 11 The official repo for [Arxiv'23] "Vision Transformer with Quadrangle Attention" Apr 01, 2023
Python 24 Jittor implementation of Vision Transformer with Deformable Attention May 18, 2022
Python 7 [ICASSP 2022] Official PyTorch Implementation for "Attention Probe: Vision Transformer Distillation in the Wild" (ICASSP … Mar 23, 2023
Python 35 Official Pytorch implementation of Super Vision Transformer Jan 02, 2023
Python 104 Implementation of Deformable Attention in Pytorch from the paper "Vision Transformer with Deformable Attention" Aug 11, 2022
Python 452 Official code for our NeurIPS 2021 Spotlight "Focal Self-attention for Local-Global Interactions in Vision Transformers" Aug 02, 2022
Python 76 Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch Aug 01, 2022
Python 10 Official Code for "Knowing what it is: Semantic-enhanced Dual Attention Transformer" (TMM2022) Jul 29, 2022
Jupyter Notebook 18 Multi-Headed Self-Attention via Vision Transformer for Zero-Shot Learning (ViT-ZSL) May 29, 2022
Python 7 This is an official implementation for "Vicinity Vision Transformer". Jul 14, 2022
Python 11 SiT: Self-supervised vision Transformer Jun 10, 2022
Python 2 Self-supervised vIsion Transformer (SiT) Aug 13, 2022
Python 88 Implementation of CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification Aug 18, 2022
Jupyter Notebook 19 Pytorch implementation of the paper Stand-Alone Self-Attention in Vision Models Mar 18, 2023
Jupyter Notebook 40 An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches Jul 25, 2022
Python 23 Official implementation for "SimA: Simple Softmax-free Attention for Vision Transformers" May 12, 2023
Python 37 The official TensorFlow implementation of the paper "Action Transformer: A Self-Attention Model for Short-Time Pose-Based … Apr 25, 2023
Python 81 A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks May 19, 2022
JavaScript 6 The official Elsa documentation website Mar 12, 2023
Python 8899 This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows". Aug 08, 2022
None 2 This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows". Jan 08, 2022
None 2 This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows". Jul 27, 2021
None 2 This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows". Oct 06, 2022
None 2 This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows". Apr 02, 2023
Python 2 This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows". Jul 03, 2023
Python 183 Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient … Jul 26, 2022
Python 296 Repository of Vision Transformer with Deformable Attention (CVPR2022) Aug 18, 2022
Python 21 Official implementation of PCS in essay "Prompt Vision Transformer for Domain Generalization" Apr 29, 2023
Python 73 [ECCV'22] The official PyTorch implementation of our ECCV 2022 paper: "AiATrack: Attention in Attention for … Apr 18, 2023
None 3 Awesome Transformers (self-attention) in Computer Vision Jan 28, 2021
None 2 The official implementation of MAGVLT: Masked Generative Vision-and-Language Transformer (CVPR'23) Apr 25, 2023
Python 216 [ECCV 2022]Code for paper "DaViT: Dual Attention Vision Transformer" Apr 26, 2023
Python 1035 Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository. May 22, 2023
Python 4 Pale Transformer implementation(Pale Transformer: A General Vision Transformer Backbone with Pale-Shaped Attention) This is an … Nov 21, 2022
Python 4 Vision Transformer Implementation in TensorFlow Mar 26, 2023
Python 76 Implementation of Convolutional enhanced image Transformer Aug 11, 2022
Python 3 Implementation of EIT: ENHANCED INTERACTIVE TRANSFORMER Mar 24, 2023
Python 103 [CVPR2022 - Oral] Official Jax Implementation of Learned Queries for Efficient Local Attention May 12, 2023
Python 794 This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows" on … Jul 13, 2022
None 2 This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows" on … Jul 27, 2021
None 2 This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows" on … Mar 26, 2023
None 2 This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows" on … Jan 28, 2023
Python 10 The official implementation of Triplet Attention. Aug 10, 2022
Python 156 [CVPR 2023] Official code release of our paper "BiFormer: Vision Transformer with Bi-Level Routing Attention" May 06, 2023
Python 31 [BMVC 2021] The official PyTorch implementation of Feature Fusion Vision Transformer for Fine-Grained Visual Categorization Apr 07, 2023
Python 2 Pytorch implementation of Vision Transformer (ViT). Mar 09, 2023
Python 273 Keras implementation of ViT (Vision Transformer) Apr 23, 2023