AFT-MindSpore

Unofficial MindSpore implementation of Attention Free Transformer (AFT) layers by Apple Inc.

Stars

2

Forks

1

Language

Python

Last Updated

Sep 15, 2023

Similar Repos
Repo Language Stars Description Updated At
Python 195 Unofficial PyTorch implementation of Attention Free Transformer (AFT) layers by Apple Inc. Apr 18, 2023
Python 6 Unofficial PyTorch implementation of **Attention Free Transformer**'s layers by [Zhai](https://twitter.com/zhaisf?lang=en), et al. [[abs](https://openreview.net/forum?id=pW--cu2FCHY), [pdf](https://arxiv.org/pdf/2105.14103.pdf)] from … Aug 20, 2022
Julia 31 Reusable functionality for defining custom attention/transformer layers. Apr 04, 2023
Python 41 This is an unofficial implementation of BOAT: Bilateral Local Attention Vision Transformer Jun 17, 2022
Python 4 NAT implementation(Neighborhood Attention Transformer) This is an unofficial implementation. https://arxiv.org/pdf/2204.07143.pdf Apr 02, 2023
Python 4 Pale Transformer implementation(Pale Transformer: A General Vision Transformer Backbone with Pale-Shaped Attention) This is an … Nov 21, 2022
Python 2 Visualize transition of attention weights across layers in a Transformer as a GIF Mar 15, 2024
Python 6 PyTorch implementation of RealFormer: Transformer Likes Residual Attention Nov 20, 2021
Python 24 Jittor implementation of Vision Transformer with Deformable Attention May 18, 2022
Python 214 Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention Aug 12, 2022
None 3 An unofficial implementation of the σReparam from the "Stabilizing Transformer Training by Preventing Attention Entropy … Apr 13, 2023
Python 269 Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image … Aug 10, 2022
None 2 Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image … Mar 07, 2021
Python 7 Transformer(Attention Is All You Need) Implementation in Pytorch Aug 22, 2022
Python 76 Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch Aug 01, 2022
Python 4 TensorFlow implementation of "Attention is all you need (Transformer)" Jan 05, 2022
Python 104 Implementation of Deformable Attention in Pytorch from the paper "Vision Transformer with Deformable Attention" Aug 11, 2022
Python 115 Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning Jun 25, 2022
Erlang 11 Erlang SS7 TCAP/MAP implementation (motivity inc unofficial mirror + experimental branches) Apr 17, 2023
Jupyter Notebook 40 An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches Jul 25, 2022
Jupyter Notebook 20 🤗 Unofficial huggingface/diffusers-based implementation of the paper "Training-Free Layout Control with Cross-Attention Guidance". Apr 25, 2023
Python 853 An implementation of Performer, a linear attention-based transformer, in Pytorch Aug 11, 2022
Python 3770 A TensorFlow Implementation of the Transformer: Attention Is All You Need Aug 23, 2022
Python 3 A TensorFlow Implementation of the Transformer: Attention Is All You Need Dec 28, 2019
Python 2 A TensorFlow Implementation of the Transformer: Attention Is All You Need Jan 09, 2019
Python 2 A TensorFlow Implementation of the Transformer: Attention Is All You Need Aug 04, 2020
Python 89 A PyTorch implementation of Transformer in "Attention is All You Need" May 03, 2023
Python 2 A TensorFlow Implementation of the Transformer: Attention Is All You Need Jun 10, 2019
Python 251 This is an unofficial implementation of the Point Transformer paper. Aug 15, 2022
Python 51 Unofficial implementation of "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows" (https://arxiv.org/abs/2103.14030) Sep 29, 2022
Python 69 A 🤗-style implementation of BERT using lambda layers instead of self-attention Aug 04, 2022
Python 80 The official implementation of ELSA: Enhanced Local Self-Attention for Vision Transformer May 24, 2022
Python 88 Implementation of CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification Aug 18, 2022
Jupyter Notebook 41 Unofficial PyTorch implementation of the paper "cosFormer: Rethinking Softmax In Attention". Apr 23, 2023
Python 2 Unofficial Implementation of "Attention-based Domain Adaptation for Single Stage Detectors" Jun 04, 2023
Python 214 Unofficial implementation of Exploring Plain Vision Transformer Backbones for Object Detection May 27, 2022
Python 461 Reference implementation of the Transformer architecture optimized for Apple Neural Engine (ANE) Aug 11, 2022
Python 47 A PyTorch implementation of the Transformer model from "Attention Is All You Need". Jul 12, 2022
Python 6894 A PyTorch implementation of the Transformer model in "Attention is All You Need". Oct 10, 2022
Python 7 A Tensorflow implementation of the Transformer model in "Attention is All You Need" Oct 09, 2021
Python 12 A numpy implementation of the Transformer model in "Attention is All You Need" Apr 27, 2023
Python 11 A pytorch implementation of Attention Is All You Need (Transformer) for image captioning. Mar 14, 2023
None 2 A PyTorch implementation of the Transformer model in "Attention is All You Need". Mar 15, 2022
None 2 CoAtNet: Marrying Convolution and Attention for All Data Sizes Pytorch Implementation (Unofficial) Nov 02, 2021
None 7 This repository contain the unofficial implementation of the graph attention neural network. Apr 04, 2023
Python 73 [ECCV'22] The official PyTorch implementation of our ECCV 2022 paper: "AiATrack: Attention in Attention for … Apr 18, 2023
Python 4 [WIP] Unofficial PyTorch implementation of the "Audio Transformer" by Verma & Berger (2021) Nov 11, 2022
Python 40 a simple unofficial implementation of classifier-free diffusion guidance May 17, 2023
Jupyter Notebook 7 An implementation of "Set Transformer: A Framework for Attention-based Permutation-Invariant Neural Networks" Jan 01, 2023
None 2 Simple Paper Implementation Code about all model after Attention is all you need(Transformer) Dec 02, 2020