torch-multi-head-attention

Multi-head attention in PyTorch

Stars

130

Forks

35

Language

Python

Last Updated

Oct 08, 2023

Similar Repos
Repo Language Stars Description Updated At
Python 6 Multi-Head Attention, Transformer, Perceiver, Linear Attention. Oct 19, 2023
Python 16 A PyTorch implementation of the Compact Multi-Head Self-Attention Mechanism from the paper: "Low Rank Factorization … Aug 11, 2022
Python 4 A pytorch version handwritten recognition with CNN and Multi head self attention Jan 11, 2022
Python 2 Visualize DETR Multi-Head Self-Attention weight May 08, 2023
Python 42 Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a … Jul 26, 2022
Python 135 Code for Multi-Head Attention: Collaborate Instead of Concatenate Apr 29, 2023
Python 20 The PyTorch implementation of ReCoSa(the Relevant Contexts with Self-attention) for dialogue generation using the multi-head … Mar 14, 2022
Python 11 Neural News Recommendation with Multi-Head Self-Attention using BERT Sep 12, 2022
Jupyter Notebook 3 Multi-Head Bi-Directional Attention Flow For Machine Reading Comprehension Aug 07, 2022
Python 3 A sliding window based multi-head attention using longformer cuda kernels Oct 22, 2022
None 5 Nested Deformable Multi-head Attention for Facial Image Inpainting [WACV-23] Apr 26, 2023
Python 2 ResNet for License Plate Detection & Multi-Head Self Attention Transformer for OCR Jun 12, 2023
Python 8 text classification with various advanced modules and latest models such as leam, hard attention, multi-head … Apr 30, 2022
Python 2 A PyTorch implementation of MCA based on PRICAI 2022 paper "Weakly-supervised Temporal Action Localization with … Jul 29, 2023
Python 15 Source code of the paper "Attention as Relation: Learning Supervised Multi-head Self-Attention for Relation Extraction, … Dec 22, 2021
Python 6 Code for ACL 2022 findings paper "Gaussian Multi-head Attention for Simultaneous Machine Translation" Apr 14, 2023
Python 3 PyTorch implementation of "Distinguishing Homophenes using Multi-Head Visual-Audio Memory" (AAAI2022) Jun 10, 2022
Python 8 MULTI HEAD SELF-ATTENTION BASED SPATIAL-TEMPORAL INFORMATION GRAPH CONVOLUTIONAL NETWORKS FOR TRAFFIC FLOW FORECASTING May 18, 2022
Python 115 Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not … Aug 12, 2022
Python 3 SmartCar Head PoseEstimation using PyTorch Sep 17, 2020
Python 5 Head pose estimation using PyTorch Mar 17, 2022
Python 21 Multihead Attention for PyTorch Mar 22, 2023
Python 2 PyTorch Attention Transformer wrapper Sep 03, 2022
Python 13 Official PyTorch implementation of "Multi-Head Distillation for Continual Unsupervised Domain Adaptation in Semantic Segmentation" Apr 14, 2023
Python 10 Batch MultiHead Graph Attention Pytorch Jun 10, 2022
Python 145 pytorch neural network attention mechanism Jan 05, 2024
Python 47 Official Pytorch implementation of Multi-Similarity and Attention Guidence for Boosting Few-Shot Segmentation. Jun 23, 2023
Python 42 Official PyTorch implementation of "The Center of Attention: Center-Keypoint Grouping via Attention for Multi-Person Pose … Sep 14, 2022
Jupyter Notebook 3 Multi-Attention Multiple Instance Learning Oct 09, 2022
Python 455 Pytorch!!!Pytorch!!!Pytorch!!! Dynamic Convolution: Attention over Convolution Kernels (CVPR-2020) May 15, 2023
Python 3 The PyTorch implementation of Multi-Level Attention-Based Domain Disentanglement for Bidirectional Cross-Domain Recommendation. Mar 14, 2023
Python 6 MPCN implemented using Pytorch for KDD 2018 Paper "Multi-Pointer Co-Attention Networks for Recommendation" May 13, 2022
Python 20 Official PyTorch Implementation of "GATraj: A Graph- and Attention-based Multi-Agent Trajectory Prediction Model" Apr 10, 2023
Python 4 Repository for the Multi-Head Multi-Loss Model Calibration paper Feb 28, 2024
Python 4 Pytorch implementation of graph attention network Jul 11, 2022
Python 16 Implementation of Kronecker Attention in Pytorch May 06, 2022
Python 16 Pytorch implementation of Self-Attention ConvLSTM May 08, 2023
Python 18 PyTorch implementation of Graph Attention Networks Jan 09, 2023
Python 3 Seq2Seq model implemented with pytorch, using Bahdanau Attention and Luong Attention. Oct 25, 2022
Python 10 Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on … Sep 23, 2022
Python 68 Multi heads attention for image classification Aug 13, 2022
Python 55 Applying Common-Sense Reasoning to Multi-Modal Dense Video Captioning and Video Question Answering | Python3 | … Sep 09, 2022
Python 6 Pytorch implementation of Realtime Global Attention Network Mar 16, 2022
Python 57 Implementation of deep implicit attention in PyTorch Apr 23, 2023
Python 14 PyTorch implementation of ResNeSt : Split-Attention Networks Jun 19, 2022
Python 28 PyTorch implementation of Pay Attention to MLPs Aug 17, 2022
Python 44 Heterogeneous Graph Attention Network (HAN) with pytorch Jul 22, 2022
Python 615 Implementing Attention Augmented Convolutional Networks using Pytorch Apr 26, 2023
Jupyter Notebook 23 A PyTorch implementation of Compositional Attention Networks Aug 18, 2021
Jupyter Notebook 5 Pytorch implementation of Attention Augmented Convolutional Networks Sep 25, 2022