AttentionGuidance

Guiding Attention for Self-Supervised Learning with Transformers

Stars

9

Forks

1

Language

Python

Last Updated

Feb 08, 2023

Similar Repos
Repo Language Stars Description Updated At
Shell 2 Heuristic Attention Representation Learning for Self-Supervised Pre-training Jun 25, 2022
Python 496 This is an official implementation for "Self-Supervised Learning with Swin Transformers". Jul 12, 2022
Python 3 Self-supervised vision transformers for joint SAR-optical representation learning Jul 09, 2022
Python 3862 PyTorch code for Vision Transformers training with the Self-Supervised learning method DINO Aug 10, 2022
Python 2 PyTorch code for Vision Transformers training with the Self-Supervised learning method DINO Nov 25, 2022
Python 315 EsViT: Efficient self-supervised Vision Transformers Jul 27, 2022
Python 87 [CVPR 2022] Learning Affinity from Attention: End-to-End Weakly-Supervised Semantic Segmentation with Transformers Aug 17, 2022
Jupyter Notebook 4 Self-Supervised-Learning with Lightly for Learning Purpose May 26, 2022
Python 12 Self-Supervised Learning Jun 24, 2023
Python 7 Visual Representation Learning with Self-Supervised Attention for Low-Label High-Data Regime [ICASSP-2022] Apr 08, 2023
None 3 Awesome Transformers (self-attention) in Computer Vision Jan 28, 2021
Python 6 An Empirical Study Of Self-supervised Learning Approaches For Object Detection With Transformers - CV703 Course … Apr 10, 2023
Python 91 [NeurIPS 2021] Revitalizing CNN Attentions via Transformers in Self-Supervised Visual Representation Learning Apr 21, 2023
Python 9 Histology Self-Supervised Learning Apr 18, 2023
Python 5 Self-Supervised Reinforcement Learning Apr 25, 2023
Python 66 Code for CVPR 2021 paper: Revamping Cross-Modal Recipe Retrieval with Hierarchical Transformers and Self-supervised Learning Jun 08, 2022
Python 2 Reimplementation of Self-Supervised Vision Transformers with DINO in pytorch-lightning Jul 14, 2022
Python 477 Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentation, CVPR 2020 (Oral) Apr 30, 2023
Python 7 Self-supervised pre-training for ECG representation with inspiration from transformers & computer vision Apr 24, 2023
Python 235 DepthContrast self-supervised learning for 3D Jul 26, 2022
Python 3 Naive codebase for self-supervised learning Nov 25, 2022
Python 2 Self-Supervised Learning for Outlier Detection. May 12, 2023
Python 15 Source code of the paper "Attention as Relation: Learning Supervised Multi-head Self-Attention for Relation Extraction, … Dec 22, 2021
None 2 Awesome Graph Self-Supervised Learning Sep 23, 2022
None 6 Awesome Self-Supervised Vision Learning Dec 15, 2022
None 2 Bayesian Self-Supervised Contrastive Learning May 19, 2023
Python 4 Bayesian Self-Supervised Contrastive Learning Apr 25, 2023
Python 7 Self-supervised visual representation learning Oct 17, 2021
Python 50 ReSSL: Relational Self-Supervised Learning with Weak Augmentation Mar 28, 2023
Python 75 Vision Transformers with Hierarchical Attention May 28, 2023
Python 2 Self-Supervised Learning for Histopathologic Subtype Classification Nov 08, 2022
Python 10 Self-supervised learning for Sequential Recommender Systems May 07, 2023
Python 7 Official code for "Self-supervised learning with rotation-invariant kernels" Mar 16, 2023
Python 21 Implementation of Sketch-BERT: Learning Sketch Bidirectional Encoder Representation from Transformers by Self-supervised Learning of Sketch … Jan 11, 2023
Jupyter Notebook 7 S5CL: Unifying Fully-Supervised, Self-Supervised, and Semi-Supervised Learning Through Hierarchical Contrastive Learning Jun 12, 2022
Python 93 Tensorflow implementation of S4L: Self-Supervised Semi-Supervised Learning May 23, 2022
Python 4 Self-Contrastive Learning with Hard Negative Sampling for Self-supervised Point Cloud Learning (ACM MM 2021) Mar 09, 2022
None 3 Self-Supervised Learning Toolbox and Benchmark Oct 14, 2022
Jupyter Notebook 9 Denoising Via Self Supervised Transfer Learning Aug 15, 2022
Python 22 [ECCV 2022] AMixer: Adaptive Weight Mixing for Self-attention Free Vision Transformers May 11, 2023
Jupyter Notebook 10 methods to support self-supervised learning with 3D images Jan 11, 2023
Jupyter Notebook 6 Self-Supervised Representation Learning of Wafer Maps with FastSiam Feb 01, 2023
Python 242 UniSpeech - Large Scale Self-Supervised Learning for Speech Aug 01, 2022
Python 15 Self-Supervised Learning for Fine-Grained Image Categorization Apr 25, 2022
Python 29 Visual Representation Learning Benchmark for Self-Supervised Models Jul 22, 2022
Python 6 [WWW'23] "Automated Self-Supervised Learning for Recommendation" Apr 07, 2023
Python 19 SSLRec: A Self-Supervised Learning Framework for Recommendation Apr 28, 2023
Python 257 Self-Supervised Learning for OOD Detection (NeurIPS 2019) Apr 21, 2023
Python 49 Self-Supervised Learning for Deep Clustering (TPAMI 2022) May 05, 2023
Jupyter Notebook 7 Deep Learning, Attention, Transformers, BERT, GPT-2, GTP-3 Apr 04, 2023