mdistiller

The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillation-Oriented Trainer https://openaccess.thecvf.com/content/ICCV2023/papers/Zhao_DOT_A_Distillation-Oriented_Trainer_ICCV_2023_paper.pdf

Stars

749

Forks

114

Language

Python

Last Updated

May 15, 2024

Similar Repos
Repo Language Stars Description Updated At
Jupyter Notebook 64 TF2 implementation of knowledge distillation using the "function matching" hypothesis from https://arxiv.org/abs/2106.05237. Sep 16, 2022
Python 11 Code for the EMNLP2020 long paper "Lifelong Language Knowledge Distillation" https://arxiv.org/abs/2010.02123 Feb 23, 2023
Python 57 Official Codes and Pretrained Models for Dynamic MLP, CVPR2022, https://arxiv.org/abs/2203.03253 Oct 14, 2022
Python 9 Official Implementation of paper https://arxiv.org/abs/1801.02612 Sep 21, 2022
Jupyter Notebook 531 Official Implementation of Paella https://arxiv.org/abs/2211.07292v1 Apr 24, 2023
Python 42 Official implementation of AdaMML. https://arxiv.org/abs/2105.05165. Aug 01, 2022
Python 136 Official implementation of CrossViT. https://arxiv.org/abs/2103.14899 Aug 04, 2022
Jupyter Notebook 22 Official implementation of https://arxiv.org/abs/2105.08655 paper Sep 23, 2022
Jupyter Notebook 11 Official implementation of https://arxiv.org/abs/2108.11554 paper May 08, 2022
Python 2 Official PyTorch Implementation for the paper https://arxiv.org/abs/2302.13929. May 10, 2023
None 174 Official implementation for "Blended Latent Diffusion" https://arxiv.org/abs/2206.02779 Oct 14, 2022
Python 123 The official implementation of Equalization Loss v1 & v2 (CVPR 2020, 2021) based on MMDetection. … Oct 13, 2022
Python 308 Implementation of https://arxiv.org/abs/1904.00962 May 16, 2022
Python 44 Implementation of https://arxiv.org/abs/1703.00792. Sep 30, 2022
Python 25 Implementation for https://arxiv.org/abs/2005.00652 Oct 17, 2022
C 3 Implementation for https://arxiv.org/abs/2110.01111 Jun 15, 2022
Python 313 [PyTorch] Official implementation of CVPR2022 paper "TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with … Aug 10, 2022
Python 16 Task Decoupled Knowledge Distillation For Lightweight Face Detectors Feb 27, 2023
Python 74 Official PyTorch implementation of SynDiff described in the paper (https://arxiv.org/abs/2207.08208). Apr 28, 2023
Python 9 Official PyTorch implementation of AdaDiff described in the paper (https://arxiv.org/abs/2207.05876). May 05, 2023
Python 14 Implementation of the paper https://arxiv.org/abs/1603.00448. Oct 06, 2022
Python 82 Pytorch implementation of LOLA (https://arxiv.org/abs/1709.04326) using DiCE (https://arxiv.org/abs/1802.05098) Sep 15, 2022
Python 4 Keras implementation of https://arxiv.org/abs/1611.06612 Apr 13, 2021
Python 6 Keras implementation of https://arxiv.org/abs/1510.07391 Aug 09, 2022
Python 9 Python implementation of https://arxiv.org/abs/2110.01111 May 15, 2022
Python 3 Keras implementation of https://arxiv.org/abs/1606.02147 Jun 10, 2021
Python 25 Implementation of BertGrid : https://arxiv.org/abs/1909.04948 Sep 11, 2022
Python 98 SEGAN pytorch implementation https://arxiv.org/abs/1703.09452 Oct 14, 2022
Python 35 TensorFlow Implementation of https://arxiv.org/abs/1807.06653 Jun 30, 2022
Python 20 Library implementation of https://arxiv.org/abs/1908.05968v5 Jul 12, 2022
Python 12 PyTorch implementation of https://arxiv.org/abs/1711.02536 May 23, 2020
Python 12 pytorch implementation of https://arxiv.org/abs/1705.09847 Jan 17, 2022
Jupyter Notebook 39 implementation of paper https://arxiv.org/abs/2210.04559 Apr 08, 2023
Python 6 implementation of DSEBM(https://arxiv.org/abs/1605.07717) Nov 17, 2021
Python 86 Official implementation of "Decoder Modulation for Indoor Depth Completion" https://arxiv.org/abs/2005.08607 Sep 29, 2022
Python 46 Official repository of our paper: https://arxiv.org/abs/2010.15366 Sep 22, 2022
Python 14 Code for "Adversarial Distillation of Bayesian Neural Network Posteriors" https://arxiv.org/abs/1806.10317 Dec 13, 2021
Python 2641 The OCR approach is rephrased as Segmentation Transformer: https://arxiv.org/abs/1909.11065. This is an official implementation of … Aug 12, 2022
Python 7 official implementation of the PR-PL model (arxiv：https://arxiv.org/abs/2202.06509) Apr 13, 2023
Python 49 (CVPR2022) Official PyTorch Implementation of KDEP. Knowledge Distillation as Efficient Pre-training: Faster Convergence, Higher Data-efficiency, … Oct 19, 2022
Python 10 Code for the paper "Attention Temperature Matters in Abstractive Summarization Distillation"(https://arxiv.org/abs/2106.03441) Feb 21, 2023
Python 714 PyTorch implementation of SimSiam https//arxiv.org/abs/2011.10566 Aug 09, 2022
Python 1591 PyTorch implementation of SwAV https//arxiv.org/abs/2006.09882 Aug 09, 2022
Python 3465 PyTorch implementation of MoCo: https://arxiv.org/abs/1911.05722 Aug 10, 2022
Python 4217 PyTorch implementation of MAE https//arxiv.org/abs/2111.06377 Aug 10, 2022
None 2 PyTorch implementation of MAML: https://arxiv.org/abs/1703.03400 Jun 23, 2022
Jupyter Notebook 17 A TensorFlow2.0 implementation of https://arxiv.org/abs/1803.05400 Apr 08, 2022
Python 43 PyTorch implementation of IRMAE https//arxiv.org/abs/2010.00679 Jul 24, 2022
Jupyter Notebook 511 PyTorch implementation of MAML: https://arxiv.org/abs/1703.03400 Oct 06, 2022
Python 268 pytorch implementation of structure2vec (https://arxiv.org/abs/1603.05629) Sep 23, 2022