knowledge_distillation_implemented

pyTorch implementation of the knowledge distillation to train a compact network to perform much better than it would have by …

Stars

4

Forks

0

Language

Jupyter Notebook

Last Updated

May 30, 2022

Similar Repos
Repo Language Stars Description Updated At
Python 2 Knowledge Distillation Papers in Pytorch Apr 13, 2022
Python 2 Knowledge Distillation Extension Library for PyTorch May 05, 2022
Python 16 Knowledge Distillation Algorithms implemented with PyTorch Feb 05, 2023
Python 4 Distillation Knowledge for training Multi-exit Model May 04, 2022
Python 49 (CVPR2022) Official PyTorch Implementation of KDEP. Knowledge Distillation as Efficient Pre-training: Faster Convergence, Higher Data-efficiency, … Oct 19, 2022
Python 119 A knowledge distillation toolkit based on PyTorch and PyTorch Lightning. Apr 18, 2023
None 2 A PyTorch Implementation of Knowledge Distillation on SSD Nov 08, 2020
Python 1266 Pytorch implementation of various Knowledge Distillation (KD) methods. May 11, 2023
Python 2 Pytorch Implementation of Relational Knowledge Distillation, CVPR 2019 Feb 28, 2022
Python 3 A PyTorch Implementation of Knowledge Distillation on SSD Mar 27, 2023
Jupyter Notebook 69 BigGAN; Knowledge Distillation; Black-Box; Fast Training; 16x compression Feb 15, 2023
Python 47 PyTorch code for training MM-DistillNet for multimodal knowledge distillation. http://rl.uni-freiburg.de/research/multimodal-distill Jul 21, 2022
Python 154 Scripts to train a bidirectional LSTM with knowledge distillation from BERT Aug 21, 2022
Python 37 [CVPR 2023] PointDistiller: Structured Knowledge Distillation Towards Efficient and Compact 3D Detection May 21, 2023
None 9 some paper of Knowledge Distillation and Adversarial Training about NLP May 18, 2023
Python 413 A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge … Aug 30, 2022
Python 1227 A PyTorch-based knowledge distillation toolkit for natural language processing Sep 12, 2022
Python 3 A PyTorch-based knowledge distillation toolkit for natural language processing Apr 12, 2022
Python 177 pytorch implementation for Patient Knowledge Distillation for BERT Model Compression Sep 05, 2022
Python 3 Flask app for dynamic thumbnail generation. Much, much better than django-cloudscope :) Jan 02, 2013
Python 5 Pytorch implement of Zero-shot Knowledge Distillation in Deep Neural Networks Apr 07, 2022
Python 76 [AAAI 2023] Official pytorch implementation for "Curriculum Temperature for Knowledge Distillation" May 18, 2023
Python 96 We evaluate many models used for biomedical and clinical nlp tasks, and train new models … Jul 08, 2022
Python 14 PyTorch implementation of (Hinton) Knowledge Distillation and a base class for simple implementation of other … Apr 15, 2023
Python 14 Effective training of convolutional neural networks for age estimation based on knowledge distillation Mar 24, 2023
Jupyter Notebook 44 Official PyTorch implementation of Data-free Knowledge Distillation for Object Detection, WACV 2021. Jul 09, 2022
Python 35 [ICCV 2021] Official pytorch implementation for "Online Knowledge Distillation for Efficient Pose Estimation" Apr 08, 2023
Python 1444 A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility Sep 01, 2022
Python 67 PyTorch code for ECCV 2020 paper: "Robust Re-Identification by Multiple Views Knowledge Distillation" Mar 17, 2023
Python 196 An Object Detection Knowledge Distillation framework powered by pytorch, now having SSD and yolov5. May 10, 2023
None 10 Official pytorch implementation for "Is Synthetic Data From Diffusion Models Ready for Knowledge Distillation?" May 27, 2023
Python 2 The much needed 2017 programming language (I heard it's better than Python) Apr 10, 2019
Python 92 Dump TeamViewer ID and password from memory. Works much better than other tools. Mar 06, 2023
Lua 2 Linux, for ComputerCraft. Much better than https://github.com/ocawesome101/oc-linux-cc-old. Sep 12, 2023
None 2 A Norwegian extended keyboard layout that is far better than the ancient normal Windows one. Sep 24, 2021
Python 4 Just for backing up my codes, it would be much better if contributed to you Feb 18, 2022
Python 20 An official implementation of "Decomposed Knowledge Distillation for Class-incremental Semantic Segmentation" (NeurIPS 2022) in PyTorch. Nov 26, 2022
C# 11 A Matrix class for Unity C# that is much better than the Matrix4x4 class Sep 13, 2022
None 5 Brainstorm possible research/engineering candidates that could let us train better chatbots than ChatGPT/GPT4 May 31, 2023
Python 3 PyTorch implementation of the paper: CDFKD-MFS: Collaborative Data-free Knowledge Distillation via Multi-level Feature Sharing. Mar 25, 2023
Python 11 Pytorch implementation (TPAMI 2023) - Training Compact CNNs for Image Classification using Dynamic-coded Filter Fusion Mar 28, 2023
Python 2 PyTorch: Train Sparsely, Generate Densely: Memory-efficient Unsupervised Training of High-resolution Temporal GAN Jan 11, 2021
None 2 Pytorch implementation of "All Tokens Matter: Token Labeling for Training Better Vision Transformers" Jun 07, 2023
None 2 "Science is a way of thinking much more than it is a body of knowledge."― … Mar 26, 2021
None 16 "Science is a way of thinking much more than it is a body of knowledge." … Jun 05, 2022
Python 42 This is the official implementation of the paper "Instance-conditional Knowledge Distillation for Object Detection", based … Jul 18, 2022
Python 11 This is the official PyTorch implementation for the paper: "Directed Acyclic Graph Factorization Machines for … Apr 19, 2023
Java 10 This mod adds AIOTs for Botania tools. Because an AIOT is so much better than … Jan 12, 2022
Ruby 11 Histograms, Linear Regression, Normal Distribution Analysis, Counting Occurances. I'm sure someone has made a better … Aug 13, 2019
Python 1602 Contrastive unpaired image-to-image translation, faster and lighter training than cyclegan (ECCV 2020, in PyTorch) Aug 19, 2022