qat

Manually implemented quantization-aware training

Stars

19

Forks

4

Language

Python

Last Updated

Mar 06, 2024

Similar Repos
Repo Language Stars Description Updated At
Python 12 Quantization Aware Training Oct 12, 2023
Python 77 PyTorch Quantization Aware Training Example Apr 18, 2023
Python 2 Training-aware quantization in Pytorch Jul 14, 2022
Python 680 Brevitas: quantization-aware training in PyTorch Aug 11, 2022
Python 16 Quantization-aware training with spiking neural networks Mar 13, 2023
Python 228 A nnie quantization aware training tool on pytorch. May 05, 2023
None 2 A Study on Optimal INT8 Quantization-aware Training from Scratch Nov 22, 2021
Python 2 This is a quantization aware training code for the ESPCN model implemented in keras using … Dec 19, 2022
Python 12 fixed-point, symmetric, power-of-2 quantization-aware training in tensorflow 1.13.1 May 30, 2022
None 2 A repository that shares tuning results of trained models generated by TensorFlow / Keras. Post-training … Feb 28, 2023
Python 2 A repository that shares tuning results of trained models generated by TensorFlow / Keras. Post-training … Nov 18, 2022
HTML 3 This example shows how to perform quantization aware training for transfer learned MobileNet-v2 network. Apr 06, 2023
Python 100 FrostNet: Towards Quantization-Aware Network Architecture Search Jul 30, 2022
Python 168 Code repo for the paper "LLM-QAT Data-Free Quantization Aware Training for Large Language Models" Jan 12, 2024
Python 88 Post-Training Quantization for Vision transformers. May 16, 2023
Python 58 Inference of quantization aware trained networks using TensorRT Jul 06, 2022
Python 4 Hessian Aware Quantization of the DECOLLE Spiking Neural Network Oct 16, 2022
Jupyter Notebook 31 Post-training static quantization using ResNet18 architecture Apr 20, 2023
Python 92 Uncertainty-aware Self-training Jul 30, 2022
Python 1373 AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration Jan 19, 2024
Jupyter Notebook 2 Post-training quantization on Nvidia Nemo ASR model Mar 28, 2023
Jupyter Notebook 11 Scripts for training neural networks resistant to photon shot noise with quantization-aware training, together with … Apr 18, 2023
Python 292 [CVPR 2019, Oral] HAQ: Hardware-Aware Automated Quantization with Mixed Precision Aug 04, 2022
Python 42 [ECCV 2022] Patch Similarity Aware Data-Free Quantization for Vision Transformers Aug 19, 2022
Python 77 Reorder-based post-training quantization for large language model Apr 12, 2023
Jupyter Notebook 421 Solve captcha without manually labeling a training set Apr 19, 2023
C 2 Fairness-Aware Tree Training software artifact Dec 20, 2021
Python 31 An official PyTorch implementation of the paper "Distance-aware Quantization", ICCV 2021. Aug 12, 2022
None 5 Noise Aware Training (NAT) for visual saliency Jul 11, 2022
Python 84 SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models Nov 23, 2022
Python 8 Adaptive Message Quantization and Parallelization for Distributed Full-graph GNN Training Apr 17, 2023
Python 49 TUTA and ForTaP for Structure-Aware and Numerical-Reasoning-Aware Table Pre-Training Aug 03, 2022
Python 14 [CVPR 2023] PD-Quant: Post-Training Quantization Based on Prediction Difference Metric Apr 25, 2023
None 83 Training & Quantization of embedded friendly Deep Learning / Machine Learning / Computer Vision models Jun 17, 2022
Python 106 [IJCAI 2022] FQ-ViT: Post-Training Quantization for Fully Quantized Vision Transformer Aug 12, 2022
Python 2 This repositories archived a set of algorithms implemented manually using Python. Feb 19, 2020
Jupyter Notebook 2 Lagrangian mechanics implemented 3 ways: manually, with auto-diff, and symbolically. Feb 14, 2022
Jupyter Notebook 2 Deadline Aware AI Training Job Scheduler for Heterogenious cluster Jun 27, 2022
None 2 A dataset for training LLM to become self-aware. Jun 22, 2023
C 2 Image quantization Nov 15, 2022
Python 3 product quantization Jun 21, 2021
Python 2 Pytorch implementation of our paper -- Fine-grained Data Distribution Alignment for Post-Training Quantization Apr 27, 2022
Python 4 Pre-training Time-Aware Location Embeddings from Spatial-Temporal Trajectories. Oct 21, 2021
C 370 DAIN, Depth-Aware Video Frame Interpolation implemented with ncnn library Aug 14, 2022
C 2 DAIN, Depth-Aware Video Frame Interpolation implemented with ncnn library Jan 16, 2023
Jupyter Notebook 48 This is 8-bit quantization sample for yolov5. Both PTQ, QAT and Partial Quantization have been … May 08, 2023
Python 230 Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers" Mar 22, 2023
None 3 Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers". Apr 22, 2023
Python 26 COLA contrastive pre-training method implemented in PyTorch Aug 22, 2022
Python 6 Automatic quantization library Jul 16, 2022