BERT-SDA

A PyTorch implementation of "Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation"

Stars

56

Forks

10

Language

Python

Last Updated

May 08, 2024

Similar Repos
Repo Language Stars Description Updated At
Jupyter Notebook 4 Fine-tuning and deploying BERT through FastAPI Jul 10, 2022
Python 30 Fine Tuning BERT for Text Classification and Question Answering Using TensorFlow & PyTorch Frameworks Aug 20, 2022
Python 2 BERT fine-tuning with Chinese corpus Sep 21, 2021
Jupyter Notebook 36 Fine tuning bert for text generation Mar 24, 2022
Python 2 Improving Ensemble Distillation With Weight Averaging and Diversifying Perturbation (ICML 2022) May 21, 2023
None 5 BERT模型fine-tuning解读 Nov 26, 2020
Python 177 pytorch implementation for Patient Knowledge Distillation for BERT Model Compression Sep 05, 2022
Python 2 About This repository is the official implementation of "Improving Fine-tuning of Self-supervised Models with Contrastive … Sep 28, 2022
Jupyter Notebook 6 Fine-tuning google's BERT model on text classification for sentiment analysis with pytorch and keras Oct 09, 2021
Python 9 A PyTorch implementation for fine-tuning AlexNet on Office dataset Sep 10, 2022
Python 8 BERT Fine-tuning for Aspect Based Sentiment Analysis Aug 02, 2022
Python 10 IsoBN: Fine-Tuning BERT with Isotropic Batch Normalization May 07, 2022
Jupyter Notebook 27 BERT Model Fine-tuning on Quora Questions Pairs Aug 26, 2022
Jupyter Notebook 66 BERT fine-tuning for POS tagging task (Keras) Sep 04, 2022
Python 13 A pytorch implementation of the ICCV2021 workshop paper SimDis: Simple Distillation Baselines for Improving Small … Jan 02, 2023
None 2 Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning … Mar 27, 2023
C 17 Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning … Mar 30, 2023
Python 15 Ensemble Knowledge Guided Sub-network Search and Fine-tuning for Filter Pruning May 04, 2023
Jupyter Notebook 2 Fine-tuning a BERT model using Ktrain | Transfer Learning NLP | Fine Tune Bert For … Apr 02, 2022
Python 34 BERT, RoBERTa fine-tuning over SQuAD Dataset using pytorch-lightning⚡️, 🤗-transformers & 🤗-nlp. Dec 12, 2022
Python 8 The official implementation for paper: Improving Knowledge Distillation via Regularizing Feature Norm and Direction Jul 13, 2023
Python 43 Pytorch Implementation of EncT5: Fine-tuning T5 Encoder for Non-autoregressive Tasks Apr 18, 2023
Python 6 The implementation of "Personalized Edge Intelligence via Federated Self- Knowledge Distillation". Apr 24, 2023
Jupyter Notebook 14 ❓Fine-Tuning BERT for extractive QA on SQuAD 2.0 May 09, 2023
Python 116 On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines Sep 06, 2022
Jupyter Notebook 2 Notebooks for teaching transformers and fine-tuning a pre-trained BERT model May 19, 2023
Python 92 PyTorch implementation for Channel Distillation May 22, 2023
Python 43 PyTorch implementation of paper "Dataset Distillation via Factorization" in NeurIPS 2022. Mar 28, 2023
Python 102 Comparatively fine-tuning pretrained BERT models on downstream, text classification tasks with different architectural configurations in … Aug 26, 2022
Python 4 Fine-tune BERT on RACE with pytorch-lightning Mar 23, 2023
Jupyter Notebook 9 A repo to implement BERT fine tuning and classification using Amazon Review Dataset. Apr 10, 2022
Jupyter Notebook 6 Multi-Label Text Classification by fine-tuning BERT and XLNet and deployment using Flask Jul 23, 2022
Jupyter Notebook 10 This repository provides code and resources for Parameter Efficient Fine-Tuning (PEFT), a technique for improving … Oct 13, 2023
Python 7 Automatic Diabetic Retinopathy Grading via self-knowledge distillation Oct 24, 2022
Python 23 Biomedical Data-to-Text Generation via Fine-Tuning Transformers Mar 28, 2023
Python 17 A fine-tune framework based on pytorch-pretrained-BERT Dec 28, 2020
Jupyter Notebook 2 A fine-tuning BERT model for detect and to binary classify fake news articles. Sep 06, 2022
TypeScript 312 LLM fine-tuning and eval Jan 17, 2024
Python 112 Official PyTorch implementation of "Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data" Apr 21, 2023
Python 9 Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation. NeurIPS 2022. May 27, 2023
Python 514 Pytorch Implementation of Google BERT Jul 25, 2022
Python 4 My Pytorch implementation of BERT Jan 05, 2023
Python 30 MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning Jun 19, 2023
Python 29 Code for "BayesAdapter: Being Bayesian, Inexpensively and Robustly, via Bayeisan Fine-tuning" Apr 06, 2023
Python 22 Implementation of "DiffFit: Unlocking Transferability of Large Diffusion Models via Simple Parameter-Efficient Fine-Tuning" May 10, 2023
Jupyter Notebook 21 Notebooks for fine-tuning a BERT model and training a LSTM model for financial QA Mar 09, 2023
Jupyter Notebook 21 Fine-tuned BERT on SQuAd 2.0 Dataset. Applied Knowledge Distillation (KD) and fine-tuned DistilBERT (student) using … Apr 10, 2023
Python 3 Multilingual Emotion classification using BERT (fine-tuning). Published at the WASSA workshop (ACL2022). Apr 10, 2023
Python 14 PyTorch implementation of (Hinton) Knowledge Distillation and a base class for simple implementation of other … Apr 15, 2023
Python 7 PyTorch Implementation of Fast and Accurate Single Image Super-Resolution via Information Distillation Network (CVPR 2018) Mar 24, 2023