smart-pytorch

PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models.

Stars

53

Forks

5

Language

Python

Last Updated

Jan 30, 2024

Similar Repos
Repo Language Stars Description Updated At
Python 13 Virtual Data Augmentation: A Robust and General Framework for Fine-tuning Pre-trained Models Aug 06, 2022
Python 13 CSS-LM: Contrastive Semi-supervised Fine-tuning of Pre-trained Language Models Aug 08, 2022
Python 88 Efficient Training (including pre-training and fine-tuning) for Big Models Aug 12, 2022
None 162 A collection of Natural language processing pre-trained models. Jul 27, 2022
None 178 Pre-trained models and language resources for Natural Language Processing in Polish Oct 06, 2022
None 2 pre-trained Language Models Mar 04, 2023
Jupyter Notebook 159 pre-trained Language Models May 10, 2023
None 412 Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT) Aug 16, 2022
None 49 Must-read Papers of Parameter Efficient Methods on Pre-trained Models (Delta Tuning). Aug 15, 2022
Jupyter Notebook 31 Using BERT for doing the task of Conditional Natural Language Generation by fine-tuning pre-trained BERT … Jul 24, 2022
Python 335 Fine-Tuning your VITS model using a pre-trained model May 10, 2023
None 2103 Must-read papers on prompt-based tuning for pre-trained language models. Aug 12, 2022
Jupyter Notebook 2 Easily customizable implementation of Transfer Learning with Fine-Tuning using Keras pre-trained CNN models. Apr 21, 2023
Jupyter Notebook 2 Notebooks for teaching transformers and fine-tuning a pre-trained BERT model May 19, 2023
Python 61 Fine Tuning Language Models for Multilabel Prediction Aug 12, 2022
Python 26 An Implementation of ERNIE For Language Understanding (including Pre-training models and Fine-tuning tools) Oct 18, 2022
Jupyter Notebook 9 An interpretable and efficient predictor using pre-trained language models. Scikit-learn compatible. Oct 12, 2022
Jupyter Notebook 10 This repository provides code and resources for Parameter Efficient Fine-Tuning (PEFT), a technique for improving … Oct 13, 2023
Python 210 A PyTorch-based model pruning toolkit for pre-trained language models Oct 13, 2022
Python 374 LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models Apr 12, 2023
Python 4 Fine-tuning large language models with huggingface transformers and deepspeed Jul 03, 2023
Python 451 Fast & Simple repository for pre-training and fine-tuning T5-style models Apr 30, 2023
None 2 Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning … Mar 27, 2023
C 17 Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning … Mar 30, 2023
Python 5 Annotating Columns with Pre-trained Language Models Aug 02, 2022
None 151 List of Korean pre-trained language models. Apr 13, 2023
Python 3 PhoBERT: Pre-trained language models for Vietnamese Feb 28, 2021
Python 3 Bio-Electra - Small and efficient discriminatively pre-trained language representation models for biomedical text mining May 02, 2022
Python 2 A primer of transformer models and fine-tuning on language tasks Jan 10, 2022
Jupyter Notebook 28 Implementation of Swin Transformers in TensorFlow along with converted pre-trained models, code for off-the-shelf classification … Sep 06, 2022
Python 79 A collection of pre-trained audio models, in PyTorch. Apr 15, 2023
None 2935 Must-read Papers on pre-trained language models. Aug 15, 2022
None 2 Must-read Papers on pre-trained language models. Nov 04, 2021
Python 14 Self-Conditioning Pre-Trained Language Models, ICML 2022 Jul 26, 2022
Python 4 Deep Keyphrase Generation with Pre-trained Language Models Apr 07, 2023
Python 3 A Toolkit for Fine-Tuning Large Language Models with LoRA and DeepSpeed Apr 14, 2023
None 11 Source code and checkpoints for legal pre-trained language models. Jul 02, 2022
Python 89 Source code and checkpoints for legal pre-trained language models. Aug 14, 2022
Python 7 Recipes from fine-tuning a pre-trained wav2vec 2.0 model using the espresso tool kit May 16, 2023
Jupyter Notebook 58 KDD19 Tutorial: From Shallow to Deep Language Representations: Pre-training, Fine-tuning, and Beyond Mar 14, 2022
Python 9 All-in-one repository for Fine-tuning & Pretraining (Large) Language Models Apr 11, 2023
Python 214 Code for the paper Fine-Tuning Language Models from Human Preferences Aug 12, 2022
None 53 KoRean based SBERT pre-trained models (KR-SBERT) for PyTorch May 17, 2023
None 110 A paper list of pre-trained language models (PLMs). Aug 05, 2022
Python 1570 Chinese Pre-Trained Language Models (CPM-LM) Version-I Apr 29, 2023
Python 2 Domain knowledge transferring framework for pre-trained language models Nov 19, 2022
Python 7 Trainer and Evaluation scripts for fine-tuning Whisper models for the Ukrainian language Apr 20, 2023
Python 153 KoRean based BERT pre-trained models (KR-BERT) for Tensorflow and PyTorch Sep 03, 2022
Shell 4 This repository contains pre-trained models and vocab for PyTorch Pretrained BERT Jun 01, 2020
Python 12 KoRean based ELECTRA pre-trained models (KR-ELECTRA) for Tensorflow and PyTorch Jun 03, 2022