nanoT5

Fast & Simple repository for pre-training and fine-tuning T5-style models

Stars

911

Forks

64

Language

Python

Last Updated

Mar 31, 2024

Similar Repos
Repo Language Stars Description Updated At
Python 88 Efficient Training (including pre-training and fine-tuning) for Big Models Aug 12, 2022
Python 26 An Implementation of ERNIE For Language Understanding (including Pre-training models and Fine-tuning tools) Oct 18, 2022
Python 173 Chinese GPT2: pre-training and fine-tuning framework for text generation Jul 29, 2022
Python 320 Blazing fast framework for fine-tuning similarity learning models Aug 15, 2022
Python 24 PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models May 24, 2022
Python 13 Virtual Data Augmentation: A Robust and General Framework for Fine-tuning Pre-trained Models Aug 06, 2022
Python 80 [CVPR 2020] Adversarial Robustness: From Self-Supervised Pre-Training to Fine-Tuning Jun 29, 2022
Jupyter Notebook 58 KDD19 Tutorial: From Shallow to Deep Language Representations: Pre-training, Fine-tuning, and Beyond Mar 14, 2022
Python 17 PyTorch code for "FactPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarization" (NAACL 2022) Jun 24, 2022
Python 13 CSS-LM: Contrastive Semi-supervised Fine-tuning of Pre-trained Language Models Aug 08, 2022
Python 40 use google pre-training model bert to fine-tuning for the chinese multiclass classification Aug 26, 2022
Jupyter Notebook 365 End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service Aug 05, 2022
Python 3 End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service Mar 21, 2022
Python 12 A unified framework for Low-resource Audio Processing and Evaluation (SSL Pre-training and Downstream Fine-tuning) Jun 27, 2023
Python 9 All-in-one repository for Fine-tuning & Pretraining (Large) Language Models Apr 11, 2023
Python 61 Fine Tuning Language Models for Multilabel Prediction Aug 12, 2022
Python 176 Advanced fine tuning tools for vision models Apr 21, 2023
Python 221 Guide for fine-tuning Llama/CodeLlama models Jan 18, 2024
Python 100 Repo for fine-tuning GPTJ and other GPT models Dec 02, 2022
None 10 Samples for fine-tuning HuggingFace models with AzureML Apr 11, 2023
Python 101 The PyTorch implementation of fine-tuning the GPT-2(Generative Pre-Training 2) for dialogue generation. Sep 05, 2022
Python 51 official implementation for our paper Cal-QL: Calibrated Offline RL Pre-Training for Efficient Online Fine-Tuning Dec 11, 2023
None 2 Generative Biomedical Entity Linking via Knowledge Base-Guided Pre-training and Synonyms-Aware Fine-tuning[NAACL 2022] Jan 27, 2023
None 2 Repository for fine-tuning Transformers 🤗 based seq2seq speech models in JAX/Flax. Jan 18, 2023
Jupyter Notebook 15 Repository for fine-tuning Transformers 🤗 based seq2seq speech models in JAX/Flax. Jun 05, 2022
Jupyter Notebook 2 Notebooks for teaching transformers and fine-tuning a pre-trained BERT model May 19, 2023
Jupyter Notebook 2 Easily customizable implementation of Transfer Learning with Fine-Tuning using Keras pre-trained CNN models. Apr 21, 2023
Python 17 Abstractive text summarization by fine-tuning seq2seq models. Aug 01, 2022
Python 4 Fine-tuning large language models with huggingface transformers and deepspeed Jul 03, 2023
Python 215 Simplify the training and tuning of Tensorflow models Sep 15, 2022
Python 335 Fine-Tuning your VITS model using a pre-trained model May 10, 2023
Python 3 Fine-tuning the GROVER pretrained models for molecular properties prediction. Mar 17, 2022
Python 3 A Toolkit for Fine-Tuning Large Language Models with LoRA and DeepSpeed Apr 14, 2023
Python 9 Code for our SIGIR 2022 accepted paper : P3 Ranker: Mitigating the Gaps between Pre-training … May 13, 2022
None 6 PPT for Fine tuning Dec 24, 2019
Python 10 Implementations of models and metrics for semantic text similarity. Includes fine-tuning and prediction of models Oct 21, 2021
Python 2 A primer of transformer models and fine-tuning on language tasks Jan 10, 2022
Python 77 Easiest way of fine-tuning HuggingFace video classification models Apr 25, 2023
Python 7 Trainer and Evaluation scripts for fine-tuning Whisper models for the Ukrainian language Apr 20, 2023
Python 2 fast style transfer on your webcam, with pre-trained models at Oct 01, 2019
Python 186 fast style transfer on your webcam, with pre-trained models at Oct 22, 2021
Python 8 The ability of GPT-2 to create abstractive summaries with fine-tuning using only keywords, without pre-training. Jan 04, 2022
TypeScript 312 LLM fine-tuning and eval Jan 17, 2024
Jupyter Notebook 28 Implementation of Swin Transformers in TensorFlow along with converted pre-trained models, code for off-the-shelf classification … Sep 06, 2022
Python 15 Fine-tuning scripts for evaluating transformer-based models on KLEJ benchmark. Aug 12, 2022
Python 214 Code for the paper Fine-Tuning Language Models from Human Preferences Aug 12, 2022
Python 2 Code for pre-training BabyLM baseline models. May 28, 2023
Python 4518 🌸 Run 100B+ language models at home, BitTorrent-style. Fine-tuning and inference up to 10x faster … Apr 25, 2023
None 2 Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning … Mar 27, 2023
C 17 Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning … Mar 30, 2023