ERNIE

An Implementation of ERNIE For Language Understanding (including Pre-training models and Fine-tuning tools)

Stars

27

Forks

4

Language

Python

Last Updated

Oct 15, 2023

Similar Repos
Repo Language Stars Description Updated At
Python 88 Efficient Training (including pre-training and fine-tuning) for Big Models Aug 12, 2022
Python 451 Fast & Simple repository for pre-training and fine-tuning T5-style models Apr 30, 2023
Python 5050 Official implementations for various pre-training models of ERNIE-family, covering topics of Language Understanding & Generation, … Aug 08, 2022
Python 24 PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models May 24, 2022
Jupyter Notebook 58 KDD19 Tutorial: From Shallow to Deep Language Representations: Pre-training, Fine-tuning, and Beyond Mar 14, 2022
Python 13 CSS-LM: Contrastive Semi-supervised Fine-tuning of Pre-trained Language Models Aug 08, 2022
Python 61 Fine Tuning Language Models for Multilabel Prediction Aug 12, 2022
Python 176 Advanced fine tuning tools for vision models Apr 21, 2023
Python 173 Chinese GPT2: pre-training and fine-tuning framework for text generation Jul 29, 2022
Python 4 Fine-tuning large language models with huggingface transformers and deepspeed Jul 03, 2023
Jupyter Notebook 2 Easily customizable implementation of Transfer Learning with Fine-Tuning using Keras pre-trained CNN models. Apr 21, 2023
Python 2 A primer of transformer models and fine-tuning on language tasks Jan 10, 2022
Python 101 The PyTorch implementation of fine-tuning the GPT-2(Generative Pre-Training 2) for dialogue generation. Sep 05, 2022
Python 80 [CVPR 2020] Adversarial Robustness: From Self-Supervised Pre-Training to Fine-Tuning Jun 29, 2022
Python 1639 Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, quantization, LoRA fine-tuning, … Apr 01, 2023
Python 2 Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, quantization, LoRA fine-tuning, … May 31, 2023
None 2 Implementation of the StableLM/Pythia language models based on nanoGPT. Supports flash attention, Int8 and GPTQ … May 04, 2023
Python 208 Chainer implementation of "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding" Sep 12, 2022
Python 51 official implementation for our paper Cal-QL: Calibrated Offline RL Pre-Training for Efficient Online Fine-Tuning Dec 11, 2023
Python 2 Pre-training of Deep Bidirectional Transformers for Language Understanding Oct 30, 2018
Python 3 A Toolkit for Fine-Tuning Large Language Models with LoRA and DeepSpeed Apr 14, 2023
Python 35 Training LLaMA language model with MMEngine! It supports LoRA fine-tuning! Apr 09, 2023
Python 13 Virtual Data Augmentation: A Robust and General Framework for Fine-tuning Pre-trained Models Aug 06, 2022
Python 953 Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN Aug 03, 2022
Python 9 All-in-one repository for Fine-tuning & Pretraining (Large) Language Models Apr 11, 2023
Python 214 Code for the paper Fine-Tuning Language Models from Human Preferences Aug 12, 2022
Python 7 Trainer and Evaluation scripts for fine-tuning Whisper models for the Ukrainian language Apr 20, 2023
Python 40 use google pre-training model bert to fine-tuning for the chinese multiclass classification Aug 26, 2022
Jupyter Notebook 365 End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service Aug 05, 2022
Python 3 End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service Mar 21, 2022
Python 17 PyTorch code for "FactPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarization" (NAACL 2022) Jun 24, 2022
Python 12 A unified framework for Low-resource Audio Processing and Evaluation (SSL Pre-training and Downstream Fine-tuning) Jun 27, 2023
Python 71 PyTorch implementation of BERT in "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding" Sep 02, 2022
Python 2 Code for ICLR 2022 submission "Differentially Private Fine-tuning of Language Models". Jul 20, 2022
Python 3 Tools and training scripts for large language models Mar 28, 2023
Python 221 Guide for fine-tuning Llama/CodeLlama models Jan 18, 2024
Python 235 An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal … Aug 05, 2022
Python 100 Repo for fine-tuning GPTJ and other GPT models Dec 02, 2022
None 2 Generative Biomedical Entity Linking via Knowledge Base-Guided Pre-training and Synonyms-Aware Fine-tuning[NAACL 2022] Jan 27, 2023
Jupyter Notebook 2 BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding review Jul 21, 2020
Python 1628 Code and model for the paper "Improving Language Understanding by Generative Pre-Training" Aug 10, 2022
Python 2 Code and model for the paper "Improving Language Understanding by Generative Pre-Training" Jan 28, 2023
Jupyter Notebook 28 Implementation of Swin Transformers in TensorFlow along with converted pre-trained models, code for off-the-shelf classification … Sep 06, 2022
Python 17 Pre-training BERT masked language models with custom vocabulary Feb 19, 2023
Python 42 Language Model Fine-tuning for Moby Dick Jun 20, 2022
Python 63 Exploring the Benefits of Training Expert Language Models over Instruction Tuning Mar 31, 2023
Jupyter Notebook 801 PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Aug 11, 2022
Jupyter Notebook 2 PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Aug 21, 2022
Jupyter Notebook 13 PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Jan 26, 2023
Jupyter Notebook 2 PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Dec 27, 2023