Cal-QL

official implementation for our paper Cal-QL: Calibrated Offline RL Pre-Training for Efficient Online Fine-Tuning

Stars

51

Forks

1

Language

Python

Last Updated

Dec 11, 2023

Similar Repos
Repo Language Stars Description Updated At
Python 88 Efficient Training (including pre-training and fine-tuning) for Big Models Aug 12, 2022
Jupyter Notebook 2 [WWW '23] The official implmentation of our paper "Fine-tuning Partition-aware Item Similarities for Efficient and … Apr 13, 2023
Python 8 Official implementation for "Parameter-Efficient Fine-Tuning Design Spaces" Apr 11, 2023
Python 173 Chinese GPT2: pre-training and fine-tuning framework for text generation Jul 29, 2022
Python 32 Code for Paper: Calibrated Language Model Fine-Tuning for In- and Out-of-Distribution Data Jul 20, 2022
Python 9 Code for our SIGIR 2022 accepted paper : P3 Ranker: Mitigating the Gaps between Pre-training … May 13, 2022
Python 80 [CVPR 2020] Adversarial Robustness: From Self-Supervised Pre-Training to Fine-Tuning Jun 29, 2022
Python 451 Fast & Simple repository for pre-training and fine-tuning T5-style models Apr 30, 2023
Python 24 PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models May 24, 2022
Python 40 use google pre-training model bert to fine-tuning for the chinese multiclass classification Aug 26, 2022
Jupyter Notebook 58 KDD19 Tutorial: From Shallow to Deep Language Representations: Pre-training, Fine-tuning, and Beyond Mar 14, 2022
Python 6 The official fine-tuning code for DropTrack May 27, 2023
Python 26 An Implementation of ERNIE For Language Understanding (including Pre-training models and Fine-tuning tools) Oct 18, 2022
Python 3 Our old fine-tuning code based on ColossalAI. Mar 06, 2023
Python 4 Official PyTorch code for "Sample Efficient Offline-to-Online Reinforcement Learning" May 31, 2023
Python 5 Script for easy parameter efficient fine tuning of LLMs. Mar 12, 2023
Jupyter Notebook 3 Efficient Fine-tuning LLaMA Using DiffFit within 0.7M Parameters May 03, 2023
Jupyter Notebook 365 End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service Aug 05, 2022
Python 3 End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service Mar 21, 2022
Python 17 PyTorch code for "FactPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarization" (NAACL 2022) Jun 24, 2022
Python 101 The PyTorch implementation of fine-tuning the GPT-2(Generative Pre-Training 2) for dialogue generation. Sep 05, 2022
Python 6 NAACL Paper (IMHO Fine-Tuning Improves Claim Detection) Feb 17, 2021
Python 9 This repository includes the official implementation our paper "In Defense of Image Pre-Training for Spatiotemporal … Jun 15, 2022
None 2 Generative Biomedical Entity Linking via Knowledge Base-Guided Pre-training and Synonyms-Aware Fine-tuning[NAACL 2022] Jan 27, 2023
Python 12 A unified framework for Low-resource Audio Processing and Evaluation (SSL Pre-training and Downstream Fine-tuning) Jun 27, 2023
Python 335 Fine-Tuning your VITS model using a pre-trained model May 10, 2023
Python 25 Official implementation of ORCA proposed in the paper "Cross-Modal Fine-Tuning: Align then Refine" Apr 26, 2023
None 5 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Apr 11, 2023
Python 3693 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Apr 12, 2023
None 2 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Apr 19, 2023
None 4 Source Code for Parameter-efficient Fine-tuning for Vision Transformers Apr 11, 2023
Python 3 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Jun 11, 2023
Python 2 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Dec 03, 2023
Python 7 Fine-tuning GPT-2 to generate research paper abstracts Mar 26, 2023
Python 8 Official Repo for ICLR2022 paper : Should we be Pre-Training ? Exploring End-Task Aware Training … Feb 21, 2023
Python 8 The ability of GPT-2 to create abstractive summaries with fine-tuning using only keywords, without pre-training. Jan 04, 2022
Python 2 Pytorch implementation of our paper -- Fine-grained Data Distribution Alignment for Post-Training Quantization Apr 27, 2022
Python 20 This repository is the official implementation of our paper MVP: Multi-task Supervised Pre-training for Natural … Aug 02, 2022
TeX 9 ICML'20 paper "Confidence-Calibrated Adversarial Training: Generalizing to Unseen Attacks". Mar 15, 2022
Python 35 Training LLaMA language model with MMEngine! It supports LoRA fine-tuning! Apr 09, 2023
Python 85 [CVPR 2023] Official repository of paper titled "Fine-tuned CLIP models are efficient video learners". Apr 29, 2023
Python 13 CSS-LM: Contrastive Semi-supervised Fine-tuning of Pre-trained Language Models Aug 08, 2022
Jupyter Notebook 2 Notebooks for teaching transformers and fine-tuning a pre-trained BERT model May 19, 2023
None 2 Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning … Mar 27, 2023
C 17 Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning … Mar 30, 2023
Python 164 For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987). Sep 12, 2022
Jupyter Notebook 280 The code to reproduce results from paper "MultiFiT: Efficient Multi-lingual Language Model Fine-tuning" https://arxiv.org/abs/1909.04761 Sep 22, 2022
None 2 The code to reproduce results from paper "MultiFiT: Efficient Multi-lingual Language Model Fine-tuning" https://arxiv.org/abs/1909.04761 Mar 04, 2023
Python 214 Code for the paper Fine-Tuning Language Models from Human Preferences Aug 12, 2022
None 6 [NAACL 2022] Domain-Oriented Prefix-Tuning: Towards Efficient and Generalizable Fine-tuning for Zero-Shot Dialogue Summarization Jan 31, 2023