Differentially-Private-Fine-tuning-of-Language-Models

Code for ICLR 2022 submission "Differentially Private Fine-tuning of Language Models".

Stars

2

Forks

0

Language

Python

Last Updated

Jul 20, 2022

Similar Repos
Repo Language Stars Description Updated At
Python 61 Fine Tuning Language Models for Multilabel Prediction Aug 12, 2022
Python 214 Code for the paper Fine-Tuning Language Models from Human Preferences Aug 12, 2022
None 5 Differentially Private Diffusion Models Oct 19, 2022
Python 250 Code for the ALiBi method for transformer language models (ICLR 2022) May 05, 2023
Python 9 All-in-one repository for Fine-tuning & Pretraining (Large) Language Models Apr 11, 2023
Python 4 Fine-tuning large language models with huggingface transformers and deepspeed Jul 03, 2023
Python 11 General Fine-Tuning: A little language for Deep Nets (ACL-2022 Tutorial) Apr 21, 2023
Python 176 Advanced fine tuning tools for vision models Apr 21, 2023
Python 221 Guide for fine-tuning Llama/CodeLlama models Jan 18, 2024
Python 59 [ICLR 2022] Towards Continual Knowledge Learning of Language Models Sep 01, 2022
Python 3 A Toolkit for Fine-Tuning Large Language Models with LoRA and DeepSpeed Apr 14, 2023
Python 2 A primer of transformer models and fine-tuning on language tasks Jan 10, 2022
Python 7 Trainer and Evaluation scripts for fine-tuning Whisper models for the Ukrainian language Apr 20, 2023
Python 2 Code for differentially private Flajolet-Martin sketch. Mar 20, 2022
Python 42 Language Model Fine-tuning for Moby Dick Jun 20, 2022
Python 24 PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models May 24, 2022
None 10 Samples for fine-tuning HuggingFace models with AzureML Apr 11, 2023
Python 13 CSS-LM: Contrastive Semi-supervised Fine-tuning of Pre-trained Language Models Aug 08, 2022
Python 161 [ICLR 2022 spotlight]GreaseLM: Graph REASoning Enhanced Language Models for Question Answering Apr 24, 2023
Python 374 LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models Apr 12, 2023
Python 19 Implementation for Variational Information Bottleneck for Effective Low-resource Fine-tuning, ICLR 2021 Sep 09, 2022
Python 320 Blazing fast framework for fine-tuning similarity learning models Aug 15, 2022
Python 100 Repo for fine-tuning GPTJ and other GPT models Dec 02, 2022
Python 9 Code associated with the paper **Fine-tuning Language Models over Slow Networks using Activation Compression with … Mar 15, 2023
Python 6 The official fine-tuning code for DropTrack May 27, 2023
Python 17 Abstractive text summarization by fine-tuning seq2seq models. Aug 01, 2022
Python 2 [CVPR-W 2022] Alleviating Representational Shift for Continual Fine-tuning Mar 08, 2023
Python 26 An Implementation of ERNIE For Language Understanding (including Pre-training models and Fine-tuning tools) Oct 18, 2022
C 4 Code for differentially private Implicit Maximum Likelihood Estimation model Mar 25, 2022
Python 4 COINSTAC code for Differentially Private Support Vector Machines (dpSVM) Feb 17, 2022
None 328 Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and … May 19, 2023
None 4 Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and … May 19, 2023
None 2 Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and … Jun 24, 2023
Python 3 Fine-tuning the GROVER pretrained models for molecular properties prediction. Mar 17, 2022
Jupyter Notebook 10 This repository provides code and resources for Parameter Efficient Fine-Tuning (PEFT), a technique for improving … Oct 13, 2023
None 6 PPT for Fine tuning Dec 24, 2019
Python 77 Easiest way of fine-tuning HuggingFace video classification models Apr 25, 2023
Python 2 A library for fine-tuning, inference and evaluation of GPT-n language models on small datasets. Feb 08, 2023
Python 17 PyTorch code for "FactPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarization" (NAACL 2022) Jun 24, 2022
Python 3 Codes for differentially-private distributed PCA Oct 03, 2022
Jupyter Notebook 35 Includes PyTorch -> Keras model porting code for DeiT models with fine-tuning and inference notebooks. Sep 05, 2022
Python 15 Fine-tuning scripts for evaluating transformer-based models on KLEJ benchmark. Aug 12, 2022
Python 88 Efficient Training (including pre-training and fine-tuning) for Big Models Aug 12, 2022
Python 32 Code for Paper: Calibrated Language Model Fine-Tuning for In- and Out-of-Distribution Data Jul 20, 2022
Python 59 Source code of paper "Differentially Private Generative Adversarial Network" Apr 20, 2023
Python 179 [ICLR 2023] Code for the paper "Binding Language Models in Symbolic Languages" Apr 26, 2023
Python 2 Code for fine-tuning GPT-J LoRAs in 4bit Apr 09, 2023
Python 610 Code for fine-tuning Platypus fam LLMs using LoRA Jan 17, 2024
Jupyter Notebook 11 Fine-tuning HuggingFace Transformer Question-Answering Models On Custom Data May 17, 2023
Python 571 ACL'2021: LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723 Oct 17, 2022