LLM-Adapters

Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"

Stars

940

Forks

81

Language

Python

Last Updated

Apr 25, 2024

Similar Repos
Repo Language Stars Description Updated At
Jupyter Notebook 19 Supplementary material for "Understanding Parameter-Efficient Finetuning of Large Language Models: From Prefix Tuning to Adapters" Apr 21, 2023
Python 22 Implementation of "DiffFit: Unlocking Transferability of Large Diffusion Models via Simple Parameter-Efficient Fine-Tuning" May 10, 2023
Python 40 An API for Chat Fine-Tuned Large Language Models (llm) Jan 07, 2024
Python 46 Collection of Tools and Papers related to Adapters (aka Parameter-Efficient Transfer Learning/ Fine-Tuning) Apr 25, 2023
Python 5 Script for easy parameter efficient fine tuning of LLMs. Mar 12, 2023
Python 8 Official implementation for "Parameter-Efficient Fine-Tuning Design Spaces" Apr 11, 2023
Python 4 Fine-tuning large language models with huggingface transformers and deepspeed Jul 03, 2023
Python 9 All-in-one repository for Fine-tuning & Pretraining (Large) Language Models Apr 11, 2023
None 4 Source Code for Parameter-efficient Fine-tuning for Vision Transformers Apr 11, 2023
Python 54 Large language Models (LLM) Jan 17, 2024
Python 33 This is the implementation of the paper AdaMix: Mixture-of-Adapter for Parameter-efficient Tuning of Large Language … Jul 12, 2022
Python 3 A Toolkit for Fine-Tuning Large Language Models with LoRA and DeepSpeed Apr 14, 2023
Python 61 Fine Tuning Language Models for Multilabel Prediction Aug 12, 2022
None 5 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Apr 11, 2023
Python 3693 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Apr 12, 2023
None 2 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Apr 19, 2023
Python 3 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Jun 11, 2023
Python 2 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Dec 03, 2023
Python 24 PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models May 24, 2022
TypeScript 312 LLM fine-tuning and eval Jan 17, 2024
Jupyter Notebook 10 This repository provides code and resources for Parameter Efficient Fine-Tuning (PEFT), a technique for improving … Oct 13, 2023
Jupyter Notebook 2 Fine-tuning an LLM for sentiment analysis Nov 29, 2023
Python 3 Official implementations of《Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models》 May 25, 2023
Jupyter Notebook 2 Recommender System with Large Language Models (LLM) Oct 08, 2023
Python 118 PB-LLM: Partially Binarized Large Language Models Jan 18, 2024
Python 88 Efficient Training (including pre-training and fine-tuning) for Big Models Aug 12, 2022
Python 146 Fine-tuning LLM on my Telegram chats Jan 18, 2024
Python 7 Pytorch implementation of INTEGRATED PARAMETER-EFFICIENT TUNING FOR GENERAL-PURPOSE AUDIO MODELS Mar 30, 2023
None 446 Efficient Large Language Models: A Survey Jan 19, 2024
Python 111 Provide efficient LLM LoRA fine tune Jan 18, 2024
Python 214 Code for the paper Fine-Tuning Language Models from Human Preferences Aug 12, 2022
None 35 A curated list for Efficient Large Language Models May 27, 2023
Python 297 A plug-and-play library for parameter-efficient-tuning (Delta Tuning) Aug 15, 2022
None 2 Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning … Mar 27, 2023
C 17 Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning … Mar 30, 2023
Python 125 Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques … Jan 08, 2024
None 102 All available datasets for Instruction Tuning of Large Language Models Apr 25, 2023
Python 176 Advanced fine tuning tools for vision models Apr 21, 2023
Python 221 Guide for fine-tuning Llama/CodeLlama models Jan 18, 2024
Python 2 Code for ICLR 2022 submission "Differentially Private Fine-tuning of Language Models". Jul 20, 2022
Jupyter Notebook 226 Implementation of "SVDiff: Compact Parameter Space for Diffusion Fine-Tuning" May 10, 2023
Python 2 A primer of transformer models and fine-tuning on language tasks Jan 10, 2022
None 49 Must-read Papers of Parameter Efficient Methods on Pre-trained Models (Delta Tuning). Aug 15, 2022
Python 7 Trainer and Evaluation scripts for fine-tuning Whisper models for the Ukrainian language Apr 20, 2023
Python 12 LLM-Pruner: On the Structural Pruning of Large Language Models May 20, 2023
Python 42 Language Model Fine-tuning for Moby Dick Jun 20, 2022
None 3 Efficient Hyper-parameter Tuning at Scale (VLDB'22) May 23, 2022
None 10 Samples for fine-tuning HuggingFace models with AzureML Apr 11, 2023
Python 13 CSS-LM: Contrastive Semi-supervised Fine-tuning of Pre-trained Language Models Aug 08, 2022
Python 606 Code for 3D-LLM: Injecting the 3D World into Large Language Models Jan 18, 2024