LLaMA-DiffFit

Efficient Fine-tuning LLaMA Using DiffFit within 0.7M Parameters

Stars

8

Forks

2

Language

Jupyter Notebook

Last Updated

Jan 09, 2024

Similar Repos
Repo Language Stars Description Updated At
Python 2068 Fine-tuning LLaMA to follow instructions within 1 Hour and 1.2M Parameters Apr 10, 2023
None 2 Fine-tuning LLaMA to follow instructions within 1 Hour and 1.2M Parameters Apr 12, 2023
None 6 Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters Jun 19, 2023
Python 45 llama fine-tuning with lora Jul 18, 2023
None 3 LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA Apr 06, 2023
Python 4 Fine-tuning LLaMA with PEFT (SFT+RLHF) May 28, 2023
Python 221 Guide for fine-tuning Llama/CodeLlama models Jan 18, 2024
Dockerfile 4 fine-tuning LLaMA to generate SCAD to make STLs Apr 20, 2023
Python 8 Minimal implementation of multiple PEFT methods for LLaMA fine-tuning Apr 26, 2023
None 2 Minimal implementation of multiple PEFT methods for LLaMA fine-tuning Apr 20, 2023
Python 35 Training LLaMA language model with MMEngine! It supports LoRA fine-tuning! Apr 09, 2023
Python 164 Fine-tuning LLMs using QLoRA Jan 17, 2024
Python 5 Script for easy parameter efficient fine tuning of LLMs. Mar 12, 2023
Python 8 Official implementation for "Parameter-Efficient Fine-Tuning Design Spaces" Apr 11, 2023
None 3 :control_knobs: Compact GUI for fine-tuning parameters and monitoring value changes Sep 02, 2020
TypeScript 2696 :control_knobs: Compact GUI for fine-tuning parameters and monitoring value changes Apr 27, 2023
None 5 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Apr 11, 2023
Python 3693 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Apr 12, 2023
None 2 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Apr 19, 2023
None 4 Source Code for Parameter-efficient Fine-tuning for Vision Transformers Apr 11, 2023
Python 3 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Jun 11, 2023
Python 2 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Dec 03, 2023
Python 41 Fine-tuning Stable Diffusion using Keras. May 15, 2023
Python 2 Tuning Llama Models > 7b Jun 19, 2023
Python 88 Efficient Training (including pre-training and fine-tuning) for Big Models Aug 12, 2022
Jupyter Notebook 8 Fine-tuning SAM using PASCAL VOC dataset Jul 10, 2023
Python 5 Tools for testing and fine-tuning LLaMA models using LoRA, based on Alpaca-LoRA (https://github.com/tloen/alpaca-lora). Apr 09, 2023
None 2 Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning … Mar 27, 2023
C 17 Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning … Mar 30, 2023
None 2 Open Instruct fine-tuned Llama Mar 23, 2023
None 6 PPT for Fine tuning Dec 24, 2019
Python 120 ChatGLM-6B fine-tuning. Apr 24, 2023
Python 59 chatglm-6b-fine-tuning May 24, 2023
None 6 [NAACL 2022] Domain-Oriented Prefix-Tuning: Towards Efficient and Generalizable Fine-tuning for Zero-Shot Dialogue Summarization Jan 31, 2023
None 3 Instruct-tuning LLaMA on consumer hardware Apr 19, 2023
Jupyter Notebook 10 This repository provides code and resources for Parameter Efficient Fine-Tuning (PEFT), a technique for improving … Oct 13, 2023
Python 24 PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models May 24, 2022
Python 35 LLaMa Tuning with Stanford Alpaca Dataset using Deepspeed and Transformers Apr 07, 2023
PHP 11 Fine tuning WordPress Content Access Oct 02, 2022
Python 87 TorToiSe fine-tuning with DLAS May 03, 2023
Python 2 TorToiSe fine-tuning with DLAS Jul 04, 2023
TypeScript 312 LLM fine-tuning and eval Jan 17, 2024
Python 610 Code for fine-tuning Platypus fam LLMs using LoRA Jan 17, 2024
Python 374 LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models Apr 12, 2023
Python 335 Fine-Tuning your VITS model using a pre-trained model May 10, 2023
Python 2 BERT fine-tuning with Chinese corpus Sep 21, 2021
Jupyter Notebook 4 GPT3 fine tuning from Excel sheet Jan 02, 2023
Python 76 [WIP] Scripts for fine-tuning Whisper Apr 25, 2023
Jupyter Notebook 36 Fine tuning bert for text generation Mar 24, 2022
Jupyter Notebook 448 General fine tuning for Stable Diffusion Apr 27, 2023