my_pefty_llama

Minimal implementation of multiple PEFT methods for LLaMA fine-tuning

Stars

13

Forks

2

Language

Python

Last Updated

Dec 01, 2023

Similar Repos
Repo Language Stars Description Updated At
None 2 Minimal implementation of multiple PEFT methods for LLaMA fine-tuning Apr 20, 2023
Python 4 Fine-tuning LLaMA with PEFT (SFT+RLHF) May 28, 2023
Python 45 llama fine-tuning with lora Jul 18, 2023
Python 221 Guide for fine-tuning Llama/CodeLlama models Jan 18, 2024
None 3 LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA Apr 06, 2023
None 5 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Apr 11, 2023
Python 3693 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Apr 12, 2023
None 2 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Apr 19, 2023
Python 3 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Jun 11, 2023
Python 2 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. Dec 03, 2023
Python 326 Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调 Apr 24, 2023
None 2 Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调 Jun 09, 2023
Python 2 Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调 Jun 27, 2023
Python 12 ChatGLM-Peft-Tuning Apr 04, 2023
Dockerfile 4 fine-tuning LLaMA to generate SCAD to make STLs Apr 20, 2023
Jupyter Notebook 3 Efficient Fine-tuning LLaMA Using DiffFit within 0.7M Parameters May 03, 2023
Jupyter Notebook 10 This repository provides code and resources for Parameter Efficient Fine-Tuning (PEFT), a technique for improving … Oct 13, 2023
Python 35 Training LLaMA language model with MMEngine! It supports LoRA fine-tuning! Apr 09, 2023
Python 11 Tune LLaMa-7B on Alpaca Dataset using PEFT / LORA Based on @zphang's https://github.com/zphang/minimal-llama scripts. Apr 07, 2023
Python 2068 Fine-tuning LLaMA to follow instructions within 1 Hour and 1.2M Parameters Apr 10, 2023
None 2 Fine-tuning LLaMA to follow instructions within 1 Hour and 1.2M Parameters Apr 12, 2023
None 6 Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters Jun 19, 2023
None 6 PPT for Fine tuning Dec 24, 2019
Python 2 Tuning Llama Models > 7b Jun 19, 2023
Python 8 Official implementation for "Parameter-Efficient Fine-Tuning Design Spaces" Apr 11, 2023
Python 23 Whisper fine-tuning event script to use multiple hf datasets Apr 22, 2023
Python 13 TensorFlow 2 implementation of GTP2, with examples for fine tuning Feb 21, 2023
Python 9 A PyTorch implementation for fine-tuning AlexNet on Office dataset Sep 10, 2022
Jupyter Notebook 226 Implementation of "SVDiff: Compact Parameter Space for Diffusion Fine-Tuning" May 10, 2023
None 2 Open Instruct fine-tuned Llama Mar 23, 2023
Python 120 ChatGLM-6B fine-tuning. Apr 24, 2023
Python 59 chatglm-6b-fine-tuning May 24, 2023
None 51 For use with fine-tuning, especially the current implementation of "Dreambooth". Dec 02, 2022
None 8 For use with fine-tuning, especially the current implementation of "Dreambooth". Oct 15, 2022
Python 2 TensorFlow 2 implementation of GPT-2, with examples for fine tuning Nov 14, 2023
Python 1639 Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, quantization, LoRA fine-tuning, … Apr 01, 2023
Python 2 Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, quantization, LoRA fine-tuning, … May 31, 2023
Python 76 [WIP] Scripts for fine-tuning Whisper Apr 25, 2023
Jupyter Notebook 36 Fine tuning bert for text generation Mar 24, 2022
Jupyter Notebook 448 General fine tuning for Stable Diffusion Apr 27, 2023
Jupyter Notebook 2 Fine-tuning BETO for emoji-prediction Dec 30, 2022
Python 285 LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA) Jan 19, 2024
Python 74 Simple implementation of using lora form the peft library to fine-tune the chatglm-6b Apr 20, 2023
None 3 Instruct-tuning LLaMA on consumer hardware Apr 19, 2023
Python 6 Implementation on tensorflow fine tuning of generic CNN based model Jun 29, 2019
R 41 Tuning Methods for mlr3 Jul 21, 2022
Python 43 Pytorch Implementation of EncT5: Fine-tuning T5 Encoder for Non-autoregressive Tasks Apr 18, 2023
PHP 11 Fine tuning WordPress Content Access Oct 02, 2022
Python 87 TorToiSe fine-tuning with DLAS May 03, 2023
Python 2 TorToiSe fine-tuning with DLAS Jul 04, 2023