LLaMa-EasyFT

A Toolkit for Fine-Tuning Large Language Models with LoRA and DeepSpeed

Stars

10

Forks

0

Language

Python

Last Updated

Sep 26, 2023

Similar Repos
Repo Language Stars Description Updated At
Python 4 Fine-tuning large language models with huggingface transformers and deepspeed Jul 03, 2023
Python 45 llama fine-tuning with lora Jul 18, 2023
Python 9 All-in-one repository for Fine-tuning & Pretraining (Large) Language Models Apr 11, 2023
Python 61 Fine Tuning Language Models for Multilabel Prediction Aug 12, 2022
Jupyter Notebook 2 Simple example of tuning rugpt3 Large with deepspeed May 30, 2022
Python 35 Training LLaMA language model with MMEngine! It supports LoRA fine-tuning! Apr 09, 2023
None 3 LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA Apr 06, 2023
Python 374 LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models Apr 12, 2023
Jupyter Notebook 33 Fine-tuning 6-Billion GPT-J (& other models) with LoRA and 8-bit compression Mar 21, 2023
Python 125 Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques … Jan 08, 2024
Python 5 Tools for testing and fine-tuning LLaMA models using LoRA, based on Alpaca-LoRA (https://github.com/tloen/alpaca-lora). Apr 09, 2023
None 10 Samples for fine-tuning HuggingFace models with AzureML Apr 11, 2023
Python 2 A primer of transformer models and fine-tuning on language tasks Jan 10, 2022
Python 610 Code for fine-tuning Platypus fam LLMs using LoRA Jan 17, 2024
Python 7 Trainer and Evaluation scripts for fine-tuning Whisper models for the Ukrainian language Apr 20, 2023
Python 2 a deepspeed project with large language model trainning Mar 24, 2023
Python 214 Code for the paper Fine-Tuning Language Models from Human Preferences Aug 12, 2022
Python 24 PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models May 24, 2022
None 102 All available datasets for Instruction Tuning of Large Language Models Apr 25, 2023
Python 8 A user toolkit for analyzing and interfacing with Large Language Models (LLMs) Mar 21, 2023
Python 5 A user toolkit for analyzing and interfacing with Large Language Models (LLMs) Mar 22, 2023
Python 40 An API for Chat Fine-Tuned Large Language Models (llm) Jan 07, 2024
Python 176 Advanced fine tuning tools for vision models Apr 21, 2023
Python 221 Guide for fine-tuning Llama/CodeLlama models Jan 18, 2024
Python 2 Code for ICLR 2022 submission "Differentially Private Fine-tuning of Language Models". Jul 20, 2022
Python 100 Repo for fine-tuning GPTJ and other GPT models Dec 02, 2022
Python 3 Official implementations of《Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models》 May 25, 2023
Python 18 Fine-tuning "ImageBind One Embedding Space to Bind Them All" with LoRA May 17, 2023
Python 42 Language Model Fine-tuning for Moby Dick Jun 20, 2022
Python 26 An Implementation of ERNIE For Language Understanding (including Pre-training models and Fine-tuning tools) Oct 18, 2022
Python 13 CSS-LM: Contrastive Semi-supervised Fine-tuning of Pre-trained Language Models Aug 08, 2022
Python 2 A library for fine-tuning, inference and evaluation of GPT-n language models on small datasets. Feb 08, 2023
Python 320 Blazing fast framework for fine-tuning similarity learning models Aug 15, 2022
Python 3728 An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Language Model for … Apr 09, 2023
Python 22 Implementation of "DiffFit: Unlocking Transferability of Large Diffusion Models via Simple Parameter-Efficient Fine-Tuning" May 10, 2023
Python 88 Efficient Training (including pre-training and fine-tuning) for Big Models Aug 12, 2022
Python 9 Code associated with the paper **Fine-tuning Language Models over Slow Networks using Activation Compression with … Mar 15, 2023
Python 26 Shepherd: A lightweight, foundational framework enabling federated instruction tuning for large language models May 10, 2023
Python 17 Abstractive text summarization by fine-tuning seq2seq models. Aug 01, 2022
Python 35 LLaMa Tuning with Stanford Alpaca Dataset using Deepspeed and Transformers Apr 07, 2023
Python 2 Python code for fine-tuning GPT-J on consumer video cards (e.g., RTX 3090) using DeepSpeed Feb 12, 2023
Jupyter Notebook 15 Alpaca-lora for huggingface implementation using Deepspeed and FullyShardedDataParallel Apr 14, 2023
Jupyter Notebook 4 Natural Language Processing with Large Language Models May 10, 2023
Python 87 TorToiSe fine-tuning with DLAS May 03, 2023
Python 2 TorToiSe fine-tuning with DLAS Jul 04, 2023
Python 3 Fine-tuning the GROVER pretrained models for molecular properties prediction. Mar 17, 2022
Python 451 Fast & Simple repository for pre-training and fine-tuning T5-style models Apr 30, 2023
Python 290 Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models" Aug 04, 2022
Python 2 Implementation of LoRA (Low-Rank Adaptation of Large Language Models) for GPT-J and GPT-2 Mar 13, 2023
Jupyter Notebook 35 Includes PyTorch -> Keras model porting code for DeiT models with fine-tuning and inference notebooks. Sep 05, 2022