llm-finetuning

Guide for fine-tuning Llama/Mistral/CodeLlama models and more

Stars

365

Forks

55

Language

Python

Last Updated

May 09, 2024

Similar Repos
Repo Language Stars Description Updated At
Python 45 llama fine-tuning with lora Jul 18, 2023
None 3 LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA Apr 06, 2023
Python 2 Tuning Llama Models > 7b Jun 19, 2023
Python 4 Fine-tuning LLaMA with PEFT (SFT+RLHF) May 28, 2023
Python 8 Minimal implementation of multiple PEFT methods for LLaMA fine-tuning Apr 26, 2023
None 2 Minimal implementation of multiple PEFT methods for LLaMA fine-tuning Apr 20, 2023
Dockerfile 4 fine-tuning LLaMA to generate SCAD to make STLs Apr 20, 2023
Jupyter Notebook 3 Efficient Fine-tuning LLaMA Using DiffFit within 0.7M Parameters May 03, 2023
Python 61 Fine Tuning Language Models for Multilabel Prediction Aug 12, 2022
Python 176 Advanced fine tuning tools for vision models Apr 21, 2023
None 10 Samples for fine-tuning HuggingFace models with AzureML Apr 11, 2023
Python 35 Training LLaMA language model with MMEngine! It supports LoRA fine-tuning! Apr 09, 2023
Python 5 Tools for testing and fine-tuning LLaMA models using LoRA, based on Alpaca-LoRA (https://github.com/tloen/alpaca-lora). Apr 09, 2023
Python 320 Blazing fast framework for fine-tuning similarity learning models Aug 15, 2022
Python 100 Repo for fine-tuning GPTJ and other GPT models Dec 02, 2022
Python 37 Instruct LLMs for flat and nested NER. Fine-tuning Llama and Mistral models for instruction named … Feb 26, 2024
Python 2068 Fine-tuning LLaMA to follow instructions within 1 Hour and 1.2M Parameters Apr 10, 2023
None 2 Fine-tuning LLaMA to follow instructions within 1 Hour and 1.2M Parameters Apr 12, 2023
None 6 Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters Jun 19, 2023
Python 17 Abstractive text summarization by fine-tuning seq2seq models. Aug 01, 2022
Python 3 Fine-tuning the GROVER pretrained models for molecular properties prediction. Mar 17, 2022
Jupyter Notebook 2 A notebook with full guide to fine tuning gpt3. Code for creating the dataset and … Feb 04, 2023
None 6 PPT for Fine tuning Dec 24, 2019
Python 77 Easiest way of fine-tuning HuggingFace video classification models Apr 25, 2023
Python 9 All-in-one repository for Fine-tuning & Pretraining (Large) Language Models Apr 11, 2023
Python 15 Fine-tuning scripts for evaluating transformer-based models on KLEJ benchmark. Aug 12, 2022
Python 88 Efficient Training (including pre-training and fine-tuning) for Big Models Aug 12, 2022
Python 214 Code for the paper Fine-Tuning Language Models from Human Preferences Aug 12, 2022
Jupyter Notebook 11 Fine-tuning HuggingFace Transformer Question-Answering Models On Custom Data May 17, 2023
Python 4 Fine-tuning large language models with huggingface transformers and deepspeed Jul 03, 2023
Python 3 A Toolkit for Fine-Tuning Large Language Models with LoRA and DeepSpeed Apr 14, 2023
Python 451 Fast & Simple repository for pre-training and fine-tuning T5-style models Apr 30, 2023
Python 2 Code for ICLR 2022 submission "Differentially Private Fine-tuning of Language Models". Jul 20, 2022
Python 3 an easy way to create JSONL files for fine-tuning openai models. Jan 04, 2024
None 2 Open Instruct fine-tuned Llama Mar 23, 2023
Python 120 ChatGLM-6B fine-tuning. Apr 24, 2023
Python 59 chatglm-6b-fine-tuning May 24, 2023
Python 7 Trainer and Evaluation scripts for fine-tuning Whisper models for the Ukrainian language Apr 20, 2023
Python 2 A primer of transformer models and fine-tuning on language tasks Jan 10, 2022
Python 76 [WIP] Scripts for fine-tuning Whisper Apr 25, 2023
Jupyter Notebook 36 Fine tuning bert for text generation Mar 24, 2022
Jupyter Notebook 448 General fine tuning for Stable Diffusion Apr 27, 2023
Jupyter Notebook 2 Fine-tuning BETO for emoji-prediction Dec 30, 2022
Python 10 Implementations of models and metrics for semantic text similarity. Includes fine-tuning and prediction of models Oct 21, 2021
None 2 Repository for fine-tuning Transformers 🤗 based seq2seq speech models in JAX/Flax. Jan 18, 2023
Python 2 Demo of fine-tuning QA models for answering FAQ of cloud providers documentation Mar 02, 2023
Jupyter Notebook 15 Repository for fine-tuning Transformers 🤗 based seq2seq speech models in JAX/Flax. Jun 05, 2022
Python 24 PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models May 24, 2022
None 3 Instruct-tuning LLaMA on consumer hardware Apr 19, 2023
Python 13 CSS-LM: Contrastive Semi-supervised Fine-tuning of Pre-trained Language Models Aug 08, 2022