llmft

Fine-tuning large language models with huggingface transformers and deepspeed

Stars

14

Forks

7

Language

Python

Last Updated

Dec 11, 2023

Similar Repos
Repo Language Stars Description Updated At
Python 3 A Toolkit for Fine-Tuning Large Language Models with LoRA and DeepSpeed Apr 14, 2023
None 10 Samples for fine-tuning HuggingFace models with AzureML Apr 11, 2023
Jupyter Notebook 3 Fine-tuning Transformers from HuggingFace for financials news sentiment Aug 30, 2023
Python 77 Easiest way of fine-tuning HuggingFace video classification models Apr 25, 2023
Python 3 Fine Tune GPT-NEO (2.7B and 1.3B Parameters) on a single GPU with Huggingface Transformers using … Mar 04, 2022
Python 9 All-in-one repository for Fine-tuning & Pretraining (Large) Language Models Apr 11, 2023
Python 35 LLaMa Tuning with Stanford Alpaca Dataset using Deepspeed and Transformers Apr 07, 2023
Jupyter Notebook 11 Fine-tuning HuggingFace Transformer Question-Answering Models On Custom Data May 17, 2023
Jupyter Notebook 2 Simple example of tuning rugpt3 Large with deepspeed May 30, 2022
Python 61 Fine Tuning Language Models for Multilabel Prediction Aug 12, 2022
Python 374 LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models Apr 12, 2023
Python 125 Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques … Jan 08, 2024
Python 2 Uncertainty-aware fine-tuning of transformers with NLI data. Jul 06, 2023
Python 2 A primer of transformer models and fine-tuning on language tasks Jan 10, 2022
Python 2 a deepspeed project with large language model trainning Mar 24, 2023
None 2 Repository for fine-tuning Transformers 🤗 based seq2seq speech models in JAX/Flax. Jan 18, 2023
Jupyter Notebook 15 Repository for fine-tuning Transformers 🤗 based seq2seq speech models in JAX/Flax. Jun 05, 2022
Python 11 Fine-tuning Vision Transformers on various classification datasets Apr 29, 2023
Python 214 Code for the paper Fine-Tuning Language Models from Human Preferences Aug 12, 2022
Python 7 Trainer and Evaluation scripts for fine-tuning Whisper models for the Ukrainian language Apr 20, 2023
Python 24 PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models May 24, 2022
Python 23 Biomedical Data-to-Text Generation via Fine-Tuning Transformers Mar 28, 2023
Jupyter Notebook 3 Fine tuning Donut transformers for UI Referring Expressions task Mar 02, 2023
None 102 All available datasets for Instruction Tuning of Large Language Models Apr 25, 2023
Jupyter Notebook 5 Benchmarking the trade-offs between cost, train time, and performance for fine-tuning HuggingFace models with distributed … Apr 28, 2022
Python 3 Cod cyd fynd a wythnos mireinio XLSR Facebook gyda HuggingFace ar gyfer y Gymraeg / … Jan 27, 2023
Python 40 An API for Chat Fine-Tuned Large Language Models (llm) Jan 07, 2024
Python 13 CSS-LM: Contrastive Semi-supervised Fine-tuning of Pre-trained Language Models Aug 08, 2022
Python 2 Code for ICLR 2022 submission "Differentially Private Fine-tuning of Language Models". Jul 20, 2022
None 5 Large Language Models (LLMs) and Generative Pre-trained Transformers (GPTs) for Legal Mar 27, 2023
Python 12 A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem. Jul 04, 2023
Python 176 Advanced fine tuning tools for vision models Apr 21, 2023
Python 221 Guide for fine-tuning Llama/CodeLlama models Jan 18, 2024
Python 100 Repo for fine-tuning GPTJ and other GPT models Dec 02, 2022
None 4 Source Code for Parameter-efficient Fine-tuning for Vision Transformers Apr 11, 2023
Jupyter Notebook 2 Notebooks for teaching transformers and fine-tuning a pre-trained BERT model May 19, 2023
Python 3 Official implementations of《Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models》 May 25, 2023
Python 3 Fine-tuning and zero-shot learning with transformers to automatically tag my study blog posts Aug 21, 2022
Jupyter Notebook 28 Implementation of Swin Transformers in TensorFlow along with converted pre-trained models, code for off-the-shelf classification … Sep 06, 2022
Python 42 Language Model Fine-tuning for Moby Dick Jun 20, 2022
Python 22 Implementation of "DiffFit: Unlocking Transferability of Large Diffusion Models via Simple Parameter-Efficient Fine-Tuning" May 10, 2023
Python 26 An Implementation of ERNIE For Language Understanding (including Pre-training models and Fine-tuning tools) Oct 18, 2022
Python 9 Code associated with the paper **Fine-tuning Language Models over Slow Networks using Activation Compression with … Mar 15, 2023
Python 17 Abstractive text summarization by fine-tuning seq2seq models. Aug 01, 2022
Jupyter Notebook 15 Alpaca-lora for huggingface implementation using Deepspeed and FullyShardedDataParallel Apr 14, 2023
Python 3 Training Large-scale Text Embedding Models with 🤗 Transformers Aug 26, 2023
Jupyter Notebook 4 Natural Language Processing with Large Language Models May 10, 2023
Python 87 TorToiSe fine-tuning with DLAS May 03, 2023
Python 2 TorToiSe fine-tuning with DLAS Jul 04, 2023
Python 45 llama fine-tuning with lora Jul 18, 2023