FLM

All-in-one repository for Fine-tuning & Pretraining (Large) Language Models

Stars

15

Forks

0

Language

Python

Last Updated

Nov 04, 2023

Similar Repos
Repo Language Stars Description Updated At
Python 4 Fine-tuning large language models with huggingface transformers and deepspeed Jul 03, 2023
Python 3 A Toolkit for Fine-Tuning Large Language Models with LoRA and DeepSpeed Apr 14, 2023
Python 61 Fine Tuning Language Models for Multilabel Prediction Aug 12, 2022
None 102 All available datasets for Instruction Tuning of Large Language Models Apr 25, 2023
Python 374 LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models Apr 12, 2023
Jupyter Notebook 19 Pretraining, fine-tuning and evaluation scripts for Indic-Wav2Vec2 Aug 04, 2022
Python 8 Pretraining, fine-tuning and evaluation scripts for IndicBERT and IndicXTREME Mar 06, 2023
Python 214 Code for the paper Fine-Tuning Language Models from Human Preferences Aug 12, 2022
Python 125 Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques … Jan 08, 2024
Python 40 An API for Chat Fine-Tuned Large Language Models (llm) Jan 07, 2024
Python 176 Advanced fine tuning tools for vision models Apr 21, 2023
Python 221 Guide for fine-tuning Llama/CodeLlama models Jan 18, 2024
Python 2 Code for ICLR 2022 submission "Differentially Private Fine-tuning of Language Models". Jul 20, 2022
Python 2 A primer of transformer models and fine-tuning on language tasks Jan 10, 2022
Python 7 Trainer and Evaluation scripts for fine-tuning Whisper models for the Ukrainian language Apr 20, 2023
Python 42 Language Model Fine-tuning for Moby Dick Jun 20, 2022
Python 451 Fast & Simple repository for pre-training and fine-tuning T5-style models Apr 30, 2023
Python 24 PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models May 24, 2022
None 10 Samples for fine-tuning HuggingFace models with AzureML Apr 11, 2023
Python 13 CSS-LM: Contrastive Semi-supervised Fine-tuning of Pre-trained Language Models Aug 08, 2022
Python 27 This is the repository for the paper titled "Don’t Stop Pretraining? Make Prompt-based Fine-tuning Powerful … May 14, 2023
None 2 Repository for fine-tuning Transformers 🤗 based seq2seq speech models in JAX/Flax. Jan 18, 2023
Jupyter Notebook 15 Repository for fine-tuning Transformers 🤗 based seq2seq speech models in JAX/Flax. Jun 05, 2022
Python 18 Fine-tuning "ImageBind One Embedding Space to Bind Them All" with LoRA May 17, 2023
Python 320 Blazing fast framework for fine-tuning similarity learning models Aug 15, 2022
Python 100 Repo for fine-tuning GPTJ and other GPT models Dec 02, 2022
Python 22 Implementation of "DiffFit: Unlocking Transferability of Large Diffusion Models via Simple Parameter-Efficient Fine-Tuning" May 10, 2023
Python 3 Official implementations of《Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models》 May 25, 2023
Python 27 one script for xls-r/xlsr/whisper fine-tuning Apr 19, 2023
Python 26 Shepherd: A lightweight, foundational framework enabling federated instruction tuning for large language models May 10, 2023
Python 17 Abstractive text summarization by fine-tuning seq2seq models. Aug 01, 2022
Python 26 An Implementation of ERNIE For Language Understanding (including Pre-training models and Fine-tuning tools) Oct 18, 2022
Jupyter Notebook 10 This repository provides code and resources for Parameter Efficient Fine-Tuning (PEFT), a technique for improving … Oct 13, 2023
Python 3 Fine-tuning the GROVER pretrained models for molecular properties prediction. Mar 17, 2022
None 6 PPT for Fine tuning Dec 24, 2019
Python 77 Easiest way of fine-tuning HuggingFace video classification models Apr 25, 2023
Python 2 A library for fine-tuning, inference and evaluation of GPT-n language models on small datasets. Feb 08, 2023
Python 1687 Large-scale pretraining for dialogue Aug 07, 2022
None 2 Large Language Models for Production Jun 13, 2023
Python 15 Fine-tuning scripts for evaluating transformer-based models on KLEJ benchmark. Aug 12, 2022
Python 88 Efficient Training (including pre-training and fine-tuning) for Big Models Aug 12, 2022
Jupyter Notebook 11 Fine-tuning HuggingFace Transformer Question-Answering Models On Custom Data May 17, 2023
Python 3 logical large language models Apr 01, 2023
None 103 Understanding large language models Apr 22, 2023
Python 51 Benchmarking Large Language Models Jan 18, 2024
Python 54 Large language Models (LLM) Jan 17, 2024
Python 571 ACL'2021: LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723 Oct 17, 2022
None 3 Repository for a course on building applications for large language models. Feb 22, 2023
Jupyter Notebook 19 Supplementary material for "Understanding Parameter-Efficient Finetuning of Large Language Models: From Prefix Tuning to Adapters" Apr 21, 2023
Python 3 an easy way to create JSONL files for fine-tuning openai models. Jan 04, 2024