ELM

[ICML 2023] Exploring the Benefits of Training Expert Language Models over Instruction Tuning

Stars

93

Forks

6

Language

Python

Last Updated

Dec 20, 2023

Similar Repos
Repo Language Stars Description Updated At
None 102 All available datasets for Instruction Tuning of Large Language Models Apr 25, 2023
Jupyter Notebook 14 A framework for creating grounded instruction based datasets and training conversational domain expert Large Language … May 10, 2023
Python 109 📚 Datasets and models for instruction-tuning Apr 27, 2023
Python 55 Language modeling and instruction tuning for Russian Apr 25, 2023
Python 3 Official implementations of《Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models》 May 25, 2023
Python 26 Shepherd: A lightweight, foundational framework enabling federated instruction tuning for large language models May 10, 2023
C++ 6 Training Hybrid Language Models by Marginalizing over Segmentation Apr 22, 2022
Python 215 Simplify the training and tuning of Tensorflow models Sep 15, 2022
Jupyter Notebook 41 Ukrainian instruction-tuned language models and datasets Apr 09, 2023
Python 88 Efficient Training (including pre-training and fine-tuning) for Big Models Aug 12, 2022
Python 96 A curated list of awesome instruction tuning datasets, models, papers and repositories. Apr 25, 2023
None 135 Instruction Tuning Dataset and Models for Long Text Generation with Corpus Extraction May 23, 2023
Python 61 Fine Tuning Language Models for Multilabel Prediction Aug 12, 2022
Python 9 Code associated with the paper **Fine-tuning Language Models over Slow Networks using Activation Compression with … Mar 15, 2023
Python 26 An Implementation of ERNIE For Language Understanding (including Pre-training models and Fine-tuning tools) Oct 18, 2022
Python 113 This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned … Mar 30, 2023
Python 214 Code for the paper Fine-Tuning Language Models from Human Preferences Aug 12, 2022
Java 5 Exercises for the Android Expert training Apr 20, 2018
Python 37 Instruct LLMs for flat and nested NER. Fine-tuning Llama and Mistral models for instruction named … Feb 26, 2024
Python 49 Exploring large language models for knowledge graph completion Jan 12, 2024
None 112 Collection of papers and resources on Reasoning in Large Language Models (LLMs), including Chain-of-Thought (CoT), … Mar 29, 2023
Python 22 Task Residual for Tuning Vision-Language Models (CVPR 2023) Apr 17, 2023
Jupyter Notebook 10 Staged Training for Transformer Language Models Jul 21, 2022
Python 2 Components for training large language models Nov 22, 2022
Emacs Lisp 18 A simple Emacs package for calling instruction-following language models Jan 20, 2023
Python 2074 Aligning pretrained language models with instruction data generated by themselves. May 03, 2023
Python 2 Exploring chemical composition space with n-gram language models Mar 26, 2022
Python 129 [Arxiv2022] All in One: Exploring Unified Video-Language Pre-training May 27, 2022
Python 4 Fine-tuning large language models with huggingface transformers and deepspeed Jul 03, 2023
Python 35 Training LLaMA language model with MMEngine! It supports LoRA fine-tuning! Apr 09, 2023
Python 451 Fast & Simple repository for pre-training and fine-tuning T5-style models Apr 30, 2023
Python 39 Training language models to make programs faster Apr 27, 2023
Python 135 Exploring the Potential of Large Language Models (LLMs) in Learning on Graphs Jan 19, 2024
Python 7 Trainer and Evaluation scripts for fine-tuning Whisper models for the Ukrainian language Apr 20, 2023
Python 2 A primer of transformer models and fine-tuning on language tasks Jan 10, 2022
Python 9 All-in-one repository for Fine-tuning & Pretraining (Large) Language Models Apr 11, 2023
Python 34 Demo code exploring Python's memory models and collection algorithms from the Talk Python Training course. Aug 30, 2022
Python 37 AfriBERTa: Exploring the Viability of Pretrained Multilingual Language Models for Low-resourced Languages Aug 26, 2022
Python 10 A platform to automate the training (including hyper-parameter tuning) and inference of machine learning models Dec 07, 2021
Python 3 Tools and training scripts for large language models Mar 28, 2023
Python 13 Tools for training causal language models for Finnish Jun 22, 2023
Python 3 Some code for evaluation and a leaderboard of instruction following language models Jun 19, 2023
Python 13 CSS-LM: Contrastive Semi-supervised Fine-tuning of Pre-trained Language Models Aug 08, 2022
None 2103 Must-read papers on prompt-based tuning for pre-trained language models. Aug 12, 2022
Python 3 A Toolkit for Fine-Tuning Large Language Models with LoRA and DeepSpeed Apr 14, 2023
Python 2 Code for ICLR 2022 submission "Differentially Private Fine-tuning of Language Models". Jul 20, 2022
Shell 44 Official implementation of the paper "CoEdIT: Text Editing by Task-Specific Instruction Tuning" Oct 10, 2023
Python 17 Pre-training BERT masked language models with custom vocabulary Feb 19, 2023
Shell 3 Scripts for training command+english language models for Silvius May 23, 2020
Python 9 A lesson exploring the Julia language Aug 17, 2022