LLM-Pruner

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support LLaMA, Llama-2, BLOOM, Vicuna, Baichuan, etc.

Stars

668

Forks

69

Language

Python

Last Updated

May 08, 2024

Similar Repos

Repo	Language	Stars	Description	Updated At
Large-Language-Models	Python	54	Large language Models (LLM)	Jan 17, 2024
Diff-Pruning	Python	24	Structural Pruning for Diffusion Models	May 20, 2023
RecommenderSystem-LLM	Jupyter Notebook	2	Recommender System with Large Language Models (LLM)	Oct 08, 2023
PB-LLM	Python	118	PB-LLM: Partially Binarized Large Language Models	Jan 18, 2024
3D-LLM	Python	606	Code for 3D-LLM: Injecting the 3D World into Large Language Models	Jan 18, 2024
llmx	Python	40	An API for Chat Fine-Tuned Large Language Models (llm)	Jan 07, 2024
MLLM	Jupyter Notebook	3	Mastering large language models - the GitHub repository for the LLM series at leftasexercise.com	Oct 27, 2023
LLM-FineTuning-Large-Language-Models	Jupyter Notebook	123	LLM (Large Language Model) FineTuning	Jan 17, 2024
mutate	Python	3	A library to synthesize text datasets using Large Language Models (LLM)	May 26, 2022
mutate	Python	142	A library to synthesize text datasets using Large Language Models (LLM)	Mar 18, 2023
LLaMA-Pruning	Python	7	Structural Pruning for LLaMA	Apr 09, 2023
yet-another-llm-curated-list	None	6	Yet Another LLM(Large Language Models) Curated List But with chinese document.	Mar 03, 2023
LLM-groundedDiffusion	Python	270	LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Models (LLM-grounded Diffusion: …	Jan 18, 2024
aix	Go	115	AIx is a cli tool to interact with Large Language Models (LLM) APIs.	Mar 31, 2023
Awesome-open-LLM	None	3	Awesome-Open-LLM : a curated list of open-source Large Language Models (LLMs)	May 03, 2023
Torch-Pruning	Python	685	Structural Pruning for Model Acceleration	Dec 01, 2022
LLM-research-paper	None	3	paper list about large language model (LLM)	Mar 23, 2023
LLM-QAT	Python	168	Code repo for the paper "LLM-QAT Data-Free Quantization Aware Training for Large Language Models"	Jan 12, 2024
LLM-Adapters	Python	374	LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models	Apr 12, 2023
X-LLM	None	5	X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages	Apr 26, 2023
L3M	Python	3	logical large language models	Apr 01, 2023
transformers	None	103	Understanding large language models	Apr 22, 2023
LLMeBench	Python	51	Benchmarking Large Language Models	Jan 18, 2024
langwhat	Python	3	pyWhat LLM version \| Answer "What is it?" on the command line with the power …	Apr 06, 2023
OneFlow-Pruning	Python	5	[CVPR-2023] Towards Any Structural Pruning	Apr 10, 2023
awesome-llm	None	9	Awesome series for Large Language Model(LLM)s	Mar 30, 2023
awesome-llm-list	None	3	An overview of Large Language Model (LLM) options	Apr 24, 2023
LLM-Inference-API	Python	25	Large Language Model (LLM) Inference API and Chatbot	Apr 27, 2023
awesome-llm-list	None	2	An overview of Large Language Model (LLM) options	May 07, 2023
application-ai-llm	Java	2	AI features using a LLM (Large Language Model)	Sep 02, 2023
baran	Ruby	8	Text Splitter for Large Language Model (LLM) datasets.	Jun 22, 2023
llm-primer	None	8	A primer on large language models (LLM) as of Jan 2023, with bonus ChatGPT topic	Mar 22, 2023
Awesome-LLM-Reliability-Robustness-Safety	None	3	Awesome-LLM-Robustness: a curated list of Robustness, Reliability and Safety in Large Language Models	Mar 28, 2023
Awesome-LLM	None	127	This project collects awesome resources (e.g., papers, open-source models) for large language model (LLM)	Apr 24, 2023
LLMs-for-Production	None	2	Large Language Models for Production	Jun 13, 2023
Awesome-LLM	None	889	Awesome-LLM: a curated list of Large Language Model	Mar 30, 2023
min-LLM	Python	68	Minimal code to train a Large Language Model (LLM).	Mar 28, 2023
LLM-Planning-Papers	None	163	Must-read Papers on Large Language Model (LLM) Planning.	Jan 18, 2024
secondbrain	Rust	6	Multi-platform desktop app to download and run Large Language Models(LLM) locally in your computer.	May 27, 2023
Awesome-LLM-RAG	None	197	Awesome-LLM-RAG: a curated list of advanced retrieval augmented generation (RAG) in Large Language Models	Jan 19, 2024
NLP-with-LLMs	Jupyter Notebook	4	Natural Language Processing with Large Language Models	May 10, 2023
wanda	Python	429	A simple and effective LLM pruning approach.	Jan 18, 2024
Awesome-TimeSeries-SpatioTemporal-LM-LLM	None	523	A professional list on Large (Language) Models and Foundation Models (LLM, LM, FM) for Time …	Jan 17, 2024
llm	Python	90	Access large language models from the command-line	Apr 11, 2023
llm-hub	None	17	A curated collection of interesting applications, repos, and tutorials using large language models (LLM) like …	Apr 11, 2023
awesome-llm-interpretability	None	734	A curated list of Large Language Model (LLM) Interpretability resources.	Jan 18, 2024
neurips_llm_efficiency_challenge	Python	220	NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day	Jan 14, 2024
LLM-Continual-Learning-Papers	None	46	Must-read Papers on Large Language Model (LLM) Continual Learning	Jan 17, 2024
lmql	Python	269	A query language for programming (large) language models.	Apr 09, 2023
guidance	Jupyter Notebook	6	A guidance language for controlling large language models.	May 20, 2023