unsloth

Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory

Stars

8378

Forks

528

Language

Python

Last Updated

May 04, 2024

Similar Repos
Repo Language Stars Description Updated At
Python 6 An finetuning pipeline for instruct tuning Raven 14bn using QLORA 4bit and the Ditty finetuning … May 29, 2023
TypeScript 25 Just your normal (JSX) syntax, with faster performance and less memory Mar 12, 2023
Haskell 69 Bit vectors: 8x less memory, up to 1000x faster than Vector Bool May 01, 2023
Python 18 中文Guanaco(原驼)大语言模型 QLora 量化训练 +本地CPU/GPU部署 (Chinese Guanaco QLoRA: Efficient Finetuning of Quantized LLMs) May 28, 2023
Java 704 Write code that run faster, use less memory and prepare for your Job Interview Aug 24, 2022
None 2 Write code that run faster, use less memory and prepare for your Job Interview Nov 28, 2021
None 2 Write code that run faster, use less memory and prepare for your Job Interview May 02, 2021
None 2 Write code that run faster, use less memory and prepare for your Job Interview Jul 17, 2023
Emacs Lisp 2 Faster than desktop.el and less features May 04, 2018
Python 164 Fine-tuning LLMs using QLoRA Jan 17, 2024
Shell 535 A server-optimized Ruby distribution: less memory, faster, easy to install and security-patch via APT/YUM May 19, 2022
Go 26 Wrapper for Golang http.FileServer that is faster (serving from memory) and uses less bandwidth (gzips … Feb 23, 2022
Python 951 chatglm 6b finetuning and alpaca finetuning Apr 24, 2023
Rust 2 SafeBox - less leaks of secrets in memory Mar 08, 2023
Java 152 Lightweight: Faster than light, Low on memory Mar 30, 2023
JavaScript 3 💾 📦 ♳ Run deno subprocesses faster! (less code) Apr 10, 2022
JavaScript 2 Faster and less buggy fork of the Scratch editor Dec 17, 2023
Crystal 64 Fast HTML5 Parser with CSS selectors. This is successor of myhtml and expected to be … Jul 28, 2022
Go 269 Make your Go programs use less memory (maybe) Apr 27, 2023
C++ 18 C++ version of the SED fitting code FAST (Kriek et al. 2009); it's faster, uses … Nov 07, 2022
Go 4 Like Apex Legends. Just more, better, faster, and less recoil Dec 25, 2021
C# 39 Faster, less leakier thread-safe Lazy<T> implementation in C# Oct 10, 2021
Jupyter Notebook 5 NLP transformer finetuning Dec 26, 2022
Python 8 clue chatyuan finetuning Apr 13, 2023
Python 8 moss chat finetuning Apr 24, 2023
Python 3 Finetuning VITS Efficiently Aug 08, 2023
Python 21 Finetuning VITS Efficiently Jan 16, 2024
PHP 11 A PHP Composer compatible classloader that uses less memory. Oct 03, 2021
Erlang 30 A minimal in-memory distributed master-less document database Sep 19, 2022
C++ 6 Create aligned buffers to make faster disk io with less iops Dec 05, 2017
C# 4 This data structure is a set of integer values. It works 2 times faster than … Feb 04, 2023
Lua 2 This is the new one! It's faster (with LuaJIT), loads bitmap images (sort of), uses … Feb 13, 2023
Perl 7 Simplest class builder, Mojo::Base porting, fast and less memory Sep 19, 2017
C++ 3 LightweighT Almost Lock-Less Oriented for C++ programs memory allocator Apr 07, 2023
Julia 3 Allows Components to be written into memory for faster serving. Jul 04, 2022
Python 13 Large language Model finetuning Apr 12, 2023
Python 32 Finetuning Multi-Modality Models Jun 19, 2023
Jupyter Notebook 750 LLM Finetuning with peft Jan 18, 2024
Python 6 Finetuning LLaMA with DeepSpeed Nov 02, 2023
C++ 3 Arduino library to store a symmetrical distance table in less memory Jan 22, 2023
PHP 20 Pure PHP implementation of array data structures that use less memory. Jul 17, 2022
Jupyter Notebook 229 第一个开源的基于QLoRA的33B中文大语言模型First QLoRA based open source 33B Chinese LLM Jun 19, 2023
Python 5 Finetuning project for GPT-3 Aug 08, 2022
Python 9 Finetuning tutorial for GPT-3 Aug 01, 2022
Python 19 LLaMA 大模型 finetuning Mar 29, 2023
Jupyter Notebook 26 Finetuning BERT for classification task Jan 23, 2023
Jupyter Notebook 337 Crosslingual Generalization through Multitask Finetuning Apr 25, 2023
Python 3 Pretraining & Finetuning T5 for CBQA Sep 04, 2022
Jupyter Notebook 2 Finetuning InstructLLaMA on consumer hardware Mar 27, 2023
Jupyter Notebook 386 Finetuning InstructLLaMA with portuguese data May 20, 2023