Finetune_GPTNEO_GPTJ6B

Repo for fine-tuning Casual LLMs

Stars

420

Forks

78

Language

Python

Last Updated

Jan 17, 2024

Similar Repos
Repo Language Stars Description Updated At
Jupyter Notebook 33 Fine-tuning 6-Billion GPT-J (& other models) with LoRA and 8-bit compression Mar 21, 2023
Python 27 Examples of inference and fine-tuning T5, GPT-2 and ruGPT-3 models Apr 07, 2023
Jupyter Notebook 23 Fine-tuning GPT for Smart Contract Auditing Apr 25, 2023
Python 93 Fine-tuning GPT-2 Small for Question Answering Mar 13, 2023
JavaScript 4 Script for fine-tuning GPT-3 from Airtable Apr 15, 2023
Python 2 A library for fine-tuning, inference and evaluation of GPT-n language models on small datasets. Feb 08, 2023
Python 61 Fine Tuning Language Models for Multilabel Prediction Aug 12, 2022
Python 176 Advanced fine tuning tools for vision models Apr 21, 2023
Python 221 Guide for fine-tuning Llama/CodeLlama models Jan 18, 2024
Python 2 Code for fine-tuning GPT-J LoRAs in 4bit Apr 09, 2023
Python 71 Humanable ChatGLM/GPT Fine-tuning | ChatGLM微调 Apr 09, 2023
None 10 Samples for fine-tuning HuggingFace models with AzureML Apr 11, 2023
Python 18 Fine tuning experiments for the GPT-2 model by OpenAI. Jun 14, 2022
Python 7 Fine-tuning GPT-2 to generate research paper abstracts Mar 26, 2023
Python 320 Blazing fast framework for fine-tuning similarity learning models Aug 15, 2022
Python 88 Efficient Training (including pre-training and fine-tuning) for Big Models Aug 12, 2022
Python 2 TensorFlow 2 implementation of GPT-2, with examples for fine tuning Nov 14, 2023
Python 17 Abstractive text summarization by fine-tuning seq2seq models. Aug 01, 2022
Python 4 Fine-tuning large language models with huggingface transformers and deepspeed Jul 03, 2023
Jupyter Notebook 15 Fine-tuning GPT-2 on articles followed by text generation Aug 18, 2022
Python 9 Medical domain-focused GPT-2 fine-tuning, optimization, and lightweighting research repository (compared to GPT-4). Jun 18, 2023
Python 7 Example code for prefix-tuning GPT/GPT-NeoX models and for inference with trained prefixes Apr 20, 2023
Python 3 Fine-tuning the GROVER pretrained models for molecular properties prediction. Mar 17, 2022
Python 3 A Toolkit for Fine-Tuning Large Language Models with LoRA and DeepSpeed Apr 14, 2023
Python 451 Fast & Simple repository for pre-training and fine-tuning T5-style models Apr 30, 2023
None 6 PPT for Fine tuning Dec 24, 2019
Python 10 Implementations of models and metrics for semantic text similarity. Includes fine-tuning and prediction of models Oct 21, 2021
Python 2 A primer of transformer models and fine-tuning on language tasks Jan 10, 2022
Python 77 Easiest way of fine-tuning HuggingFace video classification models Apr 25, 2023
JavaScript 131 GPT Fine-Tuning using Node.js - an easy to use starter project Apr 09, 2023
Python 7 Trainer and Evaluation scripts for fine-tuning Whisper models for the Ukrainian language Apr 20, 2023
TypeScript 312 LLM fine-tuning and eval Jan 17, 2024
Python 24 PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models May 24, 2022
Python 9 All-in-one repository for Fine-tuning & Pretraining (Large) Language Models Apr 11, 2023
Python 15 Fine-tuning scripts for evaluating transformer-based models on KLEJ benchmark. Aug 12, 2022
Python 214 Code for the paper Fine-Tuning Language Models from Human Preferences Aug 12, 2022
None 2 Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning … Mar 27, 2023
C 17 Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning … Mar 30, 2023
Jupyter Notebook 11 Fine-tuning HuggingFace Transformer Question-Answering Models On Custom Data May 17, 2023
Jupyter Notebook 3 Prompt tuning toolkit for GPT-2 and GPT-Neo Apr 16, 2022
Jupyter Notebook 45 Prompt tuning toolkit for GPT-2 and GPT-Neo Jun 21, 2022
Python 13 Virtual Data Augmentation: A Robust and General Framework for Fine-tuning Pre-trained Models Aug 06, 2022
Pascal 13 Windows, macOS, and Linux desktop client for fine tuning Dreambooth models using Replicate's API. Apr 22, 2023
Python 2 Code for ICLR 2022 submission "Differentially Private Fine-tuning of Language Models". Jul 20, 2022
Python 3 an easy way to create JSONL files for fine-tuning openai models. Jan 04, 2024
Jupyter Notebook 7 Fine Tuning and Feature Extraction Examples May 20, 2022
Jupyter Notebook 18 Ipython notebooks of walk-trough Transformer model implementations in PyTorch and GPT-2 fine-tuning. Oct 31, 2022
Python 120 ChatGLM-6B fine-tuning. Apr 24, 2023
Python 59 chatglm-6b-fine-tuning May 24, 2023
Jupyter Notebook 35 Includes PyTorch -> Keras model porting code for DeiT models with fine-tuning and inference notebooks. Sep 05, 2022