finetune-gptneo

Fine Tune GPT-NEO (2.7B and 1.3B Parameters) on a single GPU with Huggingface Transformers using DeepSpeed.

Stars

3

Forks

1

Language

Python

Last Updated

Mar 04, 2022

Similar Repos
Repo Language Stars Description Updated At
Python 5 Visually ground GPT-Neo 1.3b and 2.7b Dec 24, 2021
Python 297 Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU … Jan 23, 2023
Python 242 Fine-Tune EleutherAI GPT-Neo And GPT-J-6B To Generate Netflix Movie Descriptions Using Hugginface And DeepSpeed Mar 22, 2023
Python 4 Fine-tuning large language models with huggingface transformers and deepspeed Jul 03, 2023
Jupyter Notebook 9 It is fine-tune the GPT-Neo model for Thai language. Apr 27, 2023
Python 41 Fine-tune transformers with pytorch-lightning Jan 09, 2023
Jupyter Notebook 3 This project uses Huggingface transformers GPT-2 to fine-tune text generation models based on lyric data … Dec 12, 2022
Jupyter Notebook 4 Fine-Tune Whisper for Italian ASR with transformers Apr 20, 2023
Python 61 Fine tune GPT-2 with your favourite authors Mar 03, 2023
Jupyter Notebook 3 Fine-tuning Transformers from HuggingFace for financials news sentiment Aug 30, 2023
Jupyter Notebook 45 Colab notebooks to run a basic AI Dungeon clone using gpt-neo-2.7B Jun 21, 2022
Jupyter Notebook 3 How to inference and finetune gpt neo with deepspeed and torch Sep 20, 2022
Jupyter Notebook 138 Fine tune a T5 transformer model using PyTorch & Transformers🤗 May 17, 2023
Jupyter Notebook 23 A basic ui for running gpt neo 2.7B on low vram (3 gb Vram minimum) Aug 02, 2022
Python 4 Document search and inference with GPT, Huggingface and Sentence Transformers. Jun 04, 2023
Python 187 Easily fine tune GPT-2 to fill in missing text Mar 21, 2023
Python 7 Fine-tune GPT-3 with a Google Chat conversation history Dec 10, 2022
Python 9 A Python Flask web API for GPT-2 (using HuggingFace/Transformers.) Jun 14, 2022
Jupyter Notebook 659 Github repo with tutorials to fine tune transformers for diff NLP tasks Oct 07, 2022
Python 2 GPT-Neo Text Generation - 125 Million parameters and Streamlit GUI May 05, 2024
Python 13 Create soft prompts for fairseq 13B dense, GPT-J-6B and GPT-Neo-2.7B for free in a Google … Jun 16, 2022
Objective-C 4753 An easy way to fine-tune, and adjust parameters for iOS apps in development. Apr 26, 2023
Jupyter Notebook 177 🤗🖼️ HuggingPics: Fine-tune Vision Transformers for anything using images found on the web. Oct 18, 2022
Python 12 A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem. Jul 04, 2023
Python 2 Python code for fine-tuning GPT-J on consumer video cards (e.g., RTX 3090) using DeepSpeed Feb 12, 2023
Python 190 Feel free to fine tune large BERT models with Multi-GPU and FP16 support. Aug 09, 2022
Python 13 Fine-tune and evaluate Whisper models for Automatic Speech Recognition (ASR) on custom datasets or datasets … May 23, 2023
Jupyter Notebook 58 This shows how to fine-tune Bert language model and use PyTorch-transformers for text classififcation Jul 11, 2022
Python 7 A simple framework to pre-train and fine-tune T5 model with pytorch-lightning and transformers Mar 01, 2023
Jupyter Notebook 3 How you can fine-tune a GPT-3 model with Python with your own data Jan 23, 2023
Python 5 Multi-GPU setup for inference with GPT NeoX 20B and OPT-30B models in huggingface Dec 29, 2022
JavaScript 11 WebGL app that breaks out many of the threejs camera parameters to fine tune projection … Dec 20, 2022
Python 6 train llama-30B on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline … Apr 09, 2023
Jupyter Notebook 20 Use the two different methods (deepspeed and SageMaker model parallelism library) to fine tune llama … Sep 25, 2023
None 2 The dataset used to fine-tune the GPT-2 model used in Anees for the multi-turn dialogue … May 10, 2023
Python 17 Easy-to-use scripts to fine-tune GPT-2-JA with your own texts, to generate sentences, and to tweet … May 16, 2023
Python 40 spaCy-wrap is a wrapper library for spaCy for including fine-tuned transformers from Huggingface in your … Apr 12, 2023
Jupyter Notebook 10 A notebook that runs GPT-Neo with low vram (6 gb) and cuda acceleration by loading … Apr 12, 2022
Python 5 A wrapper to simply load GPT-J and use it for generation. Uses DeepSpeed ons stage … Mar 17, 2022
Python 2 Running large language models like OPT-175B/GPT-3 on a single GPU. Focusing on high-throughput generation. Jun 07, 2023
Jupyter Notebook 49 Fine-tuning GPT-J-6B on colab or equivalent PC GPU with your custom datasets: 8-bit weights with … Mar 21, 2023
None 2 Running large language models like ChatGPT/GPT-3/OPT-175B on a single GPU. Up to 100x faster than … Feb 19, 2024
Jupyter Notebook 126 Under the hood working of transformers, fine-tuning GPT-3 models, DeBERTa, vision models, and the start … Oct 07, 2022
C# 16 An example program for TensorflowSharp - classify an image as a dog or cat using … May 09, 2023
Jupyter Notebook 5 In this project, we will use and fine tune the pre-trained Bidirectional Encoder Representations from … Jul 07, 2022
Jupyter Notebook 8 This Python script reads an e-book in PDF format, splits the text into prompts, and … Apr 12, 2023
Python 72 Crowdfunding open source projects: use OpenReview's high-quality review data to fine-tune a professional review and … Apr 23, 2023
Jupyter Notebook 4 Spam SMS Detection Project implemented using NLP & Transformers. DistilBERT - a hugging face Transformer … Aug 25, 2022
Jupyter Notebook 2 n recent years the NLP community has seen many breakthoughs in Natural Language Processing, especially … Mar 27, 2023
C++ 2 AwesomeBump is a free program written using Qt library designed to generate normal, height, specular … Jan 06, 2022