finetune-transformer-lm

Code and model for the paper "Improving Language Understanding by Generative Pre-Training"

Stars

2

Forks

4

Language

Python

Last Updated

Jan 28, 2023

Similar Repos
Repo Language Stars Description Updated At
Python 1628 Code and model for the paper "Improving Language Understanding by Generative Pre-Training" Aug 10, 2022
Python 254 Code for training and evaluation of the model from "Language Generation with Recurrent Generative Adversarial … May 04, 2023
Jupyter Notebook 53 Chinese Transformer Generative Pre-Training Model Apr 02, 2023
Python 71 Source code for ACL 2021 paper "ERICA: Improving Entity and Relation Understanding for Pre-trained Language … Aug 14, 2022
None 7 UniLM - Unified Language Model Pre-training / Pre-training for NLP and Beyond Jun 03, 2022
Jupyter Notebook 801 PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Aug 11, 2022
Jupyter Notebook 2 PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Aug 21, 2022
Jupyter Notebook 13 PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Jan 26, 2023
Jupyter Notebook 2 PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Dec 27, 2023
Python 2 Pre-training of Deep Bidirectional Transformers for Language Understanding Oct 30, 2018
Python 18 Code and pre-trained model for the paper "Molecular Language Model as Multi-task Generator." Mar 12, 2023
Python 953 Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN Aug 03, 2022
Python 224 Unsupervised Language Model Pre-training for French May 28, 2023
Python 235 An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal … Aug 05, 2022
Python 16 Code for EMNLP 2021 paper: Improving Sequence-to-Sequence Pre-training via Sequence Span Rewriting Jun 13, 2022
Python 26 Code for paper `Improving the Fairness of Deep Generative Models without Retraining` Aug 02, 2022
Python 88 Understanding and Improving Fast Adversarial Training [NeurIPS 2020] Mar 15, 2023
Python 2 Code of ACL 2022 paper Continual Pre-training of Language Models for Math Problem Understanding with … Jun 20, 2023
Jupyter Notebook 2 BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding review Jul 21, 2020
Python 36 Code for the Paper "Improving Diffusion Model Efficiency Through Patching" Sep 01, 2022
Python 8 generative language model training on top of the JAX and Huggingface 🤗 Jul 13, 2022
Python 37 Code for "Understanding and Improving Layer Normalization" Jan 13, 2023
Python 2 ✍️ | RunPod Worker for bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Mar 04, 2024
Python 5370 Code for the paper "Jukebox: A Generative Model for Music" Aug 12, 2022
None 10 Code for the paper "Jukebox: A Generative Model for Music" Apr 11, 2023
Python 3 Examples for pre-training retrieval-extraction based language model Oct 25, 2021
Python 7 Code of the CVPR 2022 paper "HOP: History-and-Order Aware Pre-training for Vision-and-Language Navigation" May 23, 2022
None 180 PERT: Pre-training BERT with Permuted Language Model Aug 13, 2022
Python 218 MPNet: Masked and Permuted Pre-training for Language Understanding https://arxiv.org/pdf/2004.09297.pdf Aug 08, 2022
Python 83 Code and data for ACL20 paper "Incorporating External Knowledge through Pre-training for Natural Language to … Aug 09, 2022
Python 2 Experiment Code for Paper ``CoT: Cooperative Training for Generative Modeling'' Mar 01, 2024
Python 371 Code for KDD'20 "Generative Pre-Training of Graph Neural Networks" Mar 22, 2023
Python 234 Source code for paper: Improving Grammatical Error Correction via Pre-Training a Copy-Augmented Architecture with Unlabeled … Sep 22, 2022
Python 16 Masked Structural Growth for 2x Faster Language Model Pre-training Jan 21, 2024
Python 208 Chainer implementation of "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding" Sep 12, 2022
Python 26 An Implementation of ERNIE For Language Understanding (including Pre-training models and Fine-tuning tools) Oct 18, 2022
Python 126 This is the official repository for the paper, MidiBERT-Piano: Large-scale Pre-training for Symbolic Music Understanding. Sep 07, 2022
Python 2 The repository for paper "Uncertainty-aware Parameter-Efficient Self-training for Semi-supervised Language Understanding" Jan 02, 2024
Python 214 Research code for EMNLP 2020 paper "HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training" May 01, 2023
Python 8 Code for ACL2023 paper: Pre-Training to Learn in Context May 08, 2023
Python 4 BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 中文 汉语 Apr 16, 2022
Python 117 Source code for TACL paper "KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language … Aug 11, 2022
None 9 Learning Visual Prior via Generative Pre-Training May 24, 2023
None 133 Paper, Code and Statistics for Self-Supervised Learning and Pre-Training on Speech. Apr 28, 2023
Python 10 Code for the paper: Tele-Knowledge Pre-training for Fault Analysis [ICDE 2023] Apr 27, 2023
Python 2 The pretrain code for the paper "Natural Language-informed Understanding of Molecule Graphs" Oct 18, 2023
Python 5050 Official implementations for various pre-training models of ERNIE-family, covering topics of Language Understanding & Generation, … Aug 08, 2022
None 20 Solving tough JavaScript questions and improving your core understanding of the language Aug 03, 2022
Python 155 Official code repository for the paper "A Generative Model for People in Clothing". Mar 24, 2023
Python 10 （Accepted By EMNLP2022 main long）Knowledge Prompting in Pre-trained Language Model for Natural Language Understanding Mar 02, 2023