PLMPapers

A paper list of pre-trained language models (PLMs).

Stars

134

Forks

18

Language

None

Last Updated

Apr 18, 2024

Similar Repos
Repo Language Stars Description Updated At
None 151 List of Korean pre-trained language models. Apr 13, 2023
None 2 pre-trained Language Models Mar 04, 2023
Jupyter Notebook 159 pre-trained Language Models May 10, 2023
Python 27 Source code for paper: Knowledge Inheritance for Pre-trained Language Models Aug 08, 2022
Python 3 Resources for the paper: Monolingual Pre-trained Language Models for Tigrinya May 27, 2023
None 3 Source code for paper: Knowledge Inheritance for Pre-trained Language Models Apr 24, 2023
Python 156 Code for the paper "Deep Entity Matching with Pre-trained Language Models" Aug 02, 2022
Python 5 Code for the paper "Revisiting k-NN for Pre-trained Language Models" Apr 20, 2023
None 111 A continuously updated paper list for multi-modal pre-trained big models May 07, 2023
Python 5 Annotating Columns with Pre-trained Language Models Aug 02, 2022
Python 3 PhoBERT: Pre-trained language models for Vietnamese Feb 28, 2021
Python 4 Code for INCLUDE paper with pre-trained models Feb 10, 2022
None 2935 Must-read Papers on pre-trained language models. Aug 15, 2022
None 2 Must-read Papers on pre-trained language models. Nov 04, 2021
Python 14 Self-Conditioning Pre-Trained Language Models, ICML 2022 Jul 26, 2022
Python 4 Deep Keyphrase Generation with Pre-trained Language Models Apr 07, 2023
Python 7 Repo for ACL2023 paper "Plug-and-Play Knowledge Injection for Pre-trained Language Models" Jun 18, 2023
None 162 A collection of Natural language processing pre-trained models. Jul 27, 2022
Python 1570 Chinese Pre-Trained Language Models (CPM-LM) Version-I Apr 29, 2023
Python 2 Domain knowledge transferring framework for pre-trained language models Nov 19, 2022
Python 31 Code for EMNLP 2021 main conference paper "Dynamic Knowledge Distillation for Pre-trained Language Models" Feb 23, 2023
Python 28 Source code for the TMLR paper "Black-Box Prompt Learning for Pre-trained Language Models" Apr 28, 2023
None 11 Source code and checkpoints for legal pre-trained language models. Jul 02, 2022
None 412 Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT) Aug 16, 2022
None 470 PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings) Aug 11, 2022
Python 89 Source code and checkpoints for legal pre-trained language models. Aug 14, 2022
None 5 Pre-trained Language Models for Under-represented Languages in NLP Jun 20, 2022
Python 73 Pre-Trained Language Models for Interactive Decision-Making [NeurIPS 2022] May 19, 2023
None 178 Pre-trained models and language resources for Natural Language Processing in Polish Oct 06, 2022
None 4 Code, Data and Demo for Paper: Controllable Generation from Pre-trained Language Models via Inverse Prompting Jun 28, 2022
Python 92 Code, Data and Demo for Paper: Controllable Generation from Pre-trained Language Models via Inverse Prompting Jul 14, 2022
Python 65 Code for the ICLR2022 paper "Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learners" Oct 17, 2022
Python 13 code for the paper 'Multi-Task Learning for Knowledge Graph Completion with Pre-trained Language Models' Mar 01, 2023
None 236 [IJCAI 2023 survey track]A curated list of resources for molecular pre-trained models or chemical language … Apr 25, 2023
None 11 Pre-trained models for Honk Nov 15, 2020
Python 600 Portuguese pre-trained BERT models Sep 10, 2022
Jupyter Notebook 29 Pre-trained Mongolian BERT models Jan 02, 2022
None 2 Low-cost Inference Package for Big Pretrained Language Models (PLMs) Dec 02, 2023
None 2 A curated list of other pre-trained language models that are similar or related to ChatGPT. Jan 15, 2023
Python 17 Code for paper ["Exploring extreme parameter compression for pre-trained language models ICLR2022"](https://arxiv.org/abs/2205.10036) Apr 20, 2023
Python 796 Guide to using pre-trained large language models of source code Aug 31, 2022
Python 48 WizardLM: Empowering Large Pre-Trained Language Models to Follow Complex Instructions Apr 26, 2023
None 2 Guide to using pre-trained large language models of source code Apr 23, 2023
Python 210 A PyTorch-based model pruning toolkit for pre-trained language models Oct 13, 2022
Python 5 GRAIN: Gradient-based Intra-attention Pruning on Pre-trained Language Models Aug 25, 2023
Python 7 WizardLM: Empowering Large Pre-Trained Language Models to Follow Complex Instructions Sep 03, 2023
Python 40 Code associated with the "Data Augmentation using Pre-trained Transformer Models" paper Aug 22, 2022
Python 6 image tagging using pre-trained models Aug 05, 2022
Python 258 Pre-Trained Models for ToD-BERT Sep 08, 2022
None 267 Pre-trained Models of DMLC Project Feb 26, 2022