BERT-pytorch

PyTorch implementation of BERT in "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding"

Stars

79

Forks

24

Language

Python

Last Updated

Jul 12, 2023

Similar Repos
Repo Language Stars Description Updated At
Python 208 Chainer implementation of "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding" Sep 12, 2022
Jupyter Notebook 2 BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding review Jul 21, 2020
Python 2 Pre-training of Deep Bidirectional Transformers for Language Understanding Oct 30, 2018
Python 4 BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 中文 汉语 Apr 16, 2022
Python 953 Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN Aug 03, 2022
Jupyter Notebook 3 Devlin, Jacob, et al. "Bert: Pre-training of deep bidirectional transformers for language understanding." arXiv preprint … Jun 27, 2022
None 639 BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 论文的中文翻译 Chinese Translation! Aug 09, 2022
Python 357 Pre-trained Transformers for the Arabic Language Understanding and Generation (Arabic BERT, Arabic GPT2, Arabic Electra) Sep 08, 2022
Jupyter Notebook 801 PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Aug 11, 2022
Jupyter Notebook 2 PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Aug 21, 2022
Jupyter Notebook 13 PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Jan 26, 2023
Jupyter Notebook 2 PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Dec 27, 2023
Python 93 Interpreting Bidirectional Encoder Representations from Transformers (BERT) Jun 18, 2022
Python 5 PyTorch implementation of Rethinking Positional Encoding in Language Pre-training Jan 27, 2022
Python 5 Pytorch implementation of "Fast and Accurate Deep Bidirectional Language Representations for Unsupervised Learning". May 07, 2022
None 180 PERT: Pre-training BERT with Permuted Language Model Aug 13, 2022
Python 17 Pre-training BERT masked language models with custom vocabulary Feb 19, 2023
Python 397 DNABERT: pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genome May 09, 2023
Python 26 An Implementation of ERNIE For Language Understanding (including Pre-training models and Fine-tuning tools) Oct 18, 2022
Python 28 Understanding the Difficulty of Training Transformers Jul 18, 2022
Python 305 Understanding the Difficulty of Training Transformers Apr 30, 2023
None 4 pytorch implementation of mvp: a multi-stage vision-language pre-training framework May 06, 2022
Python 237 (CVPR2021) Kaleido-BERT: Vision-Language Pre-training on Fashion Domain. Sep 10, 2022
Python 270 Pytorch implementation of R-BERT: "Enriching Pre-trained Language Model with Entity Information for Relation Classification" Sep 12, 2022
Python 10 BERT for Distributed PyTorch + AMP Training Mar 15, 2023
Python 48 HeBERT: Pre-training BERT for modern Hebrew Aug 06, 2022
Python 175 Minimalist implementation of a BERT Sentence Classifier with PyTorch Lightning, Transformers and PyTorch-NLP. Aug 25, 2022
Python 27 ACL 2021: MPC-BERT: A Pre-Trained Language Model for Multi-Party Conversation Understanding Feb 26, 2023
Python 235 An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal … Aug 05, 2022
Python 1628 Code and model for the paper "Improving Language Understanding by Generative Pre-Training" Aug 10, 2022
Python 2 Code and model for the paper "Improving Language Understanding by Generative Pre-Training" Jan 28, 2023
Python 2 ✍️ | RunPod Worker for bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Mar 04, 2024
Python 71 Implementation of Marge, Pre-training via Paraphrasing, in Pytorch Jul 12, 2022
Jupyter Notebook 4 pre-training your own BERT modelfrom scratch Mar 05, 2023
Python 269 Semantics-aware BERT for Language Understanding (AAAI 2020) Sep 12, 2022
Python 31 The Pytorch implementation for "Video-Text Pre-training with Learned Regions" May 08, 2022
Python 218 MPNet: Masked and Permuted Pre-training for Language Understanding https://arxiv.org/pdf/2004.09297.pdf Aug 08, 2022
Python 96 Pre-training of Graph Augmented Transformers for Medication Recommendation Sep 02, 2022
Python 2 Colab notebooks and code used for training and inferencing BERT and other transformer models from … Nov 29, 2019
Python 113 Open-source pre-training implementation of Google's LaMDA in PyTorch. Aug 11, 2022
None 2 Pytorch implementation of "All Tokens Matter: Token Labeling for Training Better Vision Transformers" Jun 07, 2023
Python 217 Pytorch implementation of "Spatial As Deep: Spatial CNN for Traffic Scene Understanding" Mar 15, 2023
Python 153 KoRean based BERT pre-trained models (KR-BERT) for Tensorflow and PyTorch Sep 03, 2022
Python 46 pytorch； mask language model ； bert Aug 29, 2022
Jupyter Notebook 58 This shows how to fine-tune Bert language model and use PyTorch-transformers for text classififcation Jul 11, 2022
Jupyter Notebook 15 CoQA QuesAns using BERT, PyTorch and Hugging Face Transformers Mar 13, 2023
Python 21 Implementation of Sketch-BERT: Learning Sketch Bidirectional Encoder Representation from Transformers by Self-supervised Learning of Sketch … Jan 11, 2023
Python 7 pytorch implementation for GraVL-BERT paper Mar 20, 2023
Python 3 Universal Transformers implementation in PyTorch Dec 06, 2022
Jupyter Notebook 7 Deep Learning, Attention, Transformers, BERT, GPT-2, GTP-3 Apr 04, 2023