xbert

Implementation of pre-training model loading architecture of bert and its variants with tensorflow2

Stars

15

Forks

0

Language

Python

Last Updated

Feb 06, 2021

Similar Repos
Repo Language Stars Description Updated At
None 180 PERT: Pre-training BERT with Permuted Language Model Aug 13, 2022
Python 17 Pre-training BERT masked language models with custom vocabulary Feb 19, 2023
Python 71 PyTorch implementation of BERT in "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding" Sep 02, 2022
Jupyter Notebook 4 pre-training your own BERT modelfrom scratch Mar 05, 2023
Python 48 HeBERT: Pre-training BERT for modern Hebrew Aug 06, 2022
Jupyter Notebook 3 BERT Pre-trained Model for Malayalam. May 12, 2022
None 7 UniLM - Unified Language Model Pre-training / Pre-training for NLP and Beyond Jun 03, 2022
Python 46 Author: Wenhao Yu ([email protected]). ACL 2022 Dict-BERT: Enhancing Language Model Pre-training with Dictionary May 10, 2023
Python 826 Keras implementation of BERT with pre-trained weights Sep 12, 2022
Python 16 a TensorFlow2(keras model) implementation of EfficientNetV2 Apr 27, 2023
Jupyter Notebook 7 Training a BERT model from scratch. Apr 18, 2023
None 8 A series of BERT and Albert model checkpoints trained to reduce gendered correlations in pre-training Aug 12, 2022
Python 40 use google pre-training model bert to fine-tuning for the chinese multiclass classification Aug 26, 2022
Jupyter Notebook 7 YOLOv1 implementation with TensorFlow2 Jul 03, 2022
Jupyter Notebook 2 YOLOv3 implementation with TensorFlow2 Jun 19, 2023
Python 208 Chainer implementation of "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding" Sep 12, 2022
Jupyter Notebook 392 iBOT :robot:: Image BERT Pre-Training with Online Tokenizer (ICLR 2022) Aug 11, 2022
Jupyter Notebook 56 A PyTorch implementation of Google AI's BERT model provided with Google's pre-trained models, examples and … Nov 14, 2022
Jupyter Notebook 2 A PyTorch implementation of Google AI's BERT model provided with Google's pre-trained models, examples and … May 05, 2023
Python 54 Financial Domain Question Answering with pre-trained BERT Language Model May 25, 2022
Python 2 About BERT model training implementation using more than 1000 A100 GPUs for MLPerf Training v2.0 Sep 05, 2022
Python 2 Tensorflow2/Keras implementation of the original FlowNet model Sep 21, 2022
Python 85 [NAACL'22] TaCL: Improving BERT Pre-training with Token-aware Contrastive Learning Mar 30, 2023
Python 270 Pytorch implementation of R-BERT: "Enriching Pre-trained Language Model with Entity Information for Relation Classification" Sep 12, 2022
Jupyter Notebook 3 A PyTorch implementation of Google AI's BERT model with script to load Google's pre-trained models Mar 27, 2023
Python 44 A pre-trained model with multi-exit transformer architecture. Aug 22, 2022
Jupyter Notebook 53 Chinese Transformer Generative Pre-Training Model Apr 02, 2023
Python 9 Pre-trained Bert model for generating Danmaku Embedding May 21, 2022
Python 2221 Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo Sep 10, 2022
None 2 Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo Oct 12, 2020
Python 7297 Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型） Aug 15, 2022
Python 277 A Pytorch implementation of MoveNet from Google. Include training code and pre-trained model. Apr 18, 2023
Python 237 (CVPR2021) Kaleido-BERT: Vision-Language Pre-training on Fashion Domain. Sep 10, 2022
Python 62 Neutron: A pytorch based implementation of Transformer and its variants. Aug 05, 2022
Python 3 Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo Oct 11, 2022
None 3 Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo Feb 17, 2023
Python 83 Use BERT pre-trained model to do sentiment classification Aug 18, 2022
Python 114 A Greek edition of BERT pre-trained language model Sep 11, 2022
Python 3 Fusion-BERT model implemented with BERT and siamese network Jan 17, 2022
Python 224 Unsupervised Language Model Pre-training for French May 28, 2023
Python 89 Bert-classification and bert-dssm implementation with keras. Jun 28, 2022
Python 3 TensorFlow2 Implementation of "Neural Attentive Item Similarity Model for Recommendation" Jun 24, 2022
Python 17 Tensorflow2 training code with jit compiling on multi-GPU. Sep 22, 2022
Python 32 A simple PyTorch implementation of BERT, complete with pretrained models and training scripts. Aug 31, 2022
Python 27 Code for pre-training CharacterBERT models (as well as BERT models). May 09, 2022
Jupyter Notebook 2 BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding review Jul 21, 2020
Python 12 BERT model training impelmentation using 1024 A100 GPUs for MLPerf Training v1.1 Apr 27, 2022
Jupyter Notebook 2 Notebooks for teaching transformers and fine-tuning a pre-trained BERT model May 19, 2023
Python 102 BERT-CCPoem is an BERT-based pre-trained model particularly for Chinese classical poetry Sep 06, 2022
Python 105 Chinese clinical named entity recognition using pre-trained BERT model Jul 14, 2022