bert_language_understanding

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

Stars

959

Forks

211

Language

Python

Last Updated

Feb 29, 2024

Similar Repos
Repo Language Stars Description Updated At
Python 2 Pre-training of Deep Bidirectional Transformers for Language Understanding Oct 30, 2018
Jupyter Notebook 2 BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding review Jul 21, 2020
Python 208 Chainer implementation of "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding" Sep 12, 2022
Python 4 BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 中文 汉语 Apr 16, 2022
Python 71 PyTorch implementation of BERT in "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding" Sep 02, 2022
None 639 BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 论文的中文翻译 Chinese Translation! Aug 09, 2022
Jupyter Notebook 3 Devlin, Jacob, et al. "Bert: Pre-training of deep bidirectional transformers for language understanding." arXiv preprint … Jun 27, 2022
Python 397 DNABERT: pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genome May 09, 2023
Python 28 Understanding the Difficulty of Training Transformers Jul 18, 2022
Python 305 Understanding the Difficulty of Training Transformers Apr 30, 2023
Python 1628 Code and model for the paper "Improving Language Understanding by Generative Pre-Training" Aug 10, 2022
Python 2 Code and model for the paper "Improving Language Understanding by Generative Pre-Training" Jan 28, 2023
Jupyter Notebook 801 PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Aug 11, 2022
Jupyter Notebook 2 PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Aug 21, 2022
Jupyter Notebook 13 PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Jan 26, 2023
Jupyter Notebook 2 PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Dec 27, 2023
Python 2 ✍️ | RunPod Worker for bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Mar 04, 2024
Python 357 Pre-trained Transformers for the Arabic Language Understanding and Generation (Arabic BERT, Arabic GPT2, Arabic Electra) Sep 08, 2022
Python 218 MPNet: Masked and Permuted Pre-training for Language Understanding https://arxiv.org/pdf/2004.09297.pdf Aug 08, 2022
Python 96 Pre-training of Graph Augmented Transformers for Medication Recommendation Sep 02, 2022
Python 26 An Implementation of ERNIE For Language Understanding (including Pre-training models and Fine-tuning tools) Oct 18, 2022
None 7 UniLM - Unified Language Model Pre-training / Pre-training for NLP and Beyond Jun 03, 2022
Python 237 Understanding Training Dynamics of Deep ReLU Networks Aug 03, 2022
Python 574 Grounded Language-Image Pre-training Sep 01, 2022
Python 5 Grounded Language-Image Pre-training Mar 31, 2023
Python 5050 Official implementations for various pre-training models of ERNIE-family, covering topics of Language Understanding & Generation, … Aug 08, 2022
Python 2 Grounded language Understanding via Transformers in Human Robot Interaction Mar 13, 2023
Python 224 Unsupervised Language Model Pre-training for French May 28, 2023
Python 235 An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal … Aug 05, 2022
Jupyter Notebook 89 CLIP (Contrastive Language–Image Pre-training) for Italian Jun 30, 2022
Python 138 Large medical text dataset curated for abbreviation disambiguation, designed for natural language understanding pre-training in … Aug 05, 2022
Jupyter Notebook 58 KDD19 Tutorial: From Shallow to Deep Language Representations: Pre-training, Fine-tuning, and Beyond Mar 14, 2022
Python 2018 Multi-Task Deep Neural Networks for Natural Language Understanding Aug 09, 2022
Python 124 Multi-Task Deep Neural Networks for Natural Language Understanding Jul 26, 2022
None 10 Recent Advances in Vision-Language Pre-training! Jul 20, 2022
None 7 Object Detection with Vision-Language Pre-training Apr 10, 2023
None 4 Compress conventional Vision-Language Pre-training data Jun 01, 2023
Python 7 Self-supervised pre-training for ECG representation with inspiration from transformers & computer vision Apr 24, 2023
Python 62 Source code for "Train No Evil: Selective Masking for Task-Guided Pre-Training" Jul 25, 2022
Python 3 Examples for pre-training retrieval-extraction based language model Oct 25, 2021
Python 227 [CVPR 2022] Pre-Training 3D Point Cloud Transformers with Masked Point Modeling Jun 27, 2022
Python 3 Friend Ranking in Online Games via Pre-training Edge Transformers. SIGIR 2023 Jun 29, 2023
None 5 Large Language Models (LLMs) and Generative Pre-trained Transformers (GPTs) for Legal Mar 27, 2023
Python 2 Code of ACL 2022 paper Continual Pre-training of Language Models for Math Problem Understanding with … Jun 20, 2023
Python 6 Training and evaluation scripts for JGLUE, a Japanese language understanding benchmark Apr 12, 2023
None 180 PERT: Pre-training BERT with Permuted Language Model Aug 13, 2022
Python 631 Code for ALBEF: a new vision-language pre-training method Aug 13, 2022
Python 1072 MASS: Masked Sequence to Sequence Pre-training for Language Generation Aug 08, 2022
Python 17 [Arxiv2022] Revitalize Region Feature for Democratizing Video-Language Pre-training Apr 30, 2022
Python 108 Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing Aug 08, 2022