cramBERT

Training BERT with relatively few compute resources.

Stars

2

Forks

0

Language

Python

Last Updated

Sep 27, 2023

Similar Repos
Repo Language Stars Description Updated At
Python 987 Cramming the training of a (BERT-type) language model into limited compute. Mar 19, 2023
Python 19 Training BERT on ABCI Oct 04, 2021
Python 4 Few-shot text classification with meta learning and BERT Apr 16, 2022
None 180 PERT: Pre-training BERT with Permuted Language Model Aug 13, 2022
Python 13 Code for co-training large language models (e.g. T0) with smaller ones (e.g. BERT) to boost … May 17, 2023
Jupyter Notebook 4 Yelp Bert Training and Prediction Apr 04, 2023
Python 17 Pre-training BERT masked language models with custom vocabulary Feb 19, 2023
Python 10 BERT for Distributed PyTorch + AMP Training Mar 15, 2023
Jupyter Notebook 7 Training a BERT model from scratch. Apr 18, 2023
Python 203 Enhancing the BERT training with Semi-supervised Generative Adversarial Networks Sep 09, 2022
Jupyter Notebook 3 Image Classifier example with few training samples using Tensorflow with Keras Jan 30, 2020
JavaScript 5 React Training: Resources Mar 14, 2022
Jupyter Notebook 4 pre-training your own BERT modelfrom scratch Mar 05, 2023
Python 48 HeBERT: Pre-training BERT for modern Hebrew Aug 06, 2022
Jupyter Notebook 392 iBOT :robot:: Image BERT Pre-Training with Online Tokenizer (ICLR 2022) Aug 11, 2022
Python 3 CLI for training multiclass and multilabel text classification models with BERT. Jan 21, 2022
Python 7297 Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型） Aug 15, 2022
Rust 315 Sample code for compute shader 101 training Aug 06, 2022
None 5 Sample code for compute shader 101 training Jul 06, 2022
None 15 Few resources for recording Oculus Passthrough experiences with scrcpy Mar 08, 2023
Python 12 BERT model training impelmentation using 1024 A100 GPUs for MLPerf Training v1.1 Apr 27, 2022
Python 85 [NAACL'22] TaCL: Improving BERT Pre-training with Token-aware Contrastive Learning Mar 30, 2023
Shell 3 Resources for Kafka Training Feb 18, 2022
Dart 6 Dart & Flutter Training resources Sep 29, 2022
None 2 Training resources for Gatsby May 30, 2019
Python 12 Expanded KR-BERT by adding more training data Feb 18, 2023
Python 55 Training neural audio classifiers with few data − https://arxiv.org/abs/1810.10274 Sep 07, 2022
Python 10 Auto create GitHub resources with just a few input values Oct 04, 2022
Python 2 PCBERT: Parent and Child BERT for Chinese Few-shot NER May 04, 2023
Shell 2 Common compute resources for Sage data scientists Aug 02, 2022
Go 2 Programmatic management of high performance compute resources. Jul 23, 2021
Python 32 A simple PyTorch implementation of BERT, complete with pretrained models and training scripts. Aug 31, 2022
Jupyter Notebook 79 Enhancing the BERT training with Semi-supervised Generative Adversarial Networks in Pytorch/HuggingFace May 20, 2023
Python 3 Enhancing the BERT training with Semi-supervised Generative Adversarial Networks and LIME visualizations May 06, 2022
Jupyter Notebook 4 KG-IQA: Knowledge-Guided Blind Image Quality Assessment with Few Training Samples Jan 15, 2024
Python 71 PyTorch implementation of BERT in "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding" Sep 02, 2022
Python 5223 Chinese version of GPT2 training code, using BERT tokenizer. Sep 12, 2022
None 23 Chinese version of GPT2 training code, using BERT tokenizer. Apr 10, 2023
None 4 Training resources for geospatial computing Mar 09, 2022
None 4 Resources for Julia training session Oct 02, 2022
HTML 3 R training resources and guides. Jun 23, 2021
Jupyter Notebook 18 Additional Resources for GCP Training Mar 24, 2022
HTML 18 Resources and recipes for training Feb 15, 2023
None 2 Training and workforce development resources Aug 26, 2022
Jupyter Notebook 26 Compute training dynamics, plot data cartography, analysing data quality... Apr 20, 2023
None 2 A few useful resources for iOS developers Sep 26, 2016
Python 15 Implementation of pre-training model loading architecture of bert and its variants with tensorflow2 Feb 06, 2021
Jupyter Notebook 4 A respoitory containing resources for screen share training with RDFlib Feb 16, 2022
Jupyter Notebook 381 BERT-NER (nert-bert) with google bert https://github.com/google-research. May 14, 2022
Python 6 multi gpu training in one machine for BERT from scratch Aug 27, 2020