Stars
6
Forks
1
Language
Python
Last Updated
May 20, 2024
Similar Repos
| Repo | Language | Stars | Description | Updated At |
|---|---|---|---|---|
| Python | 16 | Masked Structural Growth for 2x Faster Language Model Pre-training | Jan 21, 2024 | |
| Python | 17 | Pre-training BERT masked language models with custom vocabulary | Feb 19, 2023 | |
| Python | 111 | Voxel-MAE: Masked Autoencoders for Pre-training Large-scale Point Clouds | Oct 19, 2022 | |
| Python | 120 | [NeurIPS 2022] Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-training | Apr 24, 2023 | |
| Python | 1072 | MASS: Masked Sequence to Sequence Pre-training for Language Generation | Aug 08, 2022 | |
| Python | 140 | Masked Visual Pre-training for Robotics | Apr 28, 2023 | |
| None | 7 | UniLM - Unified Language Model Pre-training / Pre-training for NLP and Beyond | Jun 03, 2022 | |
| Python | 224 | Unsupervised Language Model Pre-training for French | May 28, 2023 | |
| None | 180 | PERT: Pre-training BERT with Permuted Language Model | Aug 13, 2022 | |
| Python | 218 | MPNet: Masked and Permuted Pre-training for Language Understanding https://arxiv.org/pdf/2004.09297.pdf | Aug 08, 2022 | |
| Python | 3 | Examples for pre-training retrieval-extraction based language model | Oct 25, 2021 | |
| Python | 23 | CCQA A New Web-Scale Question Answering Dataset for Model Pre-Training | Jun 14, 2022 | |
| Python | 342 | Preprint: Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning | Jan 17, 2024 | |
| Python | 574 | Grounded Language-Image Pre-training | Sep 01, 2022 | |
| Python | 5 | Grounded Language-Image Pre-training | Mar 31, 2023 | |
| Python | 9 | [ICLR 2023] Masked Frequency Modeling for Self-Supervised Visual Pre-Training | Apr 29, 2023 | |
| Jupyter Notebook | 2 | Data processing and machine learning model training at scale with Dask clusters | Jan 28, 2023 | |
| Python | 9 | [AAAI 2023] CoMAE: Single Model Hybrid Pre-training on Small-Scale RGB-D Datasets | Mar 19, 2023 | |
| None | 6 | Pre-mRNA language model | Apr 19, 2023 | |
| Jupyter Notebook | 53 | Chinese Transformer Generative Pre-Training Model | Apr 02, 2023 | |
| Python | 32 | PALM: Pre-training an Autoencoding & Autoregressive Language Model for Context-conditioned Generation | Apr 22, 2023 | |
| Jupyter Notebook | 2 | Node embedding technique based on Masked Language Model. | Nov 28, 2023 | |
| Python | 2221 | Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo | Sep 10, 2022 | |
| None | 2 | Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo | Oct 12, 2020 | |
| Python | 227 | [CVPR 2022] Pre-Training 3D Point Cloud Transformers with Masked Point Modeling | Jun 27, 2022 | |
| Shell | 3 | training russian language model | Feb 21, 2023 | |
| Python | 1628 | Code and model for the paper "Improving Language Understanding by Generative Pre-Training" | Aug 10, 2022 | |
| Python | 2 | Code and model for the paper "Improving Language Understanding by Generative Pre-Training" | Jan 28, 2023 | |
| Python | 63 | [MICCAI-2022] This is the official implementation of Multi-Modal Masked Autoencoders for Medical Vision-and-Language Pre-Training. | Apr 19, 2023 | |
| Python | 3 | Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo | Oct 11, 2022 | |
| None | 3 | Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo | Feb 17, 2023 | |
| Python | 495 | VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training | Aug 12, 2022 | |
| None | 10 | Recent Advances in Vision-Language Pre-training! | Jul 20, 2022 | |
| None | 7 | Object Detection with Vision-Language Pre-training | Apr 10, 2023 | |
| None | 4 | Compress conventional Vision-Language Pre-training data | Jun 01, 2023 | |
| None | 819 | Open Language Pre-trained Model Zoo | Aug 23, 2022 | |
| None | 7 | The Pytorch implementation of paper: Masked Spectrogram Prediction For Self-Supervised Audio Pre-Training | Apr 28, 2022 | |
| Python | 238 | Python library & examples for Masked Language Model Scoring (ACL 2020) | Jul 29, 2022 | |
| Python | 27 | This is an example program illustrating BERTs masked language model. | Aug 02, 2022 | |
| Python | 254 | Code for training and evaluation of the model from "Language Generation with Recurrent Generative Adversarial … | May 04, 2023 | |
| Jupyter Notebook | 89 | CLIP (Contrastive Language–Image Pre-training) for Italian | Jun 30, 2022 | |
| HTML | 6 | Fill-in-the-BERT uses pre-trained BERT Masked Language Model for Infering the task of fill in the … | Apr 11, 2023 | |
| Python | 260 | BigDetection: A Large-scale Benchmark for Improved Object Detector Pre-training | Aug 31, 2022 | |
| Python | 6840 | Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities | Oct 06, 2022 | |
| Python | 56 | Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities | Aug 10, 2022 | |
| Python | 87 | The official code for PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization | Aug 11, 2022 | |
| Python | 4 | large language model training and deploy | Apr 25, 2023 | |
| Scala | 4 | Training Large Scale Statistical Machine Translation Models on Spark | Aug 18, 2019 | |
| Python | 953 | Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN | Aug 03, 2022 | |
| None | 825 | Open Chinese Language Pre-trained Model Zoo | Aug 13, 2022 |