Stars
183
Forks
25
Language
Python
Last Updated
Feb 26, 2024
Similar Repos
| Repo | Language | Stars | Description | Updated At |
|---|---|---|---|---|
| Python | 9 | [ICLR 2023] Masked Frequency Modeling for Self-Supervised Visual Pre-Training | Apr 29, 2023 | |
| Python | 1072 | MASS: Masked Sequence to Sequence Pre-training for Language Generation | Aug 08, 2022 | |
| Python | 16 | Masked Structural Growth for 2x Faster Language Model Pre-training | Jan 21, 2024 | |
| Python | 17 | Pre-training BERT masked language models with custom vocabulary | Feb 19, 2023 | |
| Python | 111 | Voxel-MAE: Masked Autoencoders for Pre-training Large-scale Point Clouds | Oct 19, 2022 | |
| Python | 120 | [NeurIPS 2022] Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-training | Apr 24, 2023 | |
| Python | 4 | Pre-training Machine-Reader (Instead of Masked Language Model) at Scale | Jun 03, 2023 | |
| Python | 495 | VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training | Aug 12, 2022 | |
| None | 9 | Learning Visual Prior via Generative Pre-Training | May 24, 2023 | |
| Python | 227 | [CVPR 2022] Pre-Training 3D Point Cloud Transformers with Masked Point Modeling | Jun 27, 2022 | |
| Python | 233 | Grid features pre-training code for visual question answering | Aug 09, 2022 | |
| None | 7 | The Pytorch implementation of paper: Masked Spectrogram Prediction For Self-Supervised Audio Pre-Training | Apr 28, 2022 | |
| Python | 218 | MPNet: Masked and Permuted Pre-training for Language Understanding https://arxiv.org/pdf/2004.09297.pdf | Aug 08, 2022 | |
| Python | 87 | The official code for PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization | Aug 11, 2022 | |
| Python | 4 | The repo for "Revisiting Pre-training in Audio-Visual Learning" | Mar 23, 2023 | |
| None | 36 | [CVPR 2023] MV-JAR: Masked Voxel Jigsaw and Reconstruction for LiDAR-Based Self-Supervised Pre-Training | May 04, 2023 | |
| Python | 6 | Mosaic Representation Learning for Self-supervised Visual Pre-training (ICLR2023, Spotlight) | Apr 09, 2023 | |
| Python | 16 | Code for ISBI 2023 paper "Self Pre-training with Masked Autoencoders for Medical Image Classification and … | Jul 04, 2023 | |
| Jupyter Notebook | 2 | Visual and Vision-Language Representation Pre-Training with Contrastive Learning | May 07, 2023 | |
| Python | 87 | SimVTP: This repo is the official implementation of "Simple Video Text Pre-training with Masked Autoencoders" | Apr 21, 2023 | |
| None | 4 | Codes and Pre-trained models for RAMM: Retrieval-augmented Biomedical Visual Question Answering with Multi-modal Pre-training | Mar 13, 2023 | |
| None | 9 | Official implementation for "Diffusion-Based Scene Graph to Image Generation with Masked Contrastive Pre-Training" https://arxiv.org/abs/2211.11138 | Nov 22, 2022 | |
| Python | 63 | [MICCAI-2022] This is the official implementation of Multi-Modal Masked Autoencoders for Medical Vision-and-Language Pre-Training. | Apr 19, 2023 | |
| None | 7 | UniLM - Unified Language Model Pre-training / Pre-training for NLP and Beyond | Jun 03, 2022 | |
| None | 30 | reStructured Pre-training | Jun 27, 2022 | |
| Jupyter Notebook | 678 | Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations". | Sep 09, 2022 | |
| None | 5 | This is the official implementation of the paper - GeoMAE: Masked Geometric Target Prediction for … | Apr 26, 2023 | |
| None | 42 | Multi-modality pre-training | Aug 02, 2022 | |
| Jupyter Notebook | 8 | Code for structure preserving pre-training | Nov 22, 2022 | |
| Jupyter Notebook | 110 | Official repository for "Revisiting Weakly Supervised Pre-Training of Visual Perception Models". https://arxiv.org/abs/2201.08371. | Jul 21, 2022 | |
| None | 83 | MixMIM: Mixed and Masked Image Modeling for Efficient Visual Representation Learning | May 05, 2023 | |
| Python | 574 | Grounded Language-Image Pre-training | Sep 01, 2022 | |
| Python | 59 | Multitask Multilingual Multimodal Pre-training | Jul 14, 2022 | |
| Python | 5 | Grounded Language-Image Pre-training | Mar 31, 2023 | |
| Python | 48 | HeBERT: Pre-training BERT for modern Hebrew | Aug 06, 2022 | |
| Python | 756 | Strategies for Pre-training Graph Neural Networks | May 02, 2023 | |
| Python | 2 | Code for pre-training BabyLM baseline models. | May 28, 2023 | |
| Python | 224 | Unsupervised Language Model Pre-training for French | May 28, 2023 | |
| Python | 90 | Pre-training code for Amber 7B LLM | Jan 14, 2024 | |
| JavaScript | 6 | Johnny-five blockly visual programming environment for robotics & sensors | Oct 29, 2020 | |
| Python | 162 | Official implementation for the paper "Prompt Pre-Training with Over Twenty-Thousand Classes for Open-Vocabulary Visual Recognition" | Apr 22, 2023 | |
| Python | 88 | Efficient Training (including pre-training and fine-tuning) for Big Models | Aug 12, 2022 | |
| Python | 8 | Official Repo for ICLR2022 paper : Should we be Pre-Training ? Exploring End-Task Aware Training … | Feb 21, 2023 | |
| Python | 953 | Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN | Aug 03, 2022 | |
| Python | 3 | Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo | Oct 11, 2022 | |
| None | 3 | Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo | Feb 17, 2023 | |
| Jupyter Notebook | 20 | Simplified Source Code Pre-Training for Vulnerability Detection | Sep 02, 2022 | |
| Python | 37 | Pre-training script for BART in JAX/Flax | Aug 11, 2022 | |
| Jupyter Notebook | 89 | CLIP (Contrastive Language–Image Pre-training) for Italian | Jun 30, 2022 | |
| Python | 118 | EMNLP 2021 - Pre-training architectures for dense retrieval | May 18, 2022 |