embeddings

Training Large-scale Text Embedding Models with 🤗 Transformers

Stars

3

Forks

0

Language

Python

Last Updated

Aug 26, 2023

Similar Repos
Repo Language Stars Description Updated At
Python 14 Large-Scale Heterogeneous Feature Embedding Apr 24, 2023
Scala 4 Training Large Scale Statistical Machine Translation Models on Spark Aug 18, 2019
Python 1060 A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models Oct 16, 2022
Python 3 A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models Apr 20, 2021
None 2 A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models Nov 05, 2021
None 2 A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models Nov 15, 2023
C++ 5 LINE: Large-scale information network embedding Jun 08, 2020
C++ 1000 LINE: Large-scale information network embedding Apr 11, 2023
Jupyter Notebook 38 Input pipelines for large scale, sharded training of deep learning models. Sep 10, 2021
Python 3 Embedding and Visualization of large-scale graphs Oct 05, 2022
Python 41 Code for text augmentation method leveraging large-scale language models Aug 17, 2022
Jupyter Notebook 4 Transformers Workshop on behalf of ML India. Contains resource notebook for training/inferring large scale transformer … Apr 14, 2023
Julia 86 Large scale Gaussian Mixture Models May 21, 2023
Jupyter Notebook 9 Convenient Text-to-Text Training for Transformers Aug 22, 2022
Python 25 Research publication code for "Forward Compatible Training for Large-Scale Embedding Retrieval Systems", CVPR 2022. Aug 01, 2022
Python 11 LINE: Large-scale Information Network Embedding in PyTorch Sep 05, 2022
Python 39 PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021 May 30, 2022
Python 4 Fine-tuning large language models with huggingface transformers and deepspeed Jul 03, 2023
C++ 126 NetSMF: Large-Scale Network Embedding as Sparse Matrix Factorization Jan 10, 2023
None 19 Improving Text-to-Image Models with Large Language Models Mar 07, 2023
Python 27 DeepGNN is a framework for training machine learning models on large scale graph data. Aug 05, 2022
Python 231 A Large Scale Text Summarization Dataset Sep 15, 2022
C++ 9 distill large scale web page text Jul 14, 2023
Python 2 Components for training large language models Nov 22, 2022
Python 2 Tools for converting .mid files into text for training large language models May 22, 2023
Python 68 Evaluation suite for large-scale language models. Jul 07, 2022
C 2 EnKF code for DA with large-scale layered geophysical models. Jan 06, 2019
C 32 EnKF code for DA with large-scale layered geophysical models. May 02, 2023
Python 109 [CVPR2023] A faster, smaller, and better text-to-image model for large-scale training May 04, 2023
Python 350 Mistral: A strong, northwesterly wind: Framework for transparent and accessible large-scale language model training, built … Oct 12, 2022
Python 37 Large Scale Distributed Model Training with Colossal AI and Lightning AI Mar 18, 2023
Python 74 Simple large-scale training of stable diffusion with multi-node support. Apr 20, 2023
Python 3149 Ongoing research training transformer models at scale Aug 10, 2022
None 2 Ongoing research training transformer models at scale Jun 17, 2022
Python 4 Ongoing research training transformer models at scale Apr 18, 2023
Python 5 Ongoing research training transformer models at scale Dec 02, 2022
Python 14 Ongoing research training transformer models at scale Dec 08, 2023
Python 2 Ongoing research training transformer models at scale May 09, 2024
Python 2 Large scale web corpus of Austronesian text. Jan 17, 2022
Jupyter Notebook 65 A prompting enhancement library for transformers-type text embedding systems Apr 25, 2023
Python 188 EVA: Large-scale Pre-trained Chit-Chat Models Oct 16, 2022
Python 156 Exploring Visual Prompts for Adapting Large-Scale Models Apr 29, 2023
Python 161 Large-scale pretrained models for goal-directed dialog Aug 08, 2022
None 3 EMNLP 2020: "Dialogue Response Ranking Training with Large-Scale Human Feedback Data" May 27, 2022
Python 36 A large-scale video dataset for the training and evaluation of 3D human pose estimation models Apr 13, 2023
Python 5 PyTorch extensions for high performance and large scale training. Jul 24, 2021
Python 1842 PyTorch extensions for high performance and large scale training. Aug 19, 2022
Python 102 Galileo library for large scale graph training by JD Jun 14, 2022
None 2 PyTorch extensions for high performance and large scale training. Sep 22, 2021
HTML 4 Data Management in large-scale education research training series Feb 04, 2023