dlinputs

Input pipelines for large scale, sharded training of deep learning models.

Stars

39

Forks

11

Language

Jupyter Notebook

Last Updated

Jan 05, 2024

Similar Repos
Repo Language Stars Description Updated At
Python 3 Colossal-AI: A Unified Deep Learning System for Large-Scale Parallel Training Jan 31, 2023
Python 27 DeepGNN is a framework for training machine learning models on large scale graph data. Aug 05, 2022
Jupyter Notebook 13 Code for "CloudLeak: Large-Scale Deep Learning Models Stealing Through Adversarial Examples" (NDSS 2020) Apr 22, 2023
Scala 4 Training Large Scale Statistical Machine Translation Models on Spark Aug 18, 2019
Python 3 Training Large-scale Text Embedding Models with 🤗 Transformers Aug 26, 2023
Python 92 A high-performance distributed deep learning system targeting large-scale and automated distributed training. Jul 08, 2022
Python 21 Large-Scale Machine and Deep Learning in PyTorch. Jun 16, 2022
Python 52 Models and datasets for training deep learning automatic mixing models Mar 31, 2023
None 2 Models and datasets for training deep learning automatic mixing models Mar 29, 2024
Python 194 OpenMMLab Foundational Library for Training Deep Learning Models Sep 13, 2022
Python 2 A repository for training deep learning classification models Feb 28, 2023
Python 96 Traditional Machine Learning Models for Large-Scale Datasets in PyTorch. Apr 05, 2023
Jupyter Notebook 6 Training cell segmentation models using deep learning Apr 10, 2023
None 2 multi-agent deep reinforcement learning for large-scale traffic signal control. Nov 02, 2022
None 2 Data Platform for Large Scale Data Processing and AI & Machine Learning/Deep Learning Apr 03, 2019
Python 39 PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021 May 30, 2022
Julia 86 Large scale Gaussian Mixture Models May 21, 2023
Python 4 QGIS plugin to aid training Deep Learning Models Aug 15, 2022
Python 2 Components for training large language models Nov 22, 2022
Python 68 Evaluation suite for large-scale language models. Jul 07, 2022
Java 9 Building Training Datasets for Deep Learning Models in Software Engineering Nov 24, 2022
Python 165 Efficient Large-Scale Fleet Management via Multi-Agent Deep Reinforcement Learning Apr 07, 2023
Go 2 Trayne is a distributed machine learning platform for training models at scale Jan 17, 2023
Shell 4 Plug-and-Play deep learning for image segmentation of large-scale microscopy data May 02, 2022
Julia 5 Interfaces for deep learning data pipelines. Feb 17, 2022
Python 1938 Deep Learning Pipelines for Apache Spark Aug 11, 2022
Python 55 Deep Learning Pipelines for Apache Spark Mar 31, 2023
Go 3 Toolkits for training deep learning models built on top of gotch - Pytorch deep learning … Jul 14, 2022
Jupyter Notebook 2 Code for training and testing deep learning based land cover models. Aug 04, 2021
None 13 Training and deployment of deep learning models for satellite & aerial imagery Apr 19, 2023
Python 2 Training compact deep learning models for video classification using circulant matrices Dec 21, 2020
C++ 15 Volumetric data sampler and streamer for training 3D deep learning models. Nov 08, 2021
Python 156 Exploring Visual Prompts for Adapting Large-Scale Models Apr 29, 2023
Python 161 Large-scale pretrained models for goal-directed dialog Aug 08, 2022
Python 1060 A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models Oct 16, 2022
Python 3 A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models Apr 20, 2021
None 2 A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models Nov 05, 2021
None 2 A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models Nov 15, 2023
Python 5 PyTorch extensions for high performance and large scale training. Jul 24, 2021
Python 1842 PyTorch extensions for high performance and large scale training. Aug 19, 2022
Python 102 Galileo library for large scale graph training by JD Jun 14, 2022
None 2 PyTorch extensions for high performance and large scale training. Sep 22, 2021
None 83 Training & Quantization of embedded friendly Deep Learning / Machine Learning / Computer Vision models Jun 17, 2022
Python 36 A large-scale video dataset for the training and evaluation of 3D human pose estimation models Apr 13, 2023
Python 10 PyDCD: A Deep Learning-Based Community Detection Software in Python for Large-scale Networks Mar 05, 2023
Python 81 Training pipelines for Firefox Translations neural machine translation models Aug 09, 2022
Python 3 Tools and training scripts for large language models Mar 28, 2023
Jupyter Notebook 2 Deep Learning Models Jul 13, 2022
Python 3149 Ongoing research training transformer models at scale Aug 10, 2022
None 2 Ongoing research training transformer models at scale Jun 17, 2022