serving

A flexible, high-performance serving system for machine learning models

Stars

8

Forks

1

Language

C++

Last Updated

Feb 29, 2024

Similar Repos
Repo Language Stars Description Updated At
C++ 5599 A flexible, high-performance serving system for machine learning models Aug 16, 2022
C++ 2 A flexible, high-performance serving system for machine learning models Nov 17, 2021
None 2 A flexible, high-performance serving system for machine learning models Apr 18, 2021
C++ 126 A flexible, high-performance serving system for machine learning models Oct 19, 2022
None 3 A flexible, high-performance serving system for machine learning models Nov 08, 2022
None 2 A flexible, high-performance serving system for machine learning models Mar 05, 2023
C++ 8 A flexible, high-performance serving system for machine learning models Sep 16, 2022
Java 117 A scalable, high-performance serving system for federated learning models Aug 02, 2022
C++ 9 High performance machine learning system May 11, 2020
C++ 5 A high-performance serving system for DeepRec based on TensorFlow Serving Apr 14, 2023
None 4 A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架） Mar 13, 2021
C++ 666 A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架） Aug 02, 2022
Python 8 A Python framework for serving machine learning models Apr 19, 2021
Python 45 Serve machine learning models using tensorflow serving Jul 23, 2022
C++ 5 High-performance Parallel Machine Learning Dec 08, 2018
Scala 12 akka http service for serving spark machine learning models Apr 16, 2020
Python 196 TensorFlow framework for training and serving machine learning models Mar 15, 2022
Java 2 Performance Evaluation of Machine Learning Models Apr 11, 2022
Python 3 A microservice for serving Machine Learning models created in Spark Apr 07, 2019
Python 117 funcX: High Performance Function Serving for Science Apr 17, 2023
JavaScript 752 Generic and easy-to-use serving service for machine learning models Jul 28, 2022
JavaScript 8 High-performance machine learning library for node.js and browsers Jun 28, 2021
Python 5 Interpret Machine Learning black-box models deployed on Serving Engine Jun 09, 2021
Julia 28 Distributed MCMC Inference in Dirichlet Process Mixture Models (High Performance Machine Learning Workshop 2019) Dec 02, 2021
C 2 High performance flexible btree library Apr 05, 2023
Python 69 classy is a simple-to-use library for building high-performance Machine Learning models in NLP. Jun 17, 2022
Python 104 A high-performance serving framework for ML models, offers dynamic batching and multi-stage pipeline to fully … Aug 27, 2022
Rust 23 A Machine Learning Framework for High Performance written in Rust Jul 18, 2022
C++ 70 A high performance data access library for machine learning tasks May 30, 2022
Scala 217 A Simple High Performance Computing Framework for [Federated] Machine Learning Jul 22, 2022
Ruby 16 Semantic, Flexible, Lightweight high-performance Role system with totally UI config Apr 12, 2022
Jupyter Notebook 5 Tools for evaluating and comparing performance of machine learning models Mar 15, 2023
Python 606 A high-performance topological machine learning toolbox in Python Aug 22, 2022
Python 6 Serving the deep learning models easily. Oct 06, 2021
Python 4 Deep learning models Serving with Python Mar 27, 2023
Python 23 High level API for using machine learning models in OpenMM simulations Jul 29, 2022
Julia 8 High-performance Julia package for online learning of binomial synaptic release models Jul 27, 2022
JavaScript 4 Machine learning logistics and serving platform Oct 11, 2021
C# 13 Universal, flexible, high-performance distributed ID generator May 21, 2022
C++ 258 A high-performance inference system for large language models, designed for production environments. Jan 17, 2024
Python 58 SHARK - High Performance Machine Learning for CPUs, GPUs, Accelerators and Heterogeneous Clusters Aug 30, 2022
C++ 5 High Performance WebAssembly Virtual Machine Sep 11, 2022
Jupyter Notebook 13 Python wrapper for the DPMMSubCluster Julia package for inference in Dirichlet Process Mixture Models (High … Jun 28, 2022
R 21 R package EloML: Elo rating system for machine learning models Jul 30, 2022
Jupyter Notebook 5 Machine Learning Model deployment for Container (TensorFlow Serving) Jan 07, 2022
Rust 311 High performance distributed framework for training deep learning recommendation models based on PyTorch. Jul 04, 2022
Python 30 a high-performance, lightweight and human friendly serving engine for scrapy Mar 01, 2022
None 7 Machine learning models. Mar 08, 2021
Jupyter Notebook 2 Machine Learning Models Feb 08, 2023
C# 182 High performance, cross-platform machine learning for Unity Engine. Register at https://hub.natml.ai Apr 27, 2023