echo-grpc-triton

Inference API server with echo and gRPC to triton server (golang)

Stars

11

Forks

1

Language

Go

Last Updated

Jan 18, 2024

Similar Repos
Repo Language Stars Description Updated At
Shell 2 gRPC echo-server with golang Oct 23, 2023
Go 15 Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server) Apr 08, 2023
Python 4 Deploy Detectron2 with Triton inference server Feb 01, 2023
Python 21 Tiny configuration for Triton Inference Server Mar 15, 2023
Python 7 Archives for Triton Inference Server Practices Apr 18, 2023
C++ 3 OneFlow Backend For Triton Inference Server Jan 06, 2022
Python 2 Triton inference server python backend examples Dec 20, 2023
None 3 Configure NVIDIA Triton Inference Server on different platforms. Deploy object detection model in Tensorflow SavedModel … Dec 14, 2022
Jupyter Notebook 28 FIL backend for the Triton Inference Server Aug 09, 2022
Go 2 REST API with golang, echo and gorm Feb 28, 2023
Go 30 Yet another gRPC echo server (YAGES) Mar 15, 2023
Python 66 This repository contains tutorials and examples for Triton Inference Server Apr 24, 2023
C++ 22 The core library and APIs implementing the Triton Inference Server. Aug 17, 2022
JavaScript 10 Demo to try out gRPC with NodeJS gRPC client and Golang gRPC server Mar 28, 2022
Jupyter Notebook 5 GPTQ inference Triton kernel Mar 28, 2023
Go 7 Golang echo server, using UDP Nov 03, 2022
Go 2 Golang protocol buffers and gRPC server May 31, 2023
Go 7 gRPC golang server boilerplate Jun 15, 2022
Python 3999 The Triton Inference Server provides an optimized cloud and edge inferencing solution. Aug 30, 2022
C++ 56 How to deploy open source models using DeepStream and Triton Inference Server Aug 13, 2022
C++ 2 How to deploy open source models using DeepStream and Triton Inference Server Aug 09, 2023
Go 4 An echo server written in golang and ❤️ Mar 17, 2023
Java 7 A simple echo server and client written using Vert.x and gRPC Dec 29, 2021
Go 2 gRPC echo template May 28, 2018
Go 4 Simple API written with GoLang using Echo framework Jan 29, 2021
Go 24 Golang with echo, gorm and GraphQL Jan 31, 2023
Go 113 gRPC server insterceptor for golang Aug 23, 2022
Go 14 golang grpc server/client tools Mar 04, 2023
Go 2 😎 Server to integrate with microservices in golang and gRPC May 01, 2022
JavaScript 2 Build a gRPC server with Golang, React, Envoy and Docker Feb 04, 2023
Go 2 golang with http framework echo, open API swagger ,docker and gorm. Jun 13, 2023
Python 5 AI Object detection server with Triton inference Server, Flask, Docker / docker 환경으로 flask와 triton … Nov 01, 2022
Go 8 Simple golang HTTP server to echo requests Oct 21, 2023
Go 7 Simple gRPC echo example Jan 24, 2023
CMake 5 Run dlib model inference as a gRPC server Oct 26, 2018
Python 154 Triton Model Analyzer is a CLI tool to help with better understanding of the compute … Aug 04, 2022
Python 4 Simple example of FastAPI + gRPC AsyncIO + Triton Aug 12, 2022
Go 2 Golang Mongodb Rest Api Example Using Echo Apr 25, 2021
Go 2 Golang Postgresql Rest Api Example Using Echo Dec 07, 2021
None 2 NLP demos with Triton Inferener server Apr 22, 2022
Dart 2 Example Golang gRPC server, Envoy proxy and Flutter frontend Jan 31, 2022
Rust 5 Proxy Profile Manager Server with gRPC API Mar 07, 2022
None 2 This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server Feb 27, 2021
Go 8 CRUD gRPC Template [Golang + GORM] Server&Client Apr 17, 2023
Python 3 Inference as a Service with Arm optimized Triton and a custom admission controller. Jan 16, 2023
Go 2 Microservices in Golang with gRPC and protobuf Mar 09, 2020
Go 6 CQRS Architecture With Golang, gRPC and NATS Feb 13, 2023
Go 12 Sample implementation of a Golang GraphQL server using gqlgen and Echo. Mar 11, 2023
Java 4 Use Android Java to implement grpc server and golang to implement grpc client demo Nov 04, 2022
None 11 golang, echo, gorm Aug 07, 2022