trans-fat

An FPGA Accelerator for Transformer Inference

Stars

56

Forks

10

Language

Jupyter Notebook

Last Updated

Mar 22, 2024

Similar Repos
Repo Language Stars Description Updated At
C++ 11 FPGA-based HyperLogLog Accelerator Apr 02, 2022
Python 5 Likelihood Inference Neural Network Accelerator Mar 07, 2023
Verilog 3 Tensor coprocessor (accelerator) on an FPGA. May 26, 2022
Tcl 5 An HBM FPGA based SpMV Accelerator Jun 22, 2023
VHDL 7 Engineering Program on RTL Design for FPGA Accelerator Aug 27, 2022
Tcl 8 Serpens is an HBM FPGA accelerator for SpMV Apr 17, 2023
None 18 PCIe adapter for an FPGA accelerator for Open CloudServer Apr 22, 2023
C++ 781 Fast inference engine for Transformer models Apr 25, 2023
C++ 2 An OpenCL-based FPGA Accelerator for Convolutional Neural Networks Sep 07, 2021
Jupyter Notebook 65 Dataflow QNN inference accelerator examples on FPGAs Aug 04, 2022
Scala 5 A Scalable BFS Accelerator on FPGA-HBM Platform Jun 21, 2022
Verilog 196 NVDLA (An Opensource DL Accelerator Framework) implementation on FPGA. May 03, 2023
C++ 83 A FPGA Based CNN accelerator, following Google's TPU V1. May 25, 2023
Python 14 Accompanying solution accelerator notebook for the Databricks blog on transformer models Apr 13, 2023
C++ 203 MTCNN C++ implementation with NVIDIA TensorRT Inference accelerator SDK Apr 30, 2023
C++ 22 An FPGA accelerator for general-purpose Sparse-Matrix Dense-Matrix Multiplication (SpMM). Aug 19, 2022
C++ 2 An FPGA accelerator for general-purpose Sparse-Matrix Dense-Matrix Multiplication (SpMM). Dec 01, 2022
C 2 An FPGA accelerator for CNN on the Fashion-MNIST dataset using HLS. Jun 12, 2022
C 10 Lecture Material on Deep Learning Inference using FPGA Feb 17, 2022
VHDL 2 Initial attempt at creating a ray tracing accelerator with an FPGA Apr 11, 2022
Tcl 5 The Accelerator Integration Tool (AIT) automatically integrates OmpSs@FPGA accelerators into FPGA designs using different vendor … Feb 08, 2023
Jupyter Notebook 222 Edge Inference in Browser with Transformer NLP model Oct 03, 2022
Python 471 LeViT a Vision Transformer in ConvNet's Clothing for Faster Inference Aug 04, 2022
Python 12 Accompanying solution accelerator notebook for the Databricks blog on parallel training and inference May 25, 2023
Python 2 Workflow on CNN utilization and inference in FPGA for embedded applications Jun 01, 2022
Jupyter Notebook 4 Transformer-guided diffusion for generative modeling and inference on set data. Apr 07, 2023
Cuda 179 Easy and Efficient Transformer : Scalable Inference Solution For Large NLP model Jul 15, 2022
Python 15 Latency and Memory Analysis of Transformer Models for Training and Inference May 04, 2023
C++ 16 Compact LSTM inference kernel (CLINK) designed in C/HLS for FPGA implementation. Aug 08, 2022
C++ 8 FleetRec: Large-Scale Recommendation Inference on Hybrid GPU-FPGA Clusters Jun 01, 2022
Python 13 Dual FMC FPGA carrier board developed for general purpose use in particle accelerator electronics instrumentation. May 15, 2022
Python 14 YOLO example implementation using Intuitus CNN accelerator on ZYBO ZYNQ-7000 FPGA board May 14, 2023
Python 69 Pytorch library for end-to-end transformer models training, inference and serving Dec 12, 2022
C 2 A Fully-mapped and Energy-efficient FPGA Accelerator for Dual-function AI-based Analysis of ECG Apr 16, 2023
None 2 collection of works aiming at reducing model sizes or the ASIC/FPGA accelerator for machine learning Feb 28, 2024
Jupyter Notebook 2 Light-weighted neural network inference for object detection on small-scale FPGA board Jan 15, 2022
C++ 94 optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052 Apr 18, 2023
Python 2 Online Inference API for NLP, Transformer models - summarization, text classification, sentiment analysis and more Apr 28, 2023
Python 37 (ICLR 2023 Spotlight) MPCFormer: fast, performant, and private transformer inference with MPC Apr 25, 2023
Verilog 6 An FPGA accelerator for all-pairs shortest-paths (using the Floyd-Warshall algorithm) - a systolic array based … Dec 08, 2022
Verilog 247 A compiler from AI model to RTL (Verilog) accelerator in FPGA hardware with auto design … Aug 07, 2022
None 2 A compiler from AI model to RTL (Verilog) accelerator in FPGA hardware with auto design … Dec 12, 2023
C++ 4 Accelerator Programming for HPC Jul 22, 2022
None 10 🐆 A compiler from AI model to RTL (Verilog) accelerator in FPGA hardware with auto … Jul 18, 2022
Python 1338 Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀 Apr 24, 2023
VHDL 4 bnn accelerator Jan 12, 2022
CSS 4 Accelerator @ DHS Jul 30, 2021
Python 3 Virtual accelerator Oct 08, 2021
Python 5 Accelerator test Apr 10, 2023
Python 7 Openmp Accelerator Mar 24, 2020