Awesome-Rust-Neural-Network

A curated collection of Rust projects related to neural networks, designed to complement "Are We Learning Yet". I plan to submit libraries to "Are We Learning Yet" that are included in this project but currently missing from it.

This repository aims to provide a comprehensive overview of the Rust neural network ecosystem to identify the currently missing foundational infrastructure. Thus, it focuses more on the features, backends, and main dependencies of the Rust-based neural network projects. Note that the features, backends, and main dependencies are based on my own search and understanding, and may be incomplete or even incorrect.

Table of contents

• Awesome-Rust-Neural-Network
  • Table of contents
  • Neural Networks
  • Machine Learning
  • GPU Computing
  • Miscellaneous

Neural Networks

Name	Description	Features	Backends	Main Deps	Last Commit Time
candle	Minimalist ML framework for Rust	Like PyTorch, Training, Various Models	CPU, CUDA, CUDA NCCL, WASM	gemm, intel-mkl-src, cudarc, metal, accelerate-src	2025-06-07
burn	Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.	Various backends, Kernel Fusion, Training, Various Models, ONNX	WGPU, Candle, Torch, Ndarray, Remote	matrixmultiply, blas-src, libm, openblas-src, ndarray, candle-core, cubecl, cudarc, tch	2025-06-06
dfdx	Deep learning in Rust, with shape checked tensors and neural networks	Compile-time Checking	CPU, CUDA, WGPU	gemm, cudarc, wgpu	2024-01-25
luminal	Deep learning at the speed of light	Static Computation Graph, RISC-style arch, Kernel Fusion, Training	CPU, CUDA, Metal	matrixmultiply, cudarc, metal-rs	2025-06-04
autograph	A machine learning library for Rust	GPGPU kernels implemented with krnl	CPU, Vulkan	krnl, ndarray	2024-08-19
unda	General purpose machine learning crate	Compile to XLA	XLA	xla-rs	2024-06-19
custos	A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework	Array Manipulation, AutoDiff, Lazy Execution	CPU, OpenCL, CUDA, Vulkan, NNAPI	min-cl, libm, ash, naga, nnapi	2025-06-08
zyx	Tensor library for machine learning	Lazy Execution, AutoDiff	CUDA, OpenCL, WGPU	wgpu, vulkano, manual bindings to CUDA, OpenCL, and HSA	2025-05-13
zenu	A Deep Learning Framework Written in Rust	Training, AutoDiff	CPU, CUDA	cblas, openblas-src, manual binding to CUDA	2024-12-30
maidenx	A lightweight and fast AI framework in Rust focused on simplicity and performance	Educational focus, Mirror PyTorch's arch	CPU, CUDA	-	2025-04-23
ort	Fast ML inference & training for ONNX models in Rust	ONNX, Various Backends	CUDA, TensorRT, OpenVINO, oneDNN, DirectML, QNN, CoreML, ACL, TVM, CANN, etc.	ort-sys: Unsafe Rust bindings for ONNX Runtime 1.20	2025-06-04
tract	Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference	ONNX, Tensorflow	CPU, Metal	accelerate-src, blis-src, cblas, metal, ndarray, openblas-src, tensorflow, tflitec	2025-06-06
Kyanite	A neural network inference library, written in Rust	ONNX, Graph IR	CPU, CUDA	manual binding to CUDA	2024-07-13
mistral.rs	Blazingly fast LLM inference	LLM inference, safetensors, Quantization	CPU, CUDA, Metal	mkl, candle, metal, accelerate	2025-06-06
InfiniLM	A handwriting transformer model project developed from YdrMaster/llama2.rs	LLM Inference, Multiple backends supported	CPU, CUDA, OpenCL, Ascend, etc.	operators	2025-02-07
operators	Multi-hardware support operator library	Multi-hardware	CPU, CUDA, OpenCL, Ascend, Cambricon	clrt, infinirt, cuda-driver	2025-02-19
crabml	a fast cross platform AI inference engine using Rust and WebGPU	LLM Inference, mmap, Quantization	CPU, WGPU	vulkano, wgpu	2025-01-04
diffusion-rs	Blazingly fast inference of diffusion models	Diffusion, Quantization, DDUF, Offloading	CPU, CUDA, Metal, etc.	cudarc, intel-mkl-src, accelerate-sr, metal, gemm	2025-04-01
mmnn	rust-based bash-cli for Neural Network propagation/backpropagation	bash-cli, json-config	-	-	2025-04-13

Machine Learning

Name	Description	Features	Backends	Main Deps	Last Commit Time
adk-rust	Production-ready AI agent development kit for Rust	Model-agnostic (Gemini, OpenAI, Anthropic), Multi-agent, MCP, Telemetry	CPU	tokio, serde	2024-12
linfa	A Rust machine learning framework	like scikit-learn	CPU	ndarray, sprs	2025-05-26
jams-rs	Rust based model serving solution for popular machine learning frameworks	Model Store, PyTorch & Tenosrflow Models, Tree Models	PyTorch, TensorFlow, Catboost, LightGBM	tensorflow, tch, catboost-rs, lgbm, ndarray	2025-05-30
bullet	Specialised ML Library	Domain-specific, NNUE-style networks, chess engines	cudarc	-
redstone-ml	High-performance Machine Learning, Dynamic Auto-Differentiation and Tensor Algebra crate for Rust	AutoDiff, NdArrray	CPU, GPU	-	2025-06-07

GPU Computing

Name	Description	Features	Backends	Main Deps	Last Commit Time
cubecl	Multi-platform high-performance compute language extension for Rust	Kernels in Rust, CubeIR	WGPU, CUDA, HIP	cudarc, cubecl-hip-sys, ash, cubecl-spirv, wgpu	2025-06-05
krnl	Safe, portable, high performance compute (GPGPU) kernels	Kernels in Rust	Vulkan	rsprv, vulkano, ash	2024-05-28
EnzymeAD	A rust fork to work towards Enzyme integration	AutoDiff on LLVM	LLVM	Enzyme	2024-11-25
Rust-CUDA	Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust	Compiling Rust to PTX	CUDA	Binding	2025-05-26
Rust-GPU	Making Rust a first-class language and ecosystem for GPU shaders	Compiling Rust to SPIR-V	SPIR-V	Binding	2025-06-05
cudarc	Safe rust wrapper around CUDA toolkit	Mixture of safe and sys APIs	CUDA	Binding	2025-05-07
async-cuda	Asynchronous CUDA for Rust	Async, NPP	CUDA	Binding	2024-11-04
async-tensorrt	Asynchronous TensorRT for Rust	Async, TensorRT	CUDA	async-cuda, Binding	2025-04-30
cuda-rs	Rust wrapper for CUDA Driver (libcuda.so) and Runtime (libcudart.so) APIs	-	CUDA	Binding	2024-01-01
tensorrt-rs	Rust wrapper to NVIDIA TensorRT	TensorRT	CUDA	cuda-rs, Binding	2024-01-03

Miscellaneous

• gpu-allocator, GPU memory allocator for Vulkan, DirectX 12 and Metal. Written in pure Rust.
• ZLUDA, CUDA on non-NVIDIA GPUs.