#inference · dorkhub

Sipp

AI inference, packed simply. A blazing-fast, zero-dependency WebGPU runtime to run GGUF models directly in the browser.…

Rust★ 100

ai cpp gguf inference llamacpp llm local-ai rust

@noumena-labs

browser-vector-search

Full in-browser Semantic Search with Huggingface Transformers.js and ElectricSQL's PGlite!

JavaScript★ 108

huggingface inference pglite postgres supabase transformerjs webgpu

@thorwebdev

inference

High-performance Ultralytics YOLO inference in Rust with ONNX Runtime, GPU backends, CLI, and WebGPU/WASM.

Rust★ 132

cli computer-vision coreml cuda depth-estimation image-classification inference object-detection

@ultralytics

InferenceHelper

C++ Helper Class for Deep Learning Inference Frameworks: TensorFlow Lite, TensorRT, OpenCV, OpenVINO, ncnn, MNN, SNPE,…

C++★ 297

cpp deep-learning deeplearning inference mnn ncnn nnabla opencv

@iwatake2222

PyTorch-CPP

PyTorch C++ inference with LibTorch

C++★ 337

cpp demo imagenet inference libtorch opencv pytorch pytorch-cpp

@BIGBALLON

tensorflow-cmake

TensorFlow examples in C, C++, Go and Python without bazel but with cmake and FindTensorFlow.cmake

CMake★ 443

c cmake cpp cuda deep-learning golang inference opencv

@PatWie

vidur

Accurate, large-scale, and extensible simulator for LLM inference Systems

Python★ 649

inference llm simulation transformer vllm

@microsoft

emlearn

Machine Learning inference engine for Microcontrollers and Embedded devices

Python★ 745

c classifier embedded-systems inference keras machine-learning microcontroller neural-networks

@emlearn

ims

📚 Introduction to Modern Statistics - A college-level open-source textbook with a modern approach highlighting multiva…

JavaScript★ 938

bootstrap-confidence-intervals inference modern-statistics openintro rstats simulation statistics

@OpenIntroStat

agibot_x1_infer

The inference module for AgiBot X1.

C++★ 1.8k

inference open-source robotics

@AgibotTech

jetson-inference

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA…

C++★ 8.9k

caffe computer-vision deep-learning digits embedded image-recognition inference jetson

@dusty-nv