Projects

Run any LLM locally. Use it from any language. Deploy anywhere. Drop-in Ollama replacement with native bindings for Python, Node.js, Go, PHP, Rust, and C/C++.

Run AI models directly on mobile devices. Flutter FFI plugin for on-device inference with vision, tool calling, and streaming.

A modular LLM inference runtime written in Rust. 47 model architectures, unified interface, type-safe and composable.

A bare-metal C unikernel for serving LLMs. No OS, no overhead. Boots directly on hardware and serves inference over HTTP.

Learn how LLMs work by building one in Zig. 18 model families, 285+ tests, progressive architecture from tensors to text.