Pinned Loading

1. cactus cactus Public

   Tiny AI for tiny devices; quantization, kernels, inference engine for mobiles, wearables and smart home and robots.

   C++ 5.5k 448

2. needle needle Public

   Cactus foundation model for tiny devices; 14mb, 26m params, 1-6k toks/sec on mobiles, wearables smart home and robots.

   Python 3.3k 247

3. cactus-hybrid cactus-hybrid Public

   On-device models that know when they're wrong: every answer carries a confidence score for cloud handoff. Copy-paste quickstarts for Cactus, Transformers, llama.cpp and MLX.

   Shell 8 1