Compute Kernel Runtime for Vector Databases
Quick Start • Usage • Contributing
Zipy is a compute kernel runtime built in Rust that manages CPU, RAM, GPU, and VRAM resources for vector database operations specifically on edge devices or cheap hardware. It decides where each operation runs and handles data movement automatically.
- Manages CPU threads, RAM allocation, GPU memory, VRAM pooling
- Automatic CPU vs GPU scheduling
- Zero-copy transfers with DMA
- Works on NVIDIA, AMD, Intel, Apple GPUs
- Standalone library or use with Piramid
TBD.
TBD.
Built by @ashworks1706 as the compute layer for Piramid.