Portail Showcases BitNet B1.58 SIMD Kernels, Benchmarks
TL;DR. Vaked.dev's Constellation portal presents technical details and performance benchmarks for BitNet b1.58 SIMD kernels, achieving 16.9k tok/s. - The showcase includes Headroom weight compression charts and a D3.js knowledge graph. - Benchmarks highlight an 8.0x FP16 compression and 98.4% Q&A similarity accuracy. - Real-time latency tracking across eight fleet nodes shows an average response time of 15ms.
- Public showcase details BitNet b1.58 SIMD kernels
- Performance benchmarks show 16.9k tok/s and 8.0x FP16 compression
- Headroom weight compression charts and D3.js knowledge graph are included
Sources
- Portail – Sovereign Rust AI Gateway and BitNet B1.58 SIMD Tensor Engine — portail-vaked-dev.pages.dev