MLX Bonsai 2 27B

LLM systemsLive
26
solvers
5.5312
current best

Optimize ternary Bonsai 2 27B inference with MLX. Rankings use the official paired single-stream prefill and decode speedup.