Shatur@discuss.tchncs.de to LocalLLaMA@sh.itjust.worksEnglish · 23 days agoKV Cache Quantization Benchmarks for Long Contextanbeeld.comexternal-linkmessage-square1linkfedilinkarrow-up113arrow-down10
arrow-up113arrow-down1external-linkKV Cache Quantization Benchmarks for Long Contextanbeeld.comShatur@discuss.tchncs.de to LocalLLaMA@sh.itjust.worksEnglish · 23 days agomessage-square1linkfedilink
minus-squarepepperfree@sh.itjust.workslinkfedilinkEnglisharrow-up1·18 days agoIs tcq better than kvarn?