Shifu@lemmy.world to LocalLLaMA@sh.itjust.worksEnglish · 2 months agoBitNet b1.58-2B-4T at 36 tok/s on Xeon - pure C99, no Python/BLAS, single binary for ternary + GGUFplus-squaremessage-squaremessage-square0linkfedilinkarrow-up16arrow-down12
arrow-up14arrow-down1message-squareBitNet b1.58-2B-4T at 36 tok/s on Xeon - pure C99, no Python/BLAS, single binary for ternary + GGUFplus-squareShifu@lemmy.world to LocalLLaMA@sh.itjust.worksEnglish · 2 months agomessage-square0linkfedilink
