floofloof@lemmy.ca to Technology@lemmy.worldEnglish · před 3 měsíciMotherboard sales are now collapsing amid unprecedented shortages fueled by AIwww.tomshardware.comexternal-linkmessage-square146linkfedilinkarrow-up1659arrow-down14file-textcross-posted to: technology@beehaw.orgpcgaming@lemmy.catechnology@lemmy.ziphackernews@lemmy.bestiver.se
arrow-up1655arrow-down1external-linkMotherboard sales are now collapsing amid unprecedented shortages fueled by AIwww.tomshardware.comfloofloof@lemmy.ca to Technology@lemmy.worldEnglish · před 3 měsícimessage-square146linkfedilinkfile-textcross-posted to: technology@beehaw.orgpcgaming@lemmy.catechnology@lemmy.ziphackernews@lemmy.bestiver.se
minus-squareboonhet@sopuli.xyzlinkfedilinkEnglisharrow-up3·před 3 měsíciYup, you want memory accessible to the GPU for local AI. AMD Strix Point and Mac devices are popular options. CPU can run LLMs but very slowly. I’ve got 32 GB of RAM and 8 VRAM and it’s borderline useless for models that don’t fit in the VRAM.
Yup, you want memory accessible to the GPU for local AI. AMD Strix Point and Mac devices are popular options. CPU can run LLMs but very slowly. I’ve got 32 GB of RAM and 8 VRAM and it’s borderline useless for models that don’t fit in the VRAM.