schizoidman@lemm.ee to Technology@lemmy.worldEnglish · 16 days agoDeepSeek's distilled new R1 AI model can run on a single GPU | TechCrunchtechcrunch.comexternal-linkmessage-square20linkfedilinkarrow-up153arrow-down13
arrow-up150arrow-down1external-linkDeepSeek's distilled new R1 AI model can run on a single GPU | TechCrunchtechcrunch.comschizoidman@lemm.ee to Technology@lemmy.worldEnglish · 16 days agomessage-square20linkfedilink
minus-squareAvid Amoeba@lemmy.calinkfedilinkEnglisharrow-up1·16 days agoIt proved sqrt(2) irrational with 40tps on a 3090 here. The 32b R1 did it with 32tps but it thought a lot longer.
It proved sqrt(2) irrational with 40tps on a 3090 here. The 32b R1 did it with 32tps but it thought a lot longer.