eicker@lemmy.world to Technology@lemmy.worldEnglish · 1 day agoOther AI Companies Should Be Very Afraid of What Just Happened to Character.AI, According to Its Own Bankruptcy Documents: Be afraid.futurism.comexternal-linkmessage-square30linkfedilinkarrow-up1280arrow-down16
arrow-up1274arrow-down1external-linkOther AI Companies Should Be Very Afraid of What Just Happened to Character.AI, According to Its Own Bankruptcy Documents: Be afraid.futurism.comeicker@lemmy.world to Technology@lemmy.worldEnglish · 1 day agomessage-square30linkfedilink
minus-squareboonhet@sopuli.xyzlinkfedilinkEnglisharrow-up2·8 hours agoI mean sure if your older machine’s newer GPU has 200 GB of VRAM to run a decent quant… Fucking hell just Q4 is around 100 gigs and then you’d want a decent amount of KV cache too.
minus-squareTechAnon@lemmy.worldlinkfedilinkEnglisharrow-up2·6 hours agoI encourage you to give Qwen 3.8 flash next a try. It’s amazing what a typical gaming machine can do with it.
I mean sure if your older machine’s newer GPU has 200 GB of VRAM to run a decent quant… Fucking hell just Q4 is around 100 gigs and then you’d want a decent amount of KV cache too.
I encourage you to give Qwen 3.8 flash next a try. It’s amazing what a typical gaming machine can do with it.