LocalLLaMA

2687 readers

30 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago

MODERATORS

SkySyrup@sh.itjust.works

pax@sh.itjust.works

noneabove1182@sh.itjust.works

NVIDIA's GeForce RTX 4090 With 96GB VRAM Reportedly Exists; The GPU May Enter Mass Production Soon, Targeting AI Workloads (wccftech.com)

submitted 1 week ago by Eyekaytee@aussie.zone to c/localllama@sh.itjust.works

2 comments fedilink hide all child comments

Maybe AMD's loss is Nvidias gain ?

you are viewing a single comment's thread
view the rest of the comments

[–] hendrik@palaver.p3x.de -1 points 1 week ago* (last edited 1 week ago) (1 children)

Hmmh, the 4090 is kind if the wrong choice for this, due to its memory bus width... For AI workloads and especially if you want to connect lots of memory, you kind of want the widest bus possible.

[–] kevin2107@lemmy.world 1 points 9 hours ago

but it has micorns ram