I bet this is just Jensen being furious that Microsoft got MI300X up and running for their AI needs.
I bet this is just Jensen being furious that Microsoft got MI300X up and running for their AI needs.Nvidia criticizes AI PCs, says Microsoft's 45 TOPS requirement is only good enough for 'basic' AI tasks
Nvidia says its GPUs provide substantially better AI-performance than today's bleeding edge NPUs.www.tomshardware.com
Stealing lunch money from NPUs?If you had any doubt what the focus of Blackwell is going to be...
No, like always their aim is to establish a perception of premium experience if you buy a nvidia graphics card. This time based on being able to run LLMs locally.Stealing lunch money from NPUs?
I'm sure NV will come up with a "LLM hardware compression" that'll somehow compress 5% and they'll present that as revolutionary.No, like always their aim is to establish a perception of premium experience if you buy a nvidia graphics card. This time based on being able to run LLMs locally.
Though I'm not sure how they're going to convince people their anemic VRAM amounts are adequate to run LLMs.
Laptop SoCs can often be paired with 32GB LPDDR nowadays, but getting lots of VRAM on consumer GPUs isn't compatible with nvidia's usual planned obsolescence.
The mental gymnastics for convincing people that 8-12GB is good enough for LLMs is going to be interesting to watch.
Now if AMD would only scale that down to consumer level with 32GB GDDR7 and it would become the mother of all APUs.Also this came out https://wccftech.com/amd-instinct-m...memory-up-to-4x-speedup-versus-discrete-gpus/ as a "hi" to Jensen.
No, like always their aim is to establish a perception of premium experience if you buy a nvidia graphics card. This time based on being able to run LLMs locally.
Though I'm not sure how they're going to convince people their anemic VRAM amounts are adequate to run LLMs.
Laptop SoCs can often be paired with 32GB LPDDR nowadays, but getting lots of VRAM on consumer GPUs isn't compatible with nvidia's usual planned obsolescence.
The mental gymnastics for convincing people that 8-12GB is good enough for LLMs is going to be interesting to watch.
Really? https://www.tomshardware.com/tech-i...wers-more-than-500-ai-models-the-company-saysBut Laptop SoC are likely too slow to very large LLMs. I don't see any push to run LLMs on SoCs...
Just come out and say that even a 3050 8GB is better for AI than an SoC's NPU.Consumer applications of AI will likely involve models optimized for 8GB.
Intel/AMD are working hard to prove your sire Jensen wrong.Hobbyist stuff can expand as much as you want, but if you want to run those massive models, you likely aren't going to choose an SoC.
The mental gymnastics for convincing people that 8-12GB is good enough for LLMs is going to be interesting to watch.
They're not. Microsoft / OpenAI know what they're doing when they're asking for 45TOPs for compliance.But Laptop SoC are likely too slow to very large LLMs. I don't see any push to run LLMs on SoCs...
5080 and 5090 will be announced at same time. Availability will be separated by few weeks...
New rumor alleging that AD203 based rtx 5080 expected to launch before rtx 5090, contradicting the rtx 50 is hurried and only rtx 5090 will come in 2024 rumors.
Since only rtx5080 is mentioned, then assumption is that rtx 5070(ti) based on GB205 will launch later. Possibly same timframe as AD104 based rtx4070ti had, so maybe a January 2025 window.
If January 2025 for GB205, then it (GB205 chip named 5070 or 5070ti) may get a mention at the GTC architecture unveiling with first party benchmarks and other marketing
As usual or you know something?5080 and 5090 will be announced at same time. Availability will be separated by few weeks...
There is a good argument against doing that... given that the 5080 is unlikely to be that much better in games than the 4090 because it should be too bandwidth limited. It may however have way better TOPs (at least on paper) so I suppose... but it seems like a better strategy to just release the 5090 and let the 4090 supply thin out before releasing the 5080.
What the hell is jensen cooking
It wouldn't have to be anything different than a really short PCIe riser, really.Kopite says the three PCBs are IO, PCIe connector, and the main GPU. PCIe connector is just that, a connector View attachment 99529
What are they using to connect those PCBs lol, there's 0.5 Terabits/s of data on that PCIe bus. I guess it's a flex cable of some kind.