Quantcast
Channel: Fjoddes.Net
Viewing all articles
Browse latest Browse all 3484

AMD admits its Instinct MI300X AI accelerator still can’t quite beat Nvidia’s H100 Hopper

$
0
0

On Wednesday, AMD released benchmarks comparing the performance of its MI300X with Nvidia’s H100 GPU to showcase its Gen AI inference capabilities. For the LLama2-70B model, a system with eight Instinct MI300X processors reached a throughput of 21,028 tokens per second in server mode and 23,514 tokens per second in…

Read Entire Article


Viewing all articles
Browse latest Browse all 3484

Trending Articles