Benchmarking NVIDIA H200, Intel Preview Gaudi 3 Accelerator Card: Equipped with 128GB HBM3e RAM

The report states that Gaudi 3 adopts a 5nm process, with a bandwidth of 1.5 times that of the previous generation Gaudi 2 (7nm process), a power of 4 times that of BF16, and a network power of 2 times that of BF16.

Intel plans to release Gaudi 3 in 2024, equipped with up to 128GB of HBM3e RAM, significantly improving AI learning and training performance.

IT Home quoted the media as reporting that given that Gaudi 2 and Nvidia H100 are in the same tier, Gaudi 3 will benchmark against Nvidia H200 accelerator cards after its launch.

In addition to previewing the Gaudi 3 accelerator card, Intel also introduced the new Intel Max Series 1550 graphics card, which will be equipped in the newly launched Aurora supercomputer.

Aurora is the second mega second supercomputer in history, and once fully tuned, it may be the most powerful ever.

The Intel Max 1550 GPU scored 48.4 samples per second in the CosmicTagger single GPU training throughput benchmark test; As a comparison, AMD's MI250 score is 31.2 samples, while NVIDIA's A100 score is 14.7 samples.

In the CosmicTagger single node training benchmark, Intel's GPU scored 280 samples per second, while AMD and Nvidia's GPUs were 120 and 54.9, respectively.(From IT home)