Gaudi 2 Intel Tests GenAI vs NV H100

Intel Gaudi 2 is Still the Only Benchmarked Option Besides NV H100

The results of the industry-standard MLPerf v4.0 benchmark for inference were released by MLCommons

The Gaudi 2 Intel AI accelerator is still the sole benchmarked substitute for the Nvidia H100

The average improvement in Intel’s 5th Gen Xeon results over 4th Gen Intel Xeon processors was 1.42x

This robust GPU is intended for usage in data centres for applications such as real-time deep learning inference

The H100 offers up to 7x better performance for HPC workloads than prior versions

The popular large language models (LLMs) and multimodal models that are covered by the Intel Gaudi software package are still growing