Powerful Intel Arc Graphics and DirectML Collaboration
Now Intel and Microsoft are showcasing their collaborative engineering efforts to facilitate cutting-edge generative AI workloads on Intel GPUs running Windows, in conjunction with the Microsoft Ignite developer conference
The Intel Arc A770 GPU, the flagship model in this family, has 16GB of high-bandwidth GDDR6 memory in addition to Intel Xe Matrix Extensions, a potent AI acceleration technology (Intel XMX.)
The customized XMX array provides exceptional performance for applications requiring generative AI, particularly for matrix multiplication
Intel and Microsoft have collaborated to enhance DirectML compatibility with Intel Arc graphics solutions, ranging from the Intel Arc A770 GPU to the Intel Arc GPUs integrated into the next Core Ultra mobile CPUs (also known as Meteor Lake)
Olive has just been upgraded with enhancements centered around some of the most fascinating new artificial intelligence models, such as the Llama 2 big language model from Meta and the Stable Diffusion XL text-to-image generator from Stability AI
Olive-optimized version of Stable Diffusion 1.5 works on the Intel Arc A770 GPU via the ONNX Runtime with the DirectML execution provider at a performance that is twice as fast as the default model, demonstrating the potential of this tool
The net effect is a cumulative acceleration of the Intel Arc A770’s Stable Diffusion 1.5 by up to 2.7 times.