The next generation of AI accelerators from Intel is finally here. At the Intel Vision event on April 9, 2024, the tech giant finally showed off the Intel Gaudi 3 AI Accelerator. This accelerator is set to compete with Nvidia’s AI GPUs, and we’ve finally gotten a good look at it.
The Gaudi 3 from Intel is based on a 5nm process node, putting it in direct competition with Nvidia’s upcoming H100 GPUs. For a while now, the Gaudi AI Accelerators have been the only competitor for Nvidia in this market, and it’s only set to heat up. The Intel Gaudi 3 will make use of the latest 5th Gen Tensor Core architecture, with two compute dies featuring 64 tensor cores.
Intel reveals the latest Gaudi 3 AI Accelerator at Intel Vision 2024
The GPUs will get up to 3.7 TB/s bandwidth and 128GB capacities, thanks to the eight HBM sites. Each of these is packed with 8-hi stacks of 16 Gb HBM2e. It also features a 96 MB cache pool across the two dies. The whole chip is built using the TSMC 5nm process node tech, with a total of 24 200GbE interconnect links.
The Gaudi 3 will be available in both Mezzanine OAM form factor, or HL-325L. This has up to 900W standard and liquid-cooled variants of over 900W. The Gaudi 3 HL-338 PCle will feature up to 600W TDP and have passive cooling. Besides these stats, it features all the OAM variant specifications.
Intel is making a big mark on the AI accelerator chip market with the Gaudi 3. This AI accelerator chip will be in direct competition with Nvidia. Nvidia has been dominating the market for a while now, but Intel is planning to go after them with the Gaudi 3. It’s likely built specifically to compete with the Blackwell chips Nvidia is bringing out. This AI chip war brewing is only going to get more intense. We’re excited to see how Intel measures up.
