Data centers have traditionally relied on central processing units to perform general-purpose computations. But generative AI models require more computing power. This can be achieved with graphics processing units and tensor processing units.
“Anytime you need large compute or advanced capabilities, chances are a CPU-only approach will not work for you,” said Chirag Dekate, VP analyst at Gartner.
CIOs and tech leaders at an individual enterprise with a cloud infrastructure will not necessarily need to think about the technology at the chip level, as that responsibility will be on cloud providers, Dekate said. But, over time, this could change.
