Text size
Nvidia’s latest AI supercomputer is powered by 256 of these Grace Hopper chips.
Courtesy of Nvidia
Generative artificial intelligence applications will soon receive a massive boost in computing power.
Monday,
Nvidia
(ticker: NVDA) announced its new DGX GH200 AI supercomputer powered by 256 GH200 Grace Hopper Superchips. That’s a lot of letters and numbers, but the specs are what matter most.
The new DGX system will enable the next generation of generative AI applications thanks to its larger memory size and larger-scale modeling capabilities, a
Nvidia
the executive said during a videoconference with reporters on Friday. The DGX GH200 will have nearly 500 times the memory of Nvidia’s DGX A100 system.
“The DGX GH200 AI supercomputers incorporate NVIDIA’s most advanced accelerated computing and networking technologies to push the frontiers of AI,” said Nvidia CEO Jensen Huang during his keynote address. COMPUTEX in Taiwan.
Nvidia chips are heavily exposed to generative AI, which has been all the rage since OpenAI released ChatGPT late last year. The technology brutally ingests text, images, and videos to create content.
Chatbots like ChatGPT use a language model that generates human-like responses, or their best guesses, based on word relationships found by digesting what has already been written on the internet or from other forms of text.
Nvidia expects its new supercomputer to enable developers to create better language models for AI chatbots, complex recommendation algorithms, and create more efficient fraud detection and data analytics.
The DGX GH200 incorporates 256 GH200 Superchips. Each Superchip has a GPU, which means the DGX GH200 will have 256 GPUs compared to 8 GPUs in the previous model.
There are two types of logic chips: central processing units (CPUs) which act as the main computing brains for PCs/servers and graphics processing units (GPUs) which are used for games and AI calculations.
Nvidia said Alphabet’s Google Cloud (GOOGL),
Meta
(META), and
Microsoft
(MSFT) will be among the first companies to gain access to the DGX GH200 to explore its generative AI capabilities. The system is expected to be available by the end of 2023. The company did not provide pricing.
Nvidia also announced that the GH200 Grace Hopper superchip has entered full production. The Superchip connects Nvidia’s Grace processor and GPU Hopper using its NVLink connection technology.
On Thursday, Nvidia shares soared 24% a day after the company provided a revenue forecast for the current quarter that was significantly above Wall Street expectations. The company’s management said the benefit came from substantial demand for its AI data center products from cloud providers, large consumer internet companies, start-ups and companies. other companies.
Email Tae Kim at tae.kim@barrons.com