Inside a MEGA AI GPU Server with the NVIDIA HGX H200

We take apart an NVIDIA HGX H200 8 GPU server from Aivres. The Aivres KR6288 is the company's Intel Xeon-powered AI server for the NVIDIA Hopper generation, and we have installed over 3.6Tbps of networking for a massive AI server.

STH Main Site Article:

Substack: axautikgroupllc.substack.com/
STH Top 5 Weekly Newsletter: eepurl.com/dryM09

----------------------------------------------------------------------
Become a STH YT Member and Support Us
----------------------------------------------------------------------
Join STH YouTube membership to support the channel: youtube.com/channel/UCv6J_jJa8GJqFwQNgNrMuww/join
Professional Users Substack: axautikgroupllc.substack.com/
----------------------------------------------------------------------
Where to Find The Unit We Purchased
Note we may earn a small commission if you use these links to purchase a product through them.
----------------------------------------------------------------------
STH Merch on Spring: the-sth-merch-shop.myteesprin...

----------------------------------------------------------------------
Where to Find STH
----------------------------------------------------------------------
STH Forums: forums.servethehome.com/
Follow on Twitter: twitter.com/ServeTheHome
Follow on LinkedIn: www.linkedin.com/company/servethehome-com/
Follow on Facebook: www.facebook.com/ServeTheHome/
Follow on Instagram: www.instagram.com/servethehome/

----------------------------------------------------------------------
Other STH Content Mentioned in this Video
----------------------------------------------------------------------
Touring the xAI Colossus:    • Inside the World's Largest AI Supercluster...  
NVIDIA HGX H100:    • Liquid Cooling High-End Servers Direct to ...  
NVIDIA HGX A100:    • Top-End AI Training Inspur NF5488A5 8x NVI...  
NVIDIA V100:    • Hands-on with an 8x NVIDIA Tesla V100 SXM3...  
NVIDIA P100:    • NVIDIA Tesla SXM2 GPU Installation in Deep...  
NVIDIA L40S:    • THIS is NVIDIA's New AI GPU for up to 10,0...  
NVIDIA Arm with A100:    • Now THIS is an Arm Server! Ampere Altra Ma...  

----------------------------------------------------------------------
Timestamps
----------------------------------------------------------------------
00:00 Introduction
02:45 NVIDIA HGX H200 Server Aivres KR6288 Hardware Overview
15:00 NVIDIA H200 Performance
16:00 NVIDIA H200 Power Consumption
18:21 Key Lessons Learned