Top-End AI Training Inspur NF5488A5 8x NVIDIA A100 server with AMD EPYC

Main site article: https://www.servethehome.com/inspur-nf5488a5-8x-nvidia-a100-hgx-platform-review-amd-epyc/
STH Merch on Spring: https://the-sth-merch-shop.myteespring.co/
STH Top 5 Weekly Newsletter: https://eepurl.com/dryM09
STH Forums: https://forums.servethehome.com/

In this video, we take a look a the Inspur NF5488A5 which packs eight NVIDIA A100 40GB/ 80GB GPUs and two AMD EPYC 7002/ 7003 series processors into a 4U server that can rival and beat the NVIDIA DGX A100.

----------------------------------------------------------------------
Timestamps
----------------------------------------------------------------------
00:00 Introduction
03:17 Understanding Different NVIDIA A100 Platforms
06:16 A Look at the NVIDIA HGX A100 8 GPU Delta
08:24 Additional Inspur NF5488A5 Hardware Overview
10:00 The AMD EPYC Rome/ Milan Server
14:17 Power Consumption and Rack Planning
16:20 Inspur NF5488A5 over DGX A100
17:31 Performance
17:53 Wrap-up

----------------------------------------------------------------------
Other STH Content Mentioned in this Video
----------------------------------------------------------------------
- Inspur NF5488M5 Intel + NVIDIA V100 Review: https://youtu.be/2FV5zHO1z1M
- AMD EPYC 7003 "Milan" Launch: https://youtu.be/b2bEoW6FcBA