Inspur NF5688M6
NF5688M6 is a new generation of NVLink AI server developed by Inspur for ultra-large-scale data centers with high performance, high compatibility and strong expansion. It is the first to support 2 Intel latest Ice Lake CPUs and 8 NVIDIA latest NVSwitch fully interconnected in 6U space. 500W A100 GPU. NF5688M6 is the industry's first air-cooled product that supports 500W A100 GPU, and can provide up to 12 PCIe expansion products, and supports self-developed dual-wide N20X, NV DPU and other smart network cards. Combined with the leading AI computing resource sched -uleing platform AIStation, it fully releases the powerful AI computing performance of up to 5 pe-taFLOPS.
Leading Technology
- 2 Intel Ice Lake processors, using 10nm process
- 8 NVIDIA A100 GPUs, 600GB/s bandwidth NVSwitch fully interconnected
- Support multi-instance GPU (MIG), greatly improving GPU resource utilization
- Up to 10 200G HDR InfiniBand, high-speed interconnection expansion
Stable Quality
- Support hard/soft RAID scheme to ensure data security
- N+N redundant power supply to ensure reliable operation of the system
- Optimized heat dissipation design to support stable work under high ambient temperature
- Intelligent remote management to quickly locate faults
Optimal Qesign
- The industry's only air-cooled support 500W A100 GPU
- High performance ratio, GPU: computing IB: storage IB=8:8:2
- Modular design, flexible operation, easy operation and maintenance
- Leading support for Inspur N20X, NV-DPU, A/T customer smart network card
Excellent Ecology
- Extensive and mature x86+CUDA global development ecology
- Leading deep learning framework support, TensorFlow/PyTorch/flying paddle, etc.
- Efficiently support large-scale CV/NLP/NMT/DLRM model training and inference
- Easily connect with Yuannao ecosystem partners and provide rich industry AI solutions
Technical Specifications
| Model | NF5688M6 |
| Height | 6U |
| GPU | 1* HGX A100 8GPU |
| CPU | 2* 3rd Intel® Xeon® IceLake scalable processors, TDP 270W, support 3 UPI interconnections |
| Chipset | Intel® C621A Series Chipset (Lewisburg-R) |
| Memory | 32* DDR4 RDIMM/LRDIMM, up to 3200MT/s |
| Storage | 8* 2.5’’ NVMe SSD or 16* 2.5’’ SATA/SAS SSD |
| M.2 | On-board 2* NVMe/SATA M.2 |
| PCIe | 10* PCIe 4.0 x16 slots，2* PCIe 4.0 x16 slots (PCIe 4.0 x8 rate) or 6*PCIe 4.0 x16 |
| RAID | Optional support RAID0/1/10/5/50/6/60, etc., support Cache super capacitor protection, provide RAID state migration, RAID configuration memory |
| NIC | Optional 1 PCIe 4.0 x16 OCP 3.0 network card, rate support 10G/25G/100G |
| Front I/O | 1* USB 3.0，1* USB 2.0，1* VGA，1* RJ45 management port |
| Rear I/O | 1* USB 3.0，1* VGA |
| Management | Built-in BMC remote management module, support Redfish/IPMI/SOL/KVM, etc. |
| OS | Red Hat Enterprise 7.8 64bit、CentOS 7.8、Ubuntu 18.04 or higher version |
| Cooling | N+1 redundant hot-swappable fans |
| Power | 6* 3000W 80Plus platinum power supply, support 3+3 redundancy |
| Size (W*H*D) | 447mm * 263.9mm * 850mm |
| Temperature | 10℃~35℃/50℉~95℉ |
| Full Load Weight | ≤88kg |
