NVIDIA B200的超級系統超過上一代的3倍

Super Micro Computer，Inc。 （SMCI），AI/ML，HPC，Cloud，Storage和5G/Edge的全部IT解決方案提供商

Leading industry-standard performance in select MLPerf V5.0 Inference benchmarks is announced today by Super Micro Computer, Inc. (Nasdaq: SMCI), a premier provider of complete IT solutions for AI/ML, HPC, cloud, storage, and 5G/edge.

Super Micro Computer，Inc。 （NASDAQ：SMCI）今天宣布了精選MLPERF V5.0推理基準的領先行業標準性能，這是AI/ML，HPC，Cloud，Storage和5G/Edge的完整IT解決方案的總理提供商。

In several V5.0 Inference benchmarks, Supermicro systems achieved the best performance. The company's 4U liquid-cooled and 10U air-cooled systems, which used the NVIDIA HGX B200 8-GPU, outperformed H200 8-GPU systems by more than 3 times in the generation of tokens per second (Token/s) for the Llama2-70B and Llama3.1-405B benchmarks.

在幾個V5.0推理基準測試中，SuperMicro系統實現了最佳性能。該公司的4U液冷和10U氣冷系統，使用NVIDIA HGX B200 8-GPU，在每秒代幣（llama2-70b和Llama3.1-405b benchmarkss）的代幣（soken/s）中，每秒鐘（soken/s）的產生代價超過3倍以上。

"We are pleased to see the first new benchmarks from MLCommons in 2025, with Supermicro remaining a leader in the AI industry," said Charles Liang, president and CEO of Supermicro. "Our building block architecture allows us to be first to market with a diverse range of systems optimized for various workloads. We continue to collaborate closely with NVIDIA to fine-tune our systems and secure a leadership position in AI workloads."

Supermicro總裁兼首席執行官Charles Liang說：“我們很高興看到2025年MLCommons的第一個新基準，Supermicro仍然是AI行業的領導者。” “我們的構件架構使我們能夠首先通過針對各種工作量進行優化的各種系統來推銷。我們繼續與NVIDIA緊密合作，以微調我們的系統並確保AI工作負載中的領導地位。”

Learn more about the new MLPerf v5.0 Inference benchmarks at: https://mlcommons.org/benchmarks/inference-datacenter/

在以下網址了解有關新的MLPERF V5.0推理基準的更多信息：https：//mlcommons.org/benchmarks/inference-datacenter/

Supermicro is the only system vendor to publish record MLPerf inference performance (on select benchmarks) for both the air-cooled and liquid-cooled NVIDIA HGX B200 8-GPU systems. Both air-cooled and liquid-cooled systems were operational before the MLCommons benchmark start date. Supermicro engineers optimized the systems and software to showcase the impressive performance.

SuperMicro是唯一針對風冷和液冷NVIDIA HGX B200 8-GPU系統發布記錄MLPERF推理性能（在精選基準測試中）的系統供應商。在MLCommons基准開始日期之前，氣冷和液冷系統都在運行。超級工程師優化了系統和軟件，以展示令人印象深刻的性能。

Within the operating margin, the Supermicro air-cooled B200 system exhibited the same level of performance as the liquid-cooled B200 system. Supermicro has been delivering these systems to customers while we conducted the benchmarks.

在操作餘量中，超級氣冷B200系統表現出與液冷B200系統相同的性能水平。在我們進行基準測試時，Supermicro一直向客戶交付這些系統。

MLCommons emphasizes that all results be reproducible, that the products are available and that the results can be audited by other MLCommons members. Supermicro engineers optimized the systems and software, as allowed by the MLCommons rules.

MLCommons強調所有結果都是可重現的，產品可用，並且可以由其他MLCommons成員審核結果。超級工程師根據MLCommons規則允許優化系統和軟件。

The SYS-421GE-NBRT-LCC (8x NVIDIA B200-SXM-180GB) and SYS-A21GE-NBRT (8x NVIDIA B200-SXM-180GB) showed performance leadership running the Mixtral 8x7B Inference, Mixture of Experts benchmarks with 129,000 tokens/second. The Supermicro air-cooled and liquid-cooled NVIDIA B200 based system delivered over 1,000 tokens/second inference for the large Llama3.1-405b model, whereas the previous generations of GPU systems have much smaller results. For smaller inferencing tasks, using the LLAMA2-70b benchmark, a Supermicro system with the NVIDIA B200 SXM-180GB installed shows the highest performance from a Tier 1 system supplier.

SYS-421GE-NBRT-LCC（8x NVIDIA B200-SXM-180GB）和SYS-A21GE-NBRT（8x NVIDIA B200-SXM-180GB）顯示出性能領導力，運行MixTRAL 8x7b推理，專家混合物與129,000個代幣/秒。基於Supermicro氣冷和液冷NVIDIA B200的系統，用於大型Llama3.1-405b模型的1000多個令牌/秒推斷，而GPU的前幾代GPU系統的結果較小。對於較小的推斷任務，使用Llama2-70B基準，這是一種具有NVIDIA B200 SXM-180GB的超級系統，已安裝了Tier 1 System System供應商的最高性能。

Specifically:

具體來說：

* The SYS-421GE-NBRT-LCC (8x NVIDIA B200-SXM-180GB) liquid-cooled system achieved the highest performance for the Mixtral 8x7B, Mixture of Experts benchmark, delivering 129,000 tokens/s. It also achieved the highest performance for the Llama3.1-405b benchmark with 1,330 tokens/s.

* SYS-421GE-NBRT-LCC（8x NVIDIA B200-SXM-180GB）液冷系統的混合8x7b的性能最高，專家的混合物基準的混合物提供了129,000個代幣/s。它還以1,330代幣/s的速度獲得了Llama3.1-405B基準的最高性能。

* The SYS-A21GE-NBRT (8x NVIDIA B200-SXM-180GB) air-cooled system achieved the highest performance for the Mixtral 8x7B, Mixture of Experts benchmark, delivering 129,000 tokens/s. It achieved the second-highest performance for the Llama3.1-405b benchmark with 1,009 tokens/s.

* SYS-A21GE-NBRT（8x NVIDIA B200-SXM-180GB）氣冷系統的混合8x7b的性能最高，專家基準的混合物提供了129,000個令牌/s。它獲得了Llama3.1-405B基準的第二高性能，並獲得1,009個令牌/s。

* The SYS-110R3-L (8x NVIDIA A200-SXM-80GB) system achieved the highest performance for the BERT Large benchmark.

* SYS-1110R3-L（8x NVIDIA A200-SXM-80GB）系統的性能最高，用於BERT大型基準。

* The SYS-110R3-L (8x NVIDIA A200-SXM-80GB) and SYS-A21GE-NBRT (8x NVIDIA B200-SXM-180GB) systems achieved the highest performance for the DeepLabV3 and REsNet-50 benchmarks.

* SYS-1110R3-L（8x NVIDIA A200-SXM-80GB）和SYS-A21GE-NBRT（8x NVIDIA B200-SXM-180GB）系統的DeepLaBV3和Resnet-50基準的性能最高。

* The SYS-110R3-L (8x NVIDIA A200-SXM-80GB) system achieved the highest performance for the 3D object detection benchmark.

* SYS-1110R3-L（8x NVIDIA A200-SXM-80GB）系統的3D對象檢測基準的性能最高。

Supermicro offers a comprehensive AI portfolio with over 100 GPU-optimized systems, both air-cooled and liquid-cooled options

SuperMicro提供了全面的AI投資組合，具有100多個GPU優化的系統，包括氣冷和液冷選項