AGUASTO

NVIDIA / Individual accelerator

NVIDIA H200 SXM

The manufacturer product page explicitly says available. No supplier stock or Aguasto deployment is verified.

Original Aguasto conceptual illustration. Not manufacturer geometry, an operating Aguasto asset, or a measured benchmark.

Manufacturer specification reference

Architecture
HopperNVIDIA H200 GPU specifications (external source) · CUDA GPU Compute Capability (external source)
Category
Individual acceleratorNVIDIA H200 GPU specifications (external source) · CUDA GPU Compute Capability (external source)
Accelerator memory
141 GBPer H200 SXM GPU; host memory excluded.NVIDIA H200 GPU specifications (external source)
Memory type
HBM3eNVIDIA H200 GPU specifications (external source) · CUDA GPU Compute Capability (external source)
Memory bandwidth
4.8 TB/sPeak GPU memory bandwidth per accelerator.NVIDIA H200 GPU specifications (external source)
Power
700 WMaximum configurable SXM GPU TDP; not H200 NVL or complete server draw.NVIDIA H200 GPU specifications (external source)
Precision formats
FP64, FP32, TF32, BF16, FP16, FP8, INT8NVIDIA H200 GPU specifications (external source)
Cooling / integration
SXM server thermal implementation depends on OEM system. The separately documented H200 NVL is a dual-slot air-cooled PCIe product.NVIDIA H200 GPU specifications (external source) · CUDA GPU Compute Capability (external source)

Configuration boundaries

  • NVIDIA retains a preliminary/specifications-may-change footnote on this page; preserve that qualification.
  • Headline power selects SXM. NVL has a different published power limit.

Published arithmetic throughput

Manufacturer peaks, not Aguasto measurements or tokens per second
SpecificationPrecisionPublished peakBoundary & source
FP8 peak computeFP83,958 TFLOPSOne H200 SXM; manufacturer peak Tensor Core specification with sparsityManufacturer source ↗

Deployment considerations

  • Larger GPU memory can accommodate more weights or cache, but capacity alone does not establish latency or concurrency.
  • Confirm the serving framework, GPU driver and selected model format together.

Software ecosystem

CUDA. Confirm the exact model, runtime release, server integration and vendor support matrix before evaluating a deployment.

Continue the research

vLLMSGLangTensorRT-LLMModel weights versus runtime memoryCompare compatible hardware categoriesWhy modular infrastructure?

Sources & verification

Reference revision 1 · Reviewed . Manufacturer claims and documentation are attributed; Aguasto has not run the cited products in production.

  1. NVIDIA H200 GPU specifications ↗

    Explicit availability statement; Hopper architecture; 141 GB HBM3e; 4.8 TB/s memory bandwidth; SXM maximum configurable TDP 700 W; precisions; SXM and NVL distinctions. Publication: date not stated in the reviewed source. Verified: 2026-10-12.

  2. CUDA GPU Compute Capability ↗

    CUDA product identification for H100, H200, B200, B300, GB200 and GB300. Publication: date not stated in the reviewed source. Verified: 2026-10-12.