--- title: "AMD Instinct MI355X | Aguasto" description: "Manufacturer reference for AMD Instinct MI355X: CDNA 4, individual accelerator, with sourced specifications, variant boundaries and deployment considerations." canonical: "https://www.aguasto.com/gpus/mi355x" last-updated: "2026-10-12" --- # AMD Instinct MI355X | Aguasto Canonical HTML: [AMD Instinct MI355X](https://www.aguasto.com/gpus/mi355x) > Manufacturer reference for AMD Instinct MI355X: CDNA 4, individual accelerator, with sourced specifications, variant boundaries and deployment considerations. [Aguasto](https://www.aguasto.com/) [GPU Library](https://www.aguasto.com/gpus) AMD Instinct MI355X [Resources](https://www.aguasto.com/resources) [GPU Library](https://www.aguasto.com/gpus) [Model Index](https://www.aguasto.com/models) [Inference Stack](https://www.aguasto.com/inference-stack) [Learn](https://www.aguasto.com/learn) [Insights](https://www.aguasto.com/insights) [Research](https://www.aguasto.com/research) [Engineering tools](https://www.aguasto.com/tools) AMD / Individual accelerator ## AMD Instinct MI355X Launched accelerator with manufacturer-reported deployment/benchmark evidence; supplier stock and Aguasto availability are not verified. Original Aguasto conceptual illustration. Not manufacturer geometry, an operating Aguasto asset, or a measured benchmark. Aguasto Research documents third-party hardware, models and software. References do not represent Aguasto inventory, evaluated deployments or available inference services. ### Manufacturer specification reference Architecture CDNA 4[AMD Instinct MI355X specifications (external source)](https://www.amd.com/en/products/accelerators/instinct/mi350/mi355x.html) · [AMD Instinct GPUs: MLPerf Inference v5.1 (external source)](https://www.amd.com/en/blogs/2025/accelerating-generative-ai-how-instinct-gpus-delivered.html) · [AMD Instinct MI355X GPU brochure (external source)](https://www.amd.com/content/dam/amd/en/documents/instinct-tech-docs/product-briefs/amd-instinct-mi355x-gpu-brochure.pdf) Category Individual accelerator[AMD Instinct MI355X specifications (external source)](https://www.amd.com/en/products/accelerators/instinct/mi350/mi355x.html) · [AMD Instinct GPUs: MLPerf Inference v5.1 (external source)](https://www.amd.com/en/blogs/2025/accelerating-generative-ai-how-instinct-gpus-delivered.html) · [AMD Instinct MI355X GPU brochure (external source)](https://www.amd.com/content/dam/amd/en/documents/instinct-tech-docs/product-briefs/amd-instinct-mi355x-gpu-brochure.pdf) Accelerator memory 288 GBPer OAM accelerator; not the eight-GPU baseboard or host memory.[AMD Instinct MI355X specifications (external source)](https://www.amd.com/en/products/accelerators/instinct/mi350/mi355x.html) Memory type HBM3e[AMD Instinct MI355X specifications (external source)](https://www.amd.com/en/products/accelerators/instinct/mi350/mi355x.html) · [AMD Instinct GPUs: MLPerf Inference v5.1 (external source)](https://www.amd.com/en/blogs/2025/accelerating-generative-ai-how-instinct-gpus-delivered.html) · [AMD Instinct MI355X GPU brochure (external source)](https://www.amd.com/content/dam/amd/en/documents/instinct-tech-docs/product-briefs/amd-instinct-mi355x-gpu-brochure.pdf) Memory bandwidth 8 TB/sManufacturer peak theoretical GPU memory bandwidth per accelerator.[AMD Instinct MI355X specifications (external source)](https://www.amd.com/en/products/accelerators/instinct/mi350/mi355x.html) Power 1,400 WManufacturer maximum board-power specification, corroborated by brochure; not measured server draw.[AMD Instinct MI355X specifications (external source)](https://www.amd.com/en/products/accelerators/instinct/mi350/mi355x.html) Precision formats FP64, FP32, FP16, BF16, INT8, OCP-FP8, MXFP8, MXFP6, MXFP4[AMD Instinct MI355X specifications (external source)](https://www.amd.com/en/products/accelerators/instinct/mi350/mi355x.html) Cooling / integration Manufacturer lists passive and active cooling; verify the actual liquid-cooled/OEM system design.[AMD Instinct MI355X specifications (external source)](https://www.amd.com/en/products/accelerators/instinct/mi350/mi355x.html) · [AMD Instinct GPUs: MLPerf Inference v5.1 (external source)](https://www.amd.com/en/blogs/2025/accelerating-generative-ai-how-instinct-gpus-delivered.html) · [AMD Instinct MI355X GPU brochure (external source)](https://www.amd.com/content/dam/amd/en/documents/instinct-tech-docs/product-briefs/amd-instinct-mi355x-gpu-brochure.pdf) ### Configuration boundaries - Published FLOPS are peak theoretical specifications; they are not model serving benchmarks. - Microscaling formats and OCP FP8 differ from earlier CDNA FP8 implementations; kernel and checkpoint compatibility must be verified. ### Published arithmetic throughput Manufacturer peaks, not Aguasto measurements or tokens per second **Specification** OCP-FP8 peak compute **Precision** OCP-FP8 **Published peak** 5 PFLOPS **Boundary & source** Per GPU; manufacturer peak matrix specification without structured-sparsity figure[Manufacturer source ↗](https://www.amd.com/en/products/accelerators/instinct/mi350/mi355x.html) **Specification** MXFP4 peak compute **Precision** MXFP4 **Published peak** 10.1 PFLOPS **Boundary & source** Per GPU; manufacturer peak microscaling matrix specification[Manufacturer source ↗](https://www.amd.com/en/products/accelerators/instinct/mi350/mi355x.html) ### Deployment considerations - Match ROCm, kernel, framework and model versions against the current support matrix. - Weight-memory estimates exclude KV cache and serving overhead; reserve runtime headroom. - Check collectives, scale-up topology and model parallelism on the intended OEM system. #### Software ecosystem ROCm. Confirm the exact model, runtime release, server integration and vendor support matrix before evaluating a deployment. ### Continue the research [AMD ROCm](https://www.aguasto.com/inference-stack/rocm) [vLLM](https://www.aguasto.com/inference-stack/vllm) [SGLang](https://www.aguasto.com/inference-stack/sglang) [Model weights versus runtime memory](https://www.aguasto.com/learn/model-weights-and-runtime-memory) [Compare compatible hardware categories](https://www.aguasto.com/gpus/compare) [Why modular infrastructure?](https://www.aguasto.com/why-modular) ### Sources & verification Reference revision 1 · Reviewed October 12, 2026. Manufacturer claims and documentation are attributed; Aguasto has not run the cited products in production. - [AMD Instinct MI355X specifications ↗](https://www.amd.com/en/products/accelerators/instinct/mi350/mi355x.html) Launch date 2025-06-12; CDNA 4 architecture; 288 GB HBM3e; 8 TB/s memory bandwidth; 1400 W module board-power specification; Precision support; Cooling and ROCm ecosystem. Publication: date not stated in the reviewed source. Verified: 2026-10-12. - [AMD Instinct GPUs: MLPerf Inference v5.1 ↗](https://www.amd.com/en/blogs/2025/accelerating-generative-ai-how-instinct-gpus-delivered.html) MI300X, MI325X and MI355X launched products with manufacturer-reported deployments or benchmark submissions. Publication: 2025-09-09. Verified: 2026-10-12. - [AMD Instinct MI355X GPU brochure ↗](https://www.amd.com/content/dam/amd/en/documents/instinct-tech-docs/product-briefs/amd-instinct-mi355x-gpu-brochure.pdf) Maximum TBP 1400 W. Publication: date not stated in the reviewed source. Verified: 2026-10-12. ### Reference journey [Compare hardware ↗](https://www.aguasto.com/gpus/compare) [Model Index ↗](https://www.aguasto.com/models) [Serving software ↗](https://www.aguasto.com/inference-stack) [OEM collaboration ↗](https://www.aguasto.com/partners) [Sources & verification ↓](https://www.aguasto.com/gpus/mi355x#sources) Research reference · No available Aguasto service ## Company navigation - [Home](https://www.aguasto.com/) - [Infrastructure](https://www.aguasto.com/infrastructure) - [GPU Cloud](https://www.aguasto.com/gpu-cloud) - [AI Inference](https://www.aguasto.com/ai-inference) - [Development & Investment](https://www.aguasto.com/development) - [Company](https://www.aguasto.com/company) - [Contact](https://www.aguasto.com/contact) - [Privacy](https://www.aguasto.com/privacy) - [Resources](https://www.aguasto.com/resources) - [GPU Library](https://www.aguasto.com/gpus) - [Model Index](https://www.aguasto.com/models) - [Inference Stack](https://www.aguasto.com/inference-stack) - [Learn](https://www.aguasto.com/learn) - [Insights](https://www.aguasto.com/insights) - [Research](https://www.aguasto.com/research) - [Industry cases](https://www.aguasto.com/research/cases) - [Why Modular](https://www.aguasto.com/why-modular) - [Partners](https://www.aguasto.com/partners) - [GPU comparison](https://www.aguasto.com/gpus/compare) - [Model comparison](https://www.aguasto.com/models/compare) - [Engineering tools](https://www.aguasto.com/tools) - [Development friction](https://www.aguasto.com/research/hyperscale-development-friction) - [NVIDIA H100 SXM](https://www.aguasto.com/gpus/h100) - [NVIDIA H200 SXM](https://www.aguasto.com/gpus/h200) - [NVIDIA B200 SXM](https://www.aguasto.com/gpus/b200) - [NVIDIA B300](https://www.aguasto.com/gpus/b300) - [NVIDIA GB200 NVL72](https://www.aguasto.com/gpus/gb200-nvl72) - [NVIDIA GB300 NVL72](https://www.aguasto.com/gpus/gb300-nvl72) - [NVIDIA Vera Rubin NVL72](https://www.aguasto.com/gpus/vera-rubin-nvl72) - [AMD Instinct MI300X](https://www.aguasto.com/gpus/mi300x) - [AMD Instinct MI325X](https://www.aguasto.com/gpus/mi325x) - [AMD Instinct MI355X](https://www.aguasto.com/gpus/mi355x) - [AMD Instinct MI455X](https://www.aguasto.com/gpus/mi455x) - [AMD Helios](https://www.aguasto.com/gpus/helios) - [GLM-4.5](https://www.aguasto.com/models/glm-4-5) - [Qwen3-235B-A22B](https://www.aguasto.com/models/qwen3-235b-a22b) - [DeepSeek-R1](https://www.aguasto.com/models/deepseek-r1) - [Llama 3.3 70B Instruct](https://www.aguasto.com/models/llama-3-3-70b-instruct) - [Gemma 3 27B IT](https://www.aguasto.com/models/gemma-3-27b-it) - [gpt-oss-120b](https://www.aguasto.com/models/gpt-oss-120b) - [Kimi-K2-Instruct](https://www.aguasto.com/models/kimi-k2-instruct) - [vLLM](https://www.aguasto.com/inference-stack/vllm) - [SGLang](https://www.aguasto.com/inference-stack/sglang) - [TensorRT-LLM](https://www.aguasto.com/inference-stack/tensorrt-llm) - [NVIDIA Dynamo](https://www.aguasto.com/inference-stack/dynamo) - [NVIDIA Triton Inference Server](https://www.aguasto.com/inference-stack/triton) - [AMD ROCm](https://www.aguasto.com/inference-stack/rocm) - [Ray Serve](https://www.aguasto.com/inference-stack/ray-serve) - [Kubernetes GPU orchestration — NVIDIA device plugin](https://www.aguasto.com/inference-stack/kubernetes) - [Model weights are only the beginning of the memory budget](https://www.aguasto.com/learn/model-weights-and-runtime-memory) - [Why tokens per second is not enough to benchmark inference](https://www.aguasto.com/research/inference-benchmark-methodology) - [Prefill, decode and the cost of separating them](https://www.aguasto.com/learn/prefill-decode-and-disaggregated-serving) - [Choosing between vLLM, SGLang and TensorRT-LLM](https://www.aguasto.com/learn/choosing-an-inference-serving-framework) - [From Power to Inference—Building a Distributed AI Compute Network](https://www.aguasto.com/learn/from-power-to-inference) - [Dedicated compute and shared inference: compare the whole workload](https://www.aguasto.com/insights/dedicated-and-shared-inference-economics) - [Distributed inference reliability begins with the failure boundary](https://www.aguasto.com/learn/distributed-inference-reliability) - [Core Scientific: reading contracted, energized and billed capacity](https://www.aguasto.com/research/cases/core-scientific-capacity-disclosures) - [Why Modular AI Infrastructure Matters Now](https://www.aguasto.com/research/why-modular-ai-infrastructure-matters-now) - [Official LinkedIn](https://www.linkedin.com/company/aguasto) This is a generated representation of the public HTML page. Diagrams are conceptual. GPU and inference services are planned and are not currently available to book or call. The contact page describes the available inquiry flow.