From 58d42ec50b412784cf5d8373541374c99d6e369b Mon Sep 17 00:00:00 2001 From: Peter Park Date: Tue, 25 Mar 2025 13:54:27 -0400 Subject: [PATCH] Improve "tuning guides" landing page (#4504) * Improve "tuning guides" landing page * Update docs/how-to/gpu-performance/mi300x.rst Co-authored-by: Pratik Basyal * Update docs/how-to/gpu-performance/mi300x.rst Co-authored-by: Pratik Basyal * change tuning to optimization --------- Co-authored-by: Pratik Basyal --- docs/how-to/gpu-performance/mi300x.rst | 27 ++++++++++++++++++++++ docs/how-to/tuning-guides/mi300x/index.rst | 19 --------------- docs/sphinx/_toc.yml.in | 6 ++--- 3 files changed, 30 insertions(+), 22 deletions(-) create mode 100644 docs/how-to/gpu-performance/mi300x.rst delete mode 100644 docs/how-to/tuning-guides/mi300x/index.rst diff --git a/docs/how-to/gpu-performance/mi300x.rst b/docs/how-to/gpu-performance/mi300x.rst new file mode 100644 index 000000000..cc65f14ec --- /dev/null +++ b/docs/how-to/gpu-performance/mi300x.rst @@ -0,0 +1,27 @@ +.. meta:: + :description: How to configure MI300X accelerators to fully leverage their capabilities and achieve optimal performance. + :keywords: ROCm, AI, machine learning, MI300X, LLM, usage, tutorial, optimization, tuning + +************************************** +AMD Instinct MI300X performance guides +************************************** + +The following performance guides provide essential guidance on the necessary +steps to properly :doc:`configure your system for AMD Instinct™ MI300X +accelerators <../system-optimization/mi300x>`. They include detailed +instructions on system settings and application :doc:`workload tuning +<../rocm-for-ai/inference-optimization/workload>` to help you +leverage the maximum capabilities of these accelerators and achieve superior +performance. + +* :doc:`../system-optimization/mi300x` covers essential system settings and + system management practices to configure your AMD Instinct MI300X system for + performance. + +* :doc:`../rocm-for-ai/inference-optimization/workload` covers steps to + optimize the performance of AMD Instinct MI300X series accelerators for HPC + and deep learning operations. + +* :doc:`../rocm-for-ai/inference/vllm-benchmark` introduces a preconfigured + environment for LLM inference, designed to help you test performance with + popular models on AMD Instinct MI300X series accelerators. diff --git a/docs/how-to/tuning-guides/mi300x/index.rst b/docs/how-to/tuning-guides/mi300x/index.rst deleted file mode 100644 index 3703dd2f3..000000000 --- a/docs/how-to/tuning-guides/mi300x/index.rst +++ /dev/null @@ -1,19 +0,0 @@ -.. meta:: - :description: How to configure MI300X accelerators to fully leverage their capabilities and achieve optimal performance. - :keywords: ROCm, AI, machine learning, MI300X, LLM, usage, tutorial, optimization, tuning - -************************ -AMD MI300X tuning guides -************************ - -The tuning guides in this section provide a comprehensive summary of the -necessary steps to properly configure your system for AMD Instinct™ MI300X -accelerators. They include detailed instructions on system settings and -application tuning suggestions to help you fully leverage the capabilities of -these accelerators, thereby achieving optimal performance. - -* :doc:`../../rocm-for-ai/inference/vllm-benchmark` - -* :doc:`../../system-optimization/mi300x` - -* :doc:`../../rocm-for-ai/inference-optimization/workload` diff --git a/docs/sphinx/_toc.yml.in b/docs/sphinx/_toc.yml.in index 652bd252f..9698a7724 100644 --- a/docs/sphinx/_toc.yml.in +++ b/docs/sphinx/_toc.yml.in @@ -90,7 +90,7 @@ subtrees: - file: how-to/rocm-for-ai/inference-optimization/profiling-and-debugging.rst title: Profile and debug - file: how-to/rocm-for-ai/inference-optimization/workload.rst - title: Workload tuning + title: Workload optimization - url: https://rocm.docs.amd.com/projects/ai-developer-hub/en/latest/ title: AI tutorials @@ -111,8 +111,8 @@ subtrees: title: AMD Instinct MI100 - file: how-to/system-optimization/w6000-v620.md title: AMD RDNA 2 - - file: how-to/tuning-guides/mi300x/index.rst - title: AMD MI300X performance validation and tuning + - file: how-to/gpu-performance/mi300x.rst + title: AMD Instinct MI300X performance guides - file: how-to/system-debugging.md - file: conceptual/compiler-topics.md title: Use advanced compiler features