diff --git a/docs/how-to/gpu-performance/mi300x.rst b/docs/how-to/gpu-performance/mi300x.rst new file mode 100644 index 000000000..cc65f14ec --- /dev/null +++ b/docs/how-to/gpu-performance/mi300x.rst @@ -0,0 +1,27 @@ +.. meta:: + :description: How to configure MI300X accelerators to fully leverage their capabilities and achieve optimal performance. + :keywords: ROCm, AI, machine learning, MI300X, LLM, usage, tutorial, optimization, tuning + +************************************** +AMD Instinct MI300X performance guides +************************************** + +The following performance guides provide essential guidance on the necessary +steps to properly :doc:`configure your system for AMD Instinctâ„¢ MI300X +accelerators <../system-optimization/mi300x>`. They include detailed +instructions on system settings and application :doc:`workload tuning +<../rocm-for-ai/inference-optimization/workload>` to help you +leverage the maximum capabilities of these accelerators and achieve superior +performance. + +* :doc:`../system-optimization/mi300x` covers essential system settings and + system management practices to configure your AMD Instinct MI300X system for + performance. + +* :doc:`../rocm-for-ai/inference-optimization/workload` covers steps to + optimize the performance of AMD Instinct MI300X series accelerators for HPC + and deep learning operations. + +* :doc:`../rocm-for-ai/inference/vllm-benchmark` introduces a preconfigured + environment for LLM inference, designed to help you test performance with + popular models on AMD Instinct MI300X series accelerators. diff --git a/docs/how-to/tuning-guides/mi300x/index.rst b/docs/how-to/tuning-guides/mi300x/index.rst deleted file mode 100644 index 3703dd2f3..000000000 --- a/docs/how-to/tuning-guides/mi300x/index.rst +++ /dev/null @@ -1,19 +0,0 @@ -.. meta:: - :description: How to configure MI300X accelerators to fully leverage their capabilities and achieve optimal performance. - :keywords: ROCm, AI, machine learning, MI300X, LLM, usage, tutorial, optimization, tuning - -************************ -AMD MI300X tuning guides -************************ - -The tuning guides in this section provide a comprehensive summary of the -necessary steps to properly configure your system for AMD Instinctâ„¢ MI300X -accelerators. They include detailed instructions on system settings and -application tuning suggestions to help you fully leverage the capabilities of -these accelerators, thereby achieving optimal performance. - -* :doc:`../../rocm-for-ai/inference/vllm-benchmark` - -* :doc:`../../system-optimization/mi300x` - -* :doc:`../../rocm-for-ai/inference-optimization/workload` diff --git a/docs/sphinx/_toc.yml.in b/docs/sphinx/_toc.yml.in index 652bd252f..9698a7724 100644 --- a/docs/sphinx/_toc.yml.in +++ b/docs/sphinx/_toc.yml.in @@ -90,7 +90,7 @@ subtrees: - file: how-to/rocm-for-ai/inference-optimization/profiling-and-debugging.rst title: Profile and debug - file: how-to/rocm-for-ai/inference-optimization/workload.rst - title: Workload tuning + title: Workload optimization - url: https://rocm.docs.amd.com/projects/ai-developer-hub/en/latest/ title: AI tutorials @@ -111,8 +111,8 @@ subtrees: title: AMD Instinct MI100 - file: how-to/system-optimization/w6000-v620.md title: AMD RDNA 2 - - file: how-to/tuning-guides/mi300x/index.rst - title: AMD MI300X performance validation and tuning + - file: how-to/gpu-performance/mi300x.rst + title: AMD Instinct MI300X performance guides - file: how-to/system-debugging.md - file: conceptual/compiler-topics.md title: Use advanced compiler features