github/ROCm
1
1
Fork 0
mirror of https://github.com/ROCm/ROCm.git synced 2026-01-10 23:28:03 -05:00
Code Issues Packages Projects Releases Wiki Activity

fix sglang mi35x pull tag

Browse Source
This commit is contained in:
Peter Park
2025-09-16 02:58:48 -04:00
parent 8f24297ac5
commit fbfc0bf70d
2 changed files with 4 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/benchmark-docker/inference-sglang-deepseek-r1-fp4.rst
View File

@@ -20,7 +20,7 @@ Use the following command to pull the `Docker image
.. code-block:: shell
docker pull rocm/7.0:rocm7.0_ubuntu_22.04_sgl-dev-v0.5.2-rocm700-mi35x-20250915
docker pull rocm/7.0:rocm7.0_ubuntu_22.04_sgl-dev-v0.5.2-rocm7.0-mi35x-20250915
Download the model
==================
@@ -59,7 +59,7 @@ Run the inference benchmark
--device=/dev/kfd \
--device=/dev/dri \
-e SGLANG_USE_AITER=1 \
rocm/7.0-preview:rocm7.0_ubuntu_22.04_sgl-dev-v0.5.2-rocm700-mi35x-20250915
rocm/7.0-preview:rocm7.0_ubuntu_22.04_sgl-dev-v0.5.2-rocm7.0-mi35x-20250915
2. Start the server.

4
docs/benchmark-docker/inference-sglang-deepseek-r1-fp8.rst
View File

@@ -24,7 +24,7 @@ for your system.
.. code-block:: shell
docker pull rocm/7.0:rocm7.0_ubuntu_22.04_sgl-dev-v0.5.2-rocm700-mi35x-20250915
docker pull rocm/7.0:rocm7.0_ubuntu_22.04_sgl-dev-v0.5.2-rocm7.0-mi35x-20250915
.. tab-item:: MI300X series
:sync: mi30x
@@ -72,7 +72,7 @@ Run the inference benchmark
--device=/dev/kfd \
--device=/dev/dri \
-e SGLANG_USE_AITER=1 \
rocm/7.0:rocm7.0_ubuntu_22.04_sgl-dev-v0.5.2-rocm700-mi35x-20250915
rocm/7.0:rocm7.0_ubuntu_22.04_sgl-dev-v0.5.2-rocm7.0-mi35x-20250915
.. tab-item:: MI300X series
:sync: mi30x