mirror of
https://github.com/ROCm/ROCm.git
synced 2026-01-09 06:38:00 -05:00
110 lines
4.2 KiB
ReStructuredText
110 lines
4.2 KiB
ReStructuredText
:orphan:
|
|
|
|
**************************************************
|
|
vLLM inference performance testing version history
|
|
**************************************************
|
|
|
|
This table lists previous versions of the ROCm vLLM inference Docker image for
|
|
inference performance testing. For detailed information about available models
|
|
for benchmarking, see the version-specific documentation. You can find tagged
|
|
previous releases of the ``ROCm/vllm`` Docker image on `Docker Hub <https://hub.docker.com/r/rocm/vllm/tags>`__.
|
|
|
|
.. list-table::
|
|
:header-rows: 1
|
|
|
|
* - Docker image tag
|
|
- Components
|
|
- Resources
|
|
|
|
* - ``rocm/vllm:rocm6.4.1_vllm_0.9.1_20250715``
|
|
(latest)
|
|
-
|
|
* ROCm 6.4.1
|
|
* vLLM 0.9.1
|
|
* PyTorch 2.7.0
|
|
-
|
|
* :doc:`Documentation <../vllm>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.4.1_vllm_0.9.1_20250715/images/sha256-4a429705fa95a58f6d20aceab43b1b76fa769d57f32d5d28bd3f4e030e2a78ea>`__
|
|
|
|
* - ``rocm/vllm:rocm6.4.1_vllm_0.9.1_20250702``
|
|
-
|
|
* ROCm 6.4.1
|
|
* vLLM 0.9.1
|
|
* PyTorch 2.7.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.9.1-20250702>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.4.1_vllm_0.9.1_20250702/images/sha256-45068a2079cb8df554ed777141bf0c67d6627c470a897256e60c9f262677faab>`__
|
|
|
|
* - ``rocm/vllm:rocm6.4.1_vllm_0.9.0.1_20250605``
|
|
-
|
|
* ROCm 6.4.1
|
|
* vLLM 0.9.0.1
|
|
* PyTorch 2.7.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.9.0.1-20250605>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.4.1_vllm_0.9.0.1_20250605/images/sha256-f48beeb3d72663a93c77211eb45273d564451447c097e060befa713d565fa36c>`__
|
|
|
|
* - ``rocm/vllm:rocm6.3.1_vllm_0.8.5_20250521``
|
|
-
|
|
* ROCm 6.3.1
|
|
* 0.8.5 vLLM (0.8.6.dev)
|
|
* PyTorch 2.7.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.8.5-20250521>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.3.1_vllm_0.8.5_20250521/images/sha256-38410c51af7208897cd8b737c9bdfc126e9bc8952d4aa6b88c85482f03092a11>`__
|
|
|
|
* - ``rocm/vllm:rocm6.3.1_vllm_0.8.5_20250513``
|
|
-
|
|
* ROCm 6.3.1
|
|
* vLLM 0.8.5
|
|
* PyTorch 2.7.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.8.5-20250513>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.3.1_vllm_0.8.5_20250513/images/sha256-5c8b4436dd0464119d9df2b44c745fadf81512f18ffb2f4b5dc235c71ebe26b4>`__
|
|
|
|
* - ``rocm/vllm:rocm6.3.1_instinct_vllm0.8.3_20250415``
|
|
-
|
|
* ROCm 6.3.1
|
|
* vLLM 0.8.3
|
|
* PyTorch 2.7.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.8.3-20250415>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.3.1_instinct_vllm0.8.3_20250415/images/sha256-ad9062dea3483d59dedb17c67f7c49f30eebd6eb37c3fac0a171fb19696cc845>`__
|
|
|
|
* - ``rocm/vllm:rocm6.3.1_instinct_vllm0.7.3_20250325``
|
|
-
|
|
* ROCm 6.3.1
|
|
* vLLM 0.7.3
|
|
* PyTorch 2.7.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.7.3-20250325>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.3.1_instinct_vllm0.7.3_20250325/images/sha256-25245924f61750b19be6dcd8e787e46088a496c1fe17ee9b9e397f3d84d35640>`__
|
|
|
|
* - ``rocm/vllm:rocm6.3.1_mi300_ubuntu22.04_py3.12_vllm_0.6.6``
|
|
-
|
|
* ROCm 6.3.1
|
|
* vLLM 0.6.6
|
|
* PyTorch 2.7.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.6.6>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.3.1_mi300_ubuntu22.04_py3.12_vllm_0.6.6/images/sha256-9a12ef62bbbeb5a4c30a01f702c8e025061f575aa129f291a49fbd02d6b4d6c9>`__
|
|
|
|
* - ``rocm/vllm:rocm6.2_mi300_ubuntu20.04_py3.9_vllm_0.6.4``
|
|
-
|
|
* ROCm 6.2.1
|
|
* vLLM 0.6.4
|
|
* PyTorch 2.5.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.6.4>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.2_mi300_ubuntu20.04_py3.9_vllm_0.6.4/images/sha256-ccbb74cc9e7adecb8f7bdab9555f7ac6fc73adb580836c2a35ca96ff471890d8>`__
|
|
|
|
* - ``rocm/vllm:rocm6.2_mi300_ubuntu22.04_py3.9_vllm_7c5fd50``
|
|
-
|
|
* ROCm 6.2.0
|
|
* vLLM 0.4.3
|
|
* PyTorch 2.4.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.4.3>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.2_mi300_ubuntu22.04_py3.9_vllm_7c5fd50/images/sha256-9e4dd4788a794c3d346d7d0ba452ae5e92d39b8dfac438b2af8efdc7f15d22c0>`__
|
|
|