mirror of
https://github.com/ROCm/ROCm.git
synced 2026-01-07 22:03:58 -05:00
154 lines
5.9 KiB
ReStructuredText
154 lines
5.9 KiB
ReStructuredText
:orphan:
|
|
|
|
**************************************************
|
|
vLLM inference performance testing version history
|
|
**************************************************
|
|
|
|
This table lists previous versions of the ROCm vLLM inference Docker image for
|
|
inference performance testing. For detailed information about available models
|
|
for benchmarking, see the version-specific documentation. You can find tagged
|
|
previous releases of the ``ROCm/vllm`` Docker image on `Docker Hub <https://hub.docker.com/r/rocm/vllm/tags>`__.
|
|
|
|
.. list-table::
|
|
:header-rows: 1
|
|
|
|
* - Docker image tag
|
|
- Components
|
|
- Resources
|
|
|
|
* - ``rocm/vllm:rocm7.0.0_vllm_0.11.2_20251210``
|
|
-
|
|
* ROCm 7.0.0
|
|
* vLLM 0.11.2
|
|
* PyTorch 2.9.0
|
|
-
|
|
* :doc:`Documentation <../vllm>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm7.0.0_vllm_0.11.2_20251210/images/sha256-e7f02dd2ce3824959658bc0391296f6158638e3ebce164f6c019c4eca8150ec7>`__
|
|
|
|
* - ``rocm/vllm:rocm7.0.0_vllm_0.11.1_20251103``
|
|
-
|
|
* ROCm 7.0.0
|
|
* vLLM 0.11.1
|
|
* PyTorch 2.9.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.11.1-20251103>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm7.0.0_vllm_0.11.1_20251103/images/sha256-8d60429043d4d00958da46039a1de0d9b82df814d45da482497eef26a6076506>`__
|
|
|
|
* - ``rocm/vllm:rocm7.0.0_vllm_0.10.2_20251006``
|
|
-
|
|
* ROCm 7.0.0
|
|
* vLLM 0.10.2
|
|
* PyTorch 2.9.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.10.2-20251006>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm7.0.0_vllm_0.10.2_20251006/images/sha256-94fd001964e1cf55c3224a445b1fb5be31a7dac302315255db8422d813edd7f5>`__
|
|
|
|
* - ``rocm/vllm:rocm6.4.1_vllm_0.10.1_20250909``
|
|
-
|
|
* ROCm 6.4.1
|
|
* vLLM 0.10.1
|
|
* PyTorch 2.7.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.10.1-20250909>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.4.1_vllm_0.10.1_20250909/images/sha256-1113268572e26d59b205792047bea0e61e018e79aeadceba118b7bf23cb3715c>`__
|
|
|
|
* - ``rocm/vllm:rocm6.4.1_vllm_0.10.0_20250812``
|
|
-
|
|
* ROCm 6.4.1
|
|
* vLLM 0.10.0
|
|
* PyTorch 2.7.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.10.0-20250812>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.4.1_vllm_0.10.0_20250812/images/sha256-4c277ad39af3a8c9feac9b30bf78d439c74d9b4728e788a419d3f1d0c30cacaa>`__
|
|
|
|
* - ``rocm/vllm:rocm6.4.1_vllm_0.9.1_20250715``
|
|
-
|
|
* ROCm 6.4.1
|
|
* vLLM 0.9.1
|
|
* PyTorch 2.7.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.9.1-20250715>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.4.1_vllm_0.9.1_20250715/images/sha256-4a429705fa95a58f6d20aceab43b1b76fa769d57f32d5d28bd3f4e030e2a78ea>`__
|
|
|
|
* - ``rocm/vllm:rocm6.4.1_vllm_0.9.1_20250702``
|
|
-
|
|
* ROCm 6.4.1
|
|
* vLLM 0.9.1
|
|
* PyTorch 2.7.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.9.1-20250702>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.4.1_vllm_0.9.1_20250702/images/sha256-45068a2079cb8df554ed777141bf0c67d6627c470a897256e60c9f262677faab>`__
|
|
|
|
* - ``rocm/vllm:rocm6.4.1_vllm_0.9.0.1_20250605``
|
|
-
|
|
* ROCm 6.4.1
|
|
* vLLM 0.9.0.1
|
|
* PyTorch 2.7.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.9.0.1-20250605>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.4.1_vllm_0.9.0.1_20250605/images/sha256-f48beeb3d72663a93c77211eb45273d564451447c097e060befa713d565fa36c>`__
|
|
|
|
* - ``rocm/vllm:rocm6.3.1_vllm_0.8.5_20250521``
|
|
-
|
|
* ROCm 6.3.1
|
|
* 0.8.5 vLLM (0.8.6.dev)
|
|
* PyTorch 2.7.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.8.5-20250521>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.3.1_vllm_0.8.5_20250521/images/sha256-38410c51af7208897cd8b737c9bdfc126e9bc8952d4aa6b88c85482f03092a11>`__
|
|
|
|
* - ``rocm/vllm:rocm6.3.1_vllm_0.8.5_20250513``
|
|
-
|
|
* ROCm 6.3.1
|
|
* vLLM 0.8.5
|
|
* PyTorch 2.7.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.8.5-20250513>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.3.1_vllm_0.8.5_20250513/images/sha256-5c8b4436dd0464119d9df2b44c745fadf81512f18ffb2f4b5dc235c71ebe26b4>`__
|
|
|
|
* - ``rocm/vllm:rocm6.3.1_instinct_vllm0.8.3_20250415``
|
|
-
|
|
* ROCm 6.3.1
|
|
* vLLM 0.8.3
|
|
* PyTorch 2.7.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.8.3-20250415>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.3.1_instinct_vllm0.8.3_20250415/images/sha256-ad9062dea3483d59dedb17c67f7c49f30eebd6eb37c3fac0a171fb19696cc845>`__
|
|
|
|
* - ``rocm/vllm:rocm6.3.1_instinct_vllm0.7.3_20250325``
|
|
-
|
|
* ROCm 6.3.1
|
|
* vLLM 0.7.3
|
|
* PyTorch 2.7.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.7.3-20250325>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.3.1_instinct_vllm0.7.3_20250325/images/sha256-25245924f61750b19be6dcd8e787e46088a496c1fe17ee9b9e397f3d84d35640>`__
|
|
|
|
* - ``rocm/vllm:rocm6.3.1_mi300_ubuntu22.04_py3.12_vllm_0.6.6``
|
|
-
|
|
* ROCm 6.3.1
|
|
* vLLM 0.6.6
|
|
* PyTorch 2.7.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.6.6>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.3.1_mi300_ubuntu22.04_py3.12_vllm_0.6.6/images/sha256-9a12ef62bbbeb5a4c30a01f702c8e025061f575aa129f291a49fbd02d6b4d6c9>`__
|
|
|
|
* - ``rocm/vllm:rocm6.2_mi300_ubuntu20.04_py3.9_vllm_0.6.4``
|
|
-
|
|
* ROCm 6.2.1
|
|
* vLLM 0.6.4
|
|
* PyTorch 2.5.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.6.4>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.2_mi300_ubuntu20.04_py3.9_vllm_0.6.4/images/sha256-ccbb74cc9e7adecb8f7bdab9555f7ac6fc73adb580836c2a35ca96ff471890d8>`__
|
|
|
|
* - ``rocm/vllm:rocm6.2_mi300_ubuntu22.04_py3.9_vllm_7c5fd50``
|
|
-
|
|
* ROCm 6.2.0
|
|
* vLLM 0.4.3
|
|
* PyTorch 2.4.0
|
|
-
|
|
* :doc:`Documentation <vllm-0.4.3>`
|
|
* `Docker Hub <https://hub.docker.com/layers/rocm/vllm/rocm6.2_mi300_ubuntu22.04_py3.9_vllm_7c5fd50/images/sha256-9e4dd4788a794c3d346d7d0ba452ae5e92d39b8dfac438b2af8efdc7f15d22c0>`__
|
|
|