mirror of
https://github.com/ROCm/ROCm.git
synced 2026-04-27 03:01:52 -04:00
fed33835a0
* Add Fine Tuning LLMs how to guide * Reorg and refactor Fine-tuning LLMs with ROCm Update index and headings Fix formatting and update toc Split out content from index to overview.rst Add metadata Clean up overview Add inference sections, fix rst errors, clean up single-gpu-fine-tuning Combine fine-tuning and inference guides Fix some links and formatting Update toc and add formatting fixes Add ck kernel fusion content Update toc Clean up model quantization and acceleration Add CK images Clean up profiling Update triton kernel performance optimization Update llm inference frameworks guide Disable automatic number of figures and tables in Sphinx conf Change tabs to spaces Change heading to end with -ing Add link fixes and heading updates Add rocprof/Omniperf/Omnitrace section Update profiling and debugging guide Add formatting fixes Satisfy spellcheck Fix words Delete unused file Finish overview Clean up first 4 sections Multi-gpu fine-tuning guide: slight fixes Update toc Remove tabs Formatting fixes * Minor wording updates * Add some clean-up * Update profiling and debugging gudie * Fix Omnitrace link * Update ck kernel fusion with latest * Update CK formatting * Fix perfetto link syntax * Fix typos and add blurbs * Add fixes to Triton optimization doc * Tabify saving adapters / models section * Fix linting errors - spellcheck Fix spelling and grammar Satisfy linter Update wording in profiling guide Add fixes to satisfy linter More fixes for linting in Triton guide More linting fixes Spellcheck in CK guide * Improve triton guide Fix linting errors and optics * Add occupancy / vgpr table Change some wording * Re-add tunableop * Add missing indent in _toc.yml * Remove ckProfiler references * Add links to resources * Add refs in CK optimization guide * Rename files and fix internal links * Organize tuning guides Reorg triton * Add compute unit diagram * Remove AutoAWQ * Add higher res image for Perfetto trace example * Update link text * Update fig nums * Update some formatting * Update "Inductor" * Change "Inductor" to TorchInductor * Add link to official TorchInductor docs
69 lines
2.2 KiB
ReStructuredText
69 lines
2.2 KiB
ReStructuredText
.. meta::
|
|
:description: How to install deep learning frameworks for ROCm
|
|
:keywords: deep learning, frameworks, ROCm, install, PyTorch, TensorFlow, JAX, MAGMA, DeepSpeed, ML, AI
|
|
|
|
********************************************
|
|
Installing deep learning frameworks for ROCm
|
|
********************************************
|
|
|
|
ROCm provides a comprehensive ecosystem for deep learning development, including
|
|
:ref:`libraries <artificial-intelligence-apis>` for optimized deep learning operations and ROCm-aware versions of popular
|
|
deep learning frameworks and libraries such as PyTorch, TensorFlow, JAX, and MAGMA. ROCm works closely with these
|
|
frameworks to ensure that framework-specific optimizations take advantage of AMD accelerator and GPU architectures.
|
|
|
|
The following guides cover installation processes for ROCm-aware deep learning frameworks.
|
|
|
|
.. grid::
|
|
|
|
.. grid-item::
|
|
:columns: 3
|
|
|
|
:doc:`PyTorch for ROCm <rocm-install-on-linux:how-to/3rd-party/pytorch-install>`
|
|
|
|
.. grid-item::
|
|
:columns: 3
|
|
|
|
:doc:`TensorFlow for ROCm <rocm-install-on-linux:how-to/3rd-party/tensorflow-install>`
|
|
|
|
.. grid-item::
|
|
:columns: 3
|
|
|
|
.. grid-item::
|
|
:columns: 3
|
|
|
|
.. grid-item::
|
|
:columns: 3
|
|
|
|
:doc:`JAX for ROCm <rocm-install-on-linux:how-to/3rd-party/jax-install>`
|
|
|
|
.. grid-item::
|
|
:columns: 3
|
|
|
|
:doc:`MAGMA for ROCm <rocm-install-on-linux:how-to/3rd-party/magma-install>`
|
|
|
|
.. grid-item::
|
|
:columns: 3
|
|
|
|
.. grid-item::
|
|
:columns: 3
|
|
|
|
The following chart steps through typical installation workflows for installing deep learning frameworks for ROCm.
|
|
|
|
.. image:: ../data/how-to/framework_install_2024_05_23.png
|
|
:alt: Flowchart for installing ROCm-aware machine learning frameworks
|
|
:align: center
|
|
|
|
Find information on version compatibility and framework release notes in :doc:`Third-party support matrix
|
|
<rocm-install-on-linux:reference/3rd-party-support-matrix>`.
|
|
|
|
.. note::
|
|
|
|
For guidance on installing ROCm itself, refer to :doc:`ROCm installation for Linux <rocm-install-on-linux:index>`.
|
|
|
|
Learn how to use your ROCm deep learning environment for training, fine-tuning, inference, and performance optimization
|
|
through the following guides.
|
|
|
|
* :doc:`rocm-for-ai/index`
|
|
|
|
* :doc:`fine-tuning-llms/index`
|