Add "Fine Tuning LLMs" how to guide (#3124)

* Add Fine Tuning LLMs how to guide

* Reorg and refactor Fine-tuning LLMs with ROCm

Update index and headings

Fix formatting and update toc

Split out content from index to overview.rst

Add metadata

Clean up overview

Add inference sections, fix rst errors, clean up single-gpu-fine-tuning

Combine fine-tuning and inference guides

Fix some links and formatting

Update toc and add formatting fixes

Add ck kernel fusion content

Update toc

Clean up model quantization and acceleration

Add CK images

Clean up profiling

Update triton kernel performance optimization

Update llm inference frameworks guide

Disable automatic number of figures and tables in Sphinx conf

Change tabs to spaces

Change heading to end with -ing

Add link fixes and heading updates

Add rocprof/Omniperf/Omnitrace section

Update profiling and debugging guide

Add formatting fixes

Satisfy spellcheck

Fix words

Delete unused file

Finish overview

Clean up first 4 sections

Multi-gpu fine-tuning guide: slight fixes

Update toc

Remove tabs

Formatting fixes

* Minor wording updates

* Add some clean-up

* Update profiling and debugging gudie

* Fix Omnitrace link

* Update ck kernel fusion with latest

* Update CK formatting

* Fix perfetto link syntax

* Fix typos and add blurbs

* Add fixes to Triton optimization doc

* Tabify saving adapters / models section

* Fix linting errors - spellcheck

Fix spelling and grammar

Satisfy linter

Update wording in profiling guide

Add fixes to satisfy linter

More fixes for linting in Triton guide

More linting fixes

Spellcheck in CK guide

* Improve triton guide

Fix linting errors and optics

* Add occupancy / vgpr table

Change some wording

* Re-add tunableop

* Add missing indent in _toc.yml

* Remove ckProfiler references

* Add links to resources

* Add refs in CK optimization guide

* Rename files and fix internal links

* Organize tuning guides

Reorg triton

* Add compute unit diagram

* Remove AutoAWQ

* Add higher res image for Perfetto trace example

* Update link text

* Update fig nums

* Update some formatting

* Update "Inductor"

* Change "Inductor" to TorchInductor

* Add link to official TorchInductor docs

docs/sphinx/_toc.yml.in

@@ -58,6 +58,27 @@ subtrees:
       - file: how-to/rocm-for-ai/train-a-model.rst
       - file: how-to/rocm-for-ai/hugging-face-models.rst
       - file: how-to/rocm-for-ai/deploy-your-model.rst
+  - file: how-to/fine-tuning-llms/index.rst
+    title: Fine-tuning LLMs with ROCm
+    subtrees:
+    - entries:
+      - file: how-to/fine-tuning-llms/overview.rst
+        title: Conceptual overview
+      - file: how-to/fine-tuning-llms/fine-tuning-and-inference.rst
+        subtrees:
+        - entries:
+          - file: how-to/fine-tuning-llms/single-gpu-fine-tuning-and-inference.rst
+            title: Using a single accelerator
+          - file: how-to/fine-tuning-llms/multi-gpu-fine-tuning-and-inference.rst
+            title: Using multiple accelerators
+      - file: how-to/fine-tuning-llms/model-quantization.rst
+      - file: how-to/fine-tuning-llms/model-acceleration-libraries.rst
+      - file: how-to/fine-tuning-llms/llm-inference-frameworks.rst
+      - file: how-to/fine-tuning-llms/optimizing-with-composable-kernel.md
+        title: Optimizing with Composable Kernel
+      - file: how-to/fine-tuning-llms/optimizing-triton-kernel.rst
+        title: Optimizing Triton kernels
+      - file: how-to/fine-tuning-llms/profiling-and-debugging.rst
   - file: how-to/tuning-guides.md
     title: System optimization
     subtrees: