Update ROCm_Installation_Guide_v3.7.md

2026-01-09 22:58:17 -05:00 · 2020-09-29 12:27:58 -07:00 · 2020-09-29 12:27:32 -07:00 · 2020-09-29 12:27:15 -07:00 · 2020-09-29 12:24:59 -07:00 · 2020-09-29 12:24:32 -07:00
6 changed files with 951 additions and 673 deletions
--- a/AMD_ROCm_Release_Notes_v3.7.pdf
+++ b/AMD_ROCm_Release_Notes_v3.7.pdf
--- a/README.md
+++ b/README.md
--- a/ROCm_Installation_Guide_v3.7.md
+++ b/ROCm_Installation_Guide_v3.7.md
@@ -0,0 +1,444 @@
+![AMD Logo](amdblack.jpg)
+
+
+# AMD ROCm Installation Guide v3.7
+
+## Install AMD ROCm
+
+
+-   [Deploying ROCm](#deploying-rocm)
+
+-   [Prerequisites](#prerequisites-1)
+
+-   [Install ROCm on Supported Operating Systems](#supported-operating-systems)
+
+     -   [Ubuntu](#ubuntu)
+     -   [CentOS RHEL](#centos-rhel)
+     -   [SLES 15 Service Pack 1](#sles-15-service-pack-1)
+    
+-   [ROCm Installation Known Issues and
+    Workarounds](#rocm-installation-known-issues-and-workarounds)
+
+
+## Deploying ROCm 
+
+AMD hosts both Debian and RPM repositories for the ROCm v3.x packages.
+
+The following directions show how to install ROCm on supported Debian-based systems such as Ubuntu 18.04.x
+
+**Note**: These directions may not work as written on unsupported Debian-based distributions. For example, newer versions of Ubuntu may
+not be compatible with the rock-dkms kernel driver. In this case, you can exclude the rocm-dkms and rock-dkms packages.
+
+
+## Prerequisites
+
+In this release, AMD ROCm extends support to Ubuntu 20.04, including dual kernel.
+
+The AMD ROCm platform is designed to support the following operating systems:
+
+-   Ubuntu 20.04 (5.4 and 5.6-oem) and 18.04.4 (Kernel 5.3)
+-   CentOS 7.8 & RHEL 7.8 (Kernel 3.10.0-1127) (Using devtoolset-7
+    runtime support)
+-   CentOS 8.2 & RHEL 8.2 (Kernel 4.18.0 ) (devtoolset is not required)
+-   SLES 15 SP1
+
+### FRESH INSTALLATION OF AMD ROCm V3.7 RECOMMENDED
+
+A fresh and clean installation of AMD ROCm v3.7 is recommended. An upgrade from previous releases to AMD ROCm v3.7 is not supported.
+
+**Note**: AMD ROCm release v3.3 or prior releases are not fully compatible with AMD ROCm v3.5 and higher versions. You must perform a
+fresh ROCm installation if you want to upgrade from AMD ROCm v3.3 or older to 3.5 or higher versions and vice-versa.
+
+**Note**: *render group* is required only for Ubuntu v20.04. For all other ROCm supported operating systems, continue to use *video group*.
+
+-   For ROCm v3.5 and releases thereafter, the *clinfo* path is changed
+    to - */opt/rocm/opencl/bin/clinfo*.
+    
+-   For ROCm v3.3 and older releases, the *clinfo* path remains unchanged - */opt/rocm/opencl/bin/x86\_64/clinfo*.
+
+    
+## Supported Operating Systems
+
+### Ubuntu
+
+**Installing a ROCm Package from a Debian Repository**
+
+To install from a Debian Repository:
+
+1.  Run the following code to ensure that your system is up to date:
+
+```
+    sudo apt update
+
+    sudo apt dist-upgrade
+
+    sudo apt install libnuma-dev
+
+    sudo reboot 
+    
+ ```
+ 
+2.  Add the ROCm apt repository.
+
+For Debian-based systems like Ubuntu, configure the Debian ROCm repository as follows:
+
+**Note**: The public key has changed to reflect the new location. You must update to the new location as the old key will be removed in a
+future release.
+
+-   Old Key: <http://repo.radeon.com/rocm/apt/debian/rocm.gpg.key>
+-   New Key: <http://repo.radeon.com/rocm/rocm.gpg.key>
+
+
+```
+    wget -q -O - http://repo.radeon.com/rocm/rocm.gpg.key | sudo apt-key add -
+
+    echo 'deb [arch=amd64] http://repo.radeon.com/rocm/apt/debian/ xenial main' | sudo tee /etc/apt/sources.list.d/rocm.list
+
+```
+
+The gpg key may change; ensure it is updated when installing a new release. If the key signature verification fails while updating, re-add
+the key from the ROCm apt repository.
+
+The current rocm.gpg.key is not available in a standard key ring distribution, but has the following sha1sum hash:
+
+    e85a40d1a43453fe37d63aa6899bc96e08f2817a rocm.gpg.key
+
+3.  Install the ROCm meta-package. Update the appropriate repository list and install the rocm-dkms meta-package:
+
+```
+    sudo apt update
+
+    sudo apt install rocm-dkms && sudo reboot
+ ```
+
+4.  Set permissions. To access the GPU, you must be a user in the video and render groups. Ensure your user account is a member of the video
+    and render groups prior to using ROCm. To identify the groups you are a member of, use the following command:
+
+```
+    groups
+    
+ ```
+
+5.  To add your user to the video and render groups, use the following command with the sudo password:
+
+```
+    sudo usermod -a -G video $LOGNAME
+
+    sudo usermod -a -G render $LOGNAME
+    
+```
+
+6.  By default, you must add any future users to the video and render groups. To add future users to the video and render groups, run the
+    following command:
+
+```
+    echo 'ADD_EXTRA_GROUPS=1' | sudo tee -a /etc/adduser.conf
+
+    echo 'EXTRA_GROUPS=video' | sudo tee -a /etc/adduser.conf
+
+    echo 'EXTRA_GROUPS=render' | sudo tee -a /etc/adduser.conf
+ 
+ ```
+
+7.  Restart the system.
+
+8.  After restarting the system, run the following commands to verify that the ROCm installation is successful. If you see your GPUs
+    listed by both commands, the installation is considered successful.
+
+```
+    /opt/rocm/bin/rocminfo
+    /opt/rocm/opencl/bin/clinfo
+    
+ ```
+
+**Note**: To run the ROCm programs, add the ROCm binaries in your PATH.
+
+```
+
+    echo 'export PATH=$PATH:/opt/rocm/bin:/opt/rocm/profiler/bin:/opt/rocm/opencl/bin' | sudo tee -a /etc/profile.d/rocm.sh
+
+```
+
+#### Uninstalling ROCm Packages from Ubuntu
+
+To uninstall the ROCm packages from Ubuntu 16.04.6 or Ubuntu 18.04.4, run the following command:
+
+    sudo apt autoremove rocm-opencl rocm-dkms rocm-dev rocm-utils && sudo reboot
+
+#### Installing Development Packages for Cross Compilation
+
+It is recommended that you develop and test development packages on different systems. For example, some development or build systems may
+not have an AMD GPU installed. In this scenario, you must avoid installing the ROCk kernel driver on the development system.
+
+Instead, install the following development subset of packages:
+
+    sudo apt update
+    sudo apt install rocm-dev
+
+**Note**: To execute ROCm enabled applications, you must install the full ROCm driver stack on your system.
+
+#### Using Debian-based ROCm with Upstream Kernel Drivers
+
+You can install the ROCm user-level software without installing the AMD\'s custom ROCk kernel driver. To use the upstream kernels, run the
+following commands instead of installing rocm-dkms:
+
+    sudo apt update   
+    sudo apt install rocm-dev 
+    echo 'SUBSYSTEM=="kfd", KERNEL=="kfd", TAG+="uaccess", GROUP="video"' | sudo tee /etc/udev/rules.d/70-kfd.rules
+
+
+### CentOS RHEL
+
+#### CentOS v7.7/RHEL v7.8 and CentOS/RHEL 8.1
+
+This section describes how to install ROCm on supported RPM-based systems such as CentOS v7.7/RHEL v7.8 and CentOS/RHEL v8.1.
+
+#### Preparing RHEL for Installation
+
+RHEL is a subscription-based operating system. You must enable the external repositories to install on the devtoolset-7 environment and the
+dkms support files.
+
+**Note**: The following steps do not apply to the CentOS installation.
+
+1.  The subscription for RHEL must be enabled and attached to a pool ID. See the Obtaining an RHEL image and license page for instructions on
+    registering your system with the RHEL subscription server and attaching to a pool id.
+    
+2.  Enable the following repositories for RHEL v7.x:
+
+```
+    sudo subscription-manager repos --enable rhel-server-rhscl-7-rpms 
+    sudo subscription-manager repos --enable rhel-7-server-optional-rpms
+    sudo subscription-manager repos --enable rhel-7-server-extras-rpms
+
+```
+
+3.  Enable additional repositories by downloading and installing the epel-release-latest-7/epel-release-latest-8 repository RPM:
+
+```
+    sudo rpm -ivh <repo>
+```
+
+For more details,
+
+-   For RHEL v7.x, see
+    <https://dl.fedoraproject.org/pub/epel/epel-release-latest-7.noarch.rpm>
+    
+-   For RHEL v8.x, see
+    <https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm>
+    
+
+4.  Install and set up Devtoolset-7.
+
+**Note**: Devtoolset is not required for CentOS/RHEL v8.x
+
+To setup the Devtoolset-7 environment, follow the instructions on this page: <https://www.softwarecollections.org/en/scls/rhscl/devtoolset-7/>
+
+**Note**: devtoolset-7 is a software collections package and is not supported by AMD.
+
+### Installing CentOS v7.7/v8.1 for DKMS
+
+Use the dkms tool to install the kernel drivers on CentOS/RHEL:
+
+    sudo yum install -y epel-release
+    sudo yum install -y dkms kernel-headers-`uname -r` kernel-devel-`uname -r`
+
+
+#### Installing ROCm 
+
+To install ROCm on your system, follow the instructions below:
+
+1.  Delete the previous versions of ROCm before installing the latest version.
+
+2.  Create a /etc/yum.repos.d/rocm.repo file with the following contents:
+
+     -   CentOS/RHEL 7.x : <http://repo.radeon.com/rocm/yum/rpm>
+     -   CentOS/RHEL 8.x : <http://repo.radeon.com/rocm/centos8/rpm>
+
+```
+    [ROCm] 
+    name=ROCm
+    baseurl=http://repo.radeon.com/rocm/yum/rpm
+    enabled=1
+    gpgcheck=1
+    gpgkey=http://repo.radeon.com/rocm/rocm.gpg.key
+
+```
+
+**Note**: The URL of the repository must point to the location of the repositories' repodata database.
+
+3.  Install ROCm components using the following command:
+
+**Note**: This step is applicable only for CentOS/RHEL v8.1 and is not required for v7.8.
+
+```
+    sudo yum install rocm-dkms && sudo reboot
+    
+```
+
+4.  Restart the system. The rock-dkms component is installed and the /dev/kfd device is now available.
+
+5.  Set permissions. To access the GPU, you must be a user in the video group. Ensure your user account is a member of the video group prior
+    to using ROCm. To identify the groups you are a member of, use the following command:
+
+```
+    groups
+    
+```
+
+6.  To add your user to the video group, use the following command with the sudo password:
+
+```
+    sudo usermod -a -G video $LOGNAME
+ ```
+
+7.  By default, add any future users to the video group. Run the following command to add users to the video group:
+
+```
+    echo 'ADD_EXTRA_GROUPS=1' | sudo tee -a /etc/adduser.conf
+    echo 'EXTRA_GROUPS=video' | sudo tee -a /etc/adduser.conf
+```
+
+**Note**: Before updating to the latest version of the operating system, delete the ROCm packages to avoid DKMS-related issues.
+
+8.  Restart the system.
+
+9.  Test the ROCm installation.
+
+#### Testing the ROCm Installation
+
+After restarting the system, run the following commands to verify that the ROCm installation is successful. If you see your GPUs listed, you
+are good to go!
+
+    /opt/rocm/bin/rocminfo
+    /opt/rocm/opencl/bin/clinfo
+
+**Note**: Add the ROCm binaries in your PATH for easy implementation of the ROCm programs.
+
+    echo 'export PATH=$PATH:/opt/rocm/bin:/opt/rocm/profiler/bin:/opt/rocm/opencl/bin' | sudo tee -a /etc/profile.d/rocm.sh
+
+#### Compiling Applications Using HCC, HIP, and Other ROCm Software
+
+To compile applications or samples, run the following command to use gcc-7.2 provided by the devtoolset-7 environment:
+
+    scl enable devtoolset-7 bash
+    
+
+#### Uninstalling ROCm from CentOS/RHEL
+
+To uninstall the ROCm packages, run the following command:
+
+    sudo yum autoremove rocm-opencl rocm-dkms rock-dkms
+
+#### Installing Development Packages for Cross Compilation
+
+You can develop and test ROCm packages on different systems. For example, some development or build systems may not have an AMD GPU
+installed. In this scenario, you can avoid installing the ROCm kernel driver on your development system. Instead, install the following
+development subset of packages:
+
+    sudo yum install rocm-dev
+
+**Note**: To execute ROCm-enabled applications, you will require a system installed with the full ROCm driver stack.
+
+
+#### Using ROCm with Upstream Kernel Drivers
+
+You can install ROCm user-level software without installing AMD\'s custom ROCk kernel driver. To use the upstream kernel drivers, run the
+following commands
+
+    sudo yum install rocm-dev
+    echo 'SUBSYSTEM=="kfd", KERNEL=="kfd", TAG+="uaccess", GROUP="video"' | sudo tee /etc/udev/rules.d/70-kfd.rules  
+    sudo reboot
+
+**Note**: You can use this command instead of installing rocm-dkms.
+
+**Note**: Ensure you restart the system after ROCm installation.
+
+
+### SLES 15 Service Pack 1
+
+The following section tells you how to perform an install and uninstall ROCm on SLES 15 SP 1.
+
+**Installation**
+
+1.  Install the \"dkms\" package.
+
+```
+    sudo SUSEConnect --product PackageHub/15.1/x86_64
+    sudo zypper install dkms
+```
+2.  Add the ROCm repo.
+
+```
+    sudo zypper clean â€“all
+    sudo zypper addrepo http://repo.radeon.com/rocm/zyp/zypper/ rocm
+    sudo zypper ref
+    sudo rpm --import http://repo.radeon.com/rocm/rocm.gpg.key
+    sudo zypper --gpg-auto-import-keys install rocm-dkms
+    sudo reboot
+```
+3.  Run the following command once
+
+```
+    cat <<EOF | sudo tee /etc/modprobe.d/10-unsupported-modules.conf
+    allow_unsupported_modules 1
+    EOF
+    sudo modprobe amdgpu
+```
+4.  Verify the ROCm installation.
+
+5.  Run /opt/rocm/bin/rocminfo and /opt/rocm/opencl/bin/clinfo commands to list the GPUs and verify that the ROCm installation is
+    successful.
+    
+6.  Set permissions. To access the GPU, you must be a user in the video group. Ensure your user account is a member of the video group prior to using ROCm. To identify the groups you are a member of, use the following command:
+
+    groups
+
+7.  To add your user to the video group, use the following command with the sudo password:
+
+```
+    sudo usermod -a -G video $LOGNAME
+```
+8.  By default, add any future users to the video group. Run the following command to add users to the video group:
+
+```
+    echo 'ADD_EXTRA_GROUPS=1' | sudo tee -a /etc/adduser.conf
+    echo 'EXTRA_GROUPS=video' | sudo tee -a /etc/adduser.conf
+```
+9.  Restart the system.
+
+10. Test the basic ROCm installation.
+
+11. After restarting the system, run the following commands to verify that the ROCm installation is successful. If you see your GPUs
+    listed by both commands, the installation is considered successful.
+
+```
+    /opt/rocm/bin/rocminfo
+    /opt/rocm/opencl/bin/clinfo
+```
+**Note**: To run the ROCm programs more efficiently, add the ROCm binaries in your PATH.
+
+     echo \'export
+     PATH=\$PATH:/opt/rocm/bin:/opt/rocm/profiler/bin:/opt/rocm/opencl/bin\'\|sudo
+     tee -a /etc/profile.d/rocm.sh
+
+#### Uninstallation
+
+To uninstall, use the following command:
+
+    sudo zypper remove rocm-opencl rocm-dkms rock-dkms
+
+**Note**: Ensure all other installed packages/components are removed. 
+
+**Note**: Ensure all the content in the /opt/rocm directory is completely removed. If the command does not remove all the ROCm components/packages, ensure
+you remove them individually.
+
+
+## ROCm Installation Known Issues and Workarounds
+
+### Closed source components
+
+The ROCm platform relies on some closed source components to provide functionalities like HSA image support. These components are only
+available through the ROCm repositories, and they may be deprecated or become open source components in the future. These components are made
+available in the following packages:
+
+     -   hsa-ext-rocr-dev
--- a/amdblack.jpg
+++ b/amdblack.jpg
--- a/default.xml
+++ b/default.xml
@@ -1,6 +1,5 @@
 <?xml version="1.0" encoding="UTF-8"?>
 <manifest>
-
    <remote name="roc-github"
            fetch="http://github.com/RadeonOpenCompute/" />
    <remote name="rocm-devtools"
@@ -11,64 +10,70 @@
            fetch="https://github.com/GPUOpen-ProfessionalCompute-Libraries/" />
    <remote name="gpuopen-tools"
            fetch="https://github.com/GPUOpen-Tools/" />
-
-    <default revision="refs/tags/roc-2.7.0"
+    <remote name="KhronosGroup"
+            fetch="https://github.com/KhronosGroup/" />
+    <default revision="refs/tags/rocm-3.7.0"
             remote="roc-github"
             sync-c="true"
             sync-j="4" />
-
+    <!--list of projects for ROCM-->
    <project name="ROCK-Kernel-Driver" />
    <project name="ROCT-Thunk-Interface" />
    <project name="ROCR-Runtime" />
    <project name="ROC-smi" />
-    <project name="rocm-cmake" revision="master-rocm-2.7" />
+    <project name="rocm_smi_lib" remote="roc-github" />
+    <project name="rocm-cmake" />
    <project name="rocminfo" />
-    <project name="rocprofiler" remote="rocm-devtools" revision="refs/tags/roc-2.6.0"/>
-    <project name="roctracer" remote="rocm-devtools" revision="refs/tags/roc-2.7.2"/>
-    <!-- If you want to get the full OpenCL runtime, there is a separate repo
-         manifest that is more authoritative than the copy in this file. It can
-         be found at the following URL:
-         https://github.com/RadeonOpenCompute/ROCm-OpenCL-Runtime/blob/roc-2.0.0/opencl.xml -->
-    <remote name="KhronosGroup" fetch="https://github.com/KhronosGroup/" />
+    <project name="rocprofiler" remote="rocm-devtools" />
+    <project name="roctracer" remote="rocm-devtools" />
    <project name="ROCm-OpenCL-Runtime" />
-    <project path="ROCm-OpenCL-Runtime/compiler/driver" name="ROCm-OpenCL-Driver"/>
-    <project path="ROCm-OpenCL-Runtime/compiler/llvm" name="llvm" revision="refs/tags/roc-ocl-2.7.0" />
-    <project path="ROCm-OpenCL-Runtime/compiler/llvm/tools/clang" name="clang" />
-    <project path="ROCm-OpenCL-Runtime/compiler/llvm/tools/lld" name="lld" revision="refs/tags/roc-ocl-2.7.0" />
-    <project path="ROCm-OpenCL-Runtime/library/amdgcn" name="ROCm-Device-Libs" revision="refs/tags/roc-ocl-2.7.0" />
-    <project path="ROCm-OpenCL-Runtime/api/opencl/khronos/icd" name="OpenCL-ICD-Loader" remote="KhronosGroup" revision="261c1288aadd9dcc4637aca08332f603e6c13715" />
-
+    <project path="ROCm-OpenCL-Runtime/api/opencl/khronos/icd" name="OpenCL-ICD-Loader" remote="KhronosGroup" revision="6c03f8b58fafd9dd693eaac826749a5cfad515f8" />
    <project name="clang-ocl" />
-    <!-- HCC needs to be recursively synced to get it submodules -->
-    <project name="hcc" sync-s="true" revision="refs/tags/roc-hcc-2.7.2" />
-    <project name="HCC-Example-Application" remote="rocm-devtools" revision="ffd6533305e79eed667badd3c4cdb7879a1281b8" />
-    <project name="HIP" remote="rocm-devtools" revision="refs/tags/roc-2.7.2" />
+    <!--HIP Projects-->
+    <project name="HIP" remote="rocm-devtools" />
    <project name="HIP-Examples" remote="rocm-devtools" />
+    <project name="ROCclr" remote="rocm-devtools" />
+    <project name="HIPIFY" remote="rocm-devtools" />
    <!-- The following projects are all associated with the AMDGPU LLVM compiler -->
-    <project name="llvm" path="llvm_amd-common" revision="refs/tags/roc-ocl-2.7.0" />
-    <project name="lld" path="llvm_amd-common/lld" revision="refs/tags/roc-ocl-2.7.0" />
-    <project name="clang" path="llvm_amd-common/clang" />
-    <project name="ROCm-Device-Libs" revision="refs/tags/roc-ocl-2.7.0" />
-    <project name="atmi" revision="refs/tags/rocm_2.7.0" />
+    <project name="llvm-project" path="llvm_amd-stg-open" />
+    <project name="ROCm-Device-Libs" />
+    <project name="atmi" />
    <project name="ROCm-CompilerSupport" />
-    <project name="rocr_debug_agent" remote="rocm-devtools" />
+    <project name="rocr_debug_agent" remote="rocm-devtools" revision="refs/tags/roc-3.7.0" />
    <project name="rocm_bandwidth_test" />
    <project name="RCP" remote="gpuopen-tools" revision="3a49405a1500067c49d181844ec90aea606055bb" />
-
+    <!-- gdb projects -->
+    <project name="ROCgdb" remote="rocm-devtools" />
+    <project name="ROCdbgapi" remote="rocm-devtools" />
    <!-- ROCm Libraries -->
-    <project name="rocBLAS" remote="rocm-swplat" revision="refs/tags/rocm-2.7" />
-    <project name="hipBLAS" remote="rocm-swplat" revision="refs/tags/rocm-2.7" />
-    <project name="rocFFT" remote="rocm-swplat" revision="refs/tags/rocm-2.7" />
-    <project name="rocRAND" remote="rocm-swplat" revision="refs/tags/rocm-2.7" />
-    <project name="rocSPARSE" remote="rocm-swplat" revision="refs/tags/rocm-2.7" />
-    <project name="hipSPARSE" remote="rocm-swplat" revision="refs/tags/rocm-2.7" />
-    <project name="rocALUTION" remote="rocm-swplat" revision="refs/tags/rocm-2.7" />
-    <project name="MIOpenGEMM" remote="rocm-swplat" revision="9547fb9e8499a5a9f16da83b1e6b749de82dd9fb" />
-    <project name="MIOpen" remote="rocm-swplat" revision="refs/tags/roc-2.7.0" />
-    <project name="rocm_smi_lib" />
-    <project name="rccl" remote="rocm-swplat" revision="refs/tags/2.7.0" />
-    <project name="MIVisionX" remote="gpuopen-libs" revision="refs/tags/1.3.0" />
-    <project name="rocThrust" remote="rocm-swplat" revision="refs/tags/rocm-2.7" />
-    <project name="hipCUB" remote="rocm-swplat" revision="refs/tags/rocm-2.7" />
-
+    <project name="rocBLAS" remote="rocm-swplat" />
+    <project name="hipBLAS" remote="rocm-swplat" />
+    <project name="rocFFT" remote="rocm-swplat" />
+    <project name="rocRAND" remote="rocm-swplat" />
+    <project name="rocSPARSE" remote="rocm-swplat" />
+    <project name="rocSOLVER" remote="rocm-swplat" />
+    <project name="hipSPARSE" remote="rocm-swplat" />
+    <project name="rocALUTION" remote="rocm-swplat" />
+    <project name="MIOpenGEMM" remote="rocm-swplat" />
+    <project name="MIOpen" remote="rocm-swplat" />
+    <project name="rccl" remote="rocm-swplat" />
+    <project name="MIVisionX" remote="gpuopen-libs" />
+    <project name="rocThrust" remote="rocm-swplat" />
+    <project name="hipCUB" remote="rocm-swplat" />
+    <project name="rocPRIM" remote="rocm-swplat" />
+    <project name="AMDMIGraphX" remote="rocm-swplat" revision="e66968a25f9342a28af1157b06cbdbf8579c5519" />
+    <project name="ROCmValidationSuite" remote="rocm-devtools" />
+    <!-- Projects for AOMP -->
+    <project name="ROCT-Thunk-Interface" path="aomp/roct-thunk-interface" remote="roc-github" />
+    <project name="ROCR-Runtime" path="aomp/rocr-runtime" remote="roc-github" />
+    <project name="ROCm-Device-Libs" path="aomp/rocm-device-libs" remote="roc-github" />
+    <project name="ROCm-CompilerSupport" path="aomp/rocm-compilersupport" remote="roc-github" />
+    <project name="rocminfo" path="aomp/rocminfo" remote="roc-github" />
+    <project name="HIP" path="aomp/hip-on-vdi" remote="rocm-devtools" />
+    <project name="aomp" path="aomp/aomp" remote="rocm-devtools" />
+    <project name="aomp-extras" path="aomp/aomp-extras" remote="rocm-devtools" />
+    <project name="flang" path="aomp/flang" remote="rocm-devtools" />
+    <project name="amd-llvm-project" path="aomp/amd-llvm-project" remote="rocm-devtools" />
+    <project name="ROCclr" path="aomp/vdi" remote="rocm-devtools" />
+    <project name="ROCm-OpenCL-Runtime" path="aomp/opencl-on-vdi" remote="roc-github" />
 </manifest>
--- a/version_history.md
+++ b/version_history.md
@@ -1,7 +1,13 @@
 ## ROCm Version History
 This file contains archived version history information for the [ROCm project](https://github.com/RadeonOpenCompute/ROCm)

-### Current ROCm Version: 2.7.2
+### Current ROCm Version: 3.3
+- [New features and enhancements in ROCm v3.1](#new-features-and-enhancements-in-rocm-v31)
+- [New features and enhancements in ROCm v3.0](#new-features-and-enhancements-in-rocm-v30)
+- [New features and enhancements in ROCm v2.10](#new-features-and-enhancements-in-rocm-v210)
+- [New features and enhancements in ROCm 2.9](#new-features-and-enhancements-in-rocm-29)
+- [New features and enhancements in ROCm 2.8](#new-features-and-enhancements-in-rocm-28)
+- [New features and enhancements in ROCm 2.7.2](#new-features-and-enhancements-in-rocm-272)
 - [New features and enhancements in ROCm 2.7](#new-features-and-enhancements-in-rocm-27)
 - [New features and enhancements in ROCm 2.6](#new-features-and-enhancements-in-rocm-26)
 - [New features and enhancements in ROCm 2.5](#new-features-and-enhancements-in-rocm-25)
@@ -20,6 +26,132 @@ This file contains archived version history information for the [ROCm project](h
 - [New Features as of ROCm 1.5](#new-features-as-of-rocm-15)


+## New features and enhancements in ROCm v3.2
+The AMD ROCm v3.2 release was not productized.
+
+## New features and enhancements in ROCm v3.1
+### Change in ROCm Installation Directory Structure
+
+A fresh installation of the ROCm toolkit installs the packages in the /opt/rocm-<version> folder. Previously, ROCm toolkit packages were installed in the /opt/rocm folder.
+
+### Reliability, Accessibility, and Serviceability Support for Vega 7nm
+
+The Reliability, Accessibility, and Serviceability (RAS) support for Vega7nm is now available.
+
+### SLURM Support for AMD GPU
+
+SLURM (Simple Linux Utility for Resource Management) is an open source, fault-tolerant, and highly scalable cluster management and job scheduling system for large and small Linux clusters.
+
+
+## New features and enhancements in ROCm v3.0
+### Support for CentOS RHEL v7.7 <a id="centos-anchor"></a> 
+Support is extended for CentOS/RHEL v7.7 in the ROCm v3.0 release. For more information about the CentOS/RHEL v7.7 release, see:
+
+[CentOS/RHEL](https://centos.org/forums/viewtopic.php?t=71657)
+
+
+### Initial distribution of AOMP 0.7-5 in ROCm v3.0 <a id="aomp-anchor"></a> 
+The code base for this release of AOMP is the Clang/LLVM 9.0 sources as of October 8th, 2019. The LLVM-project branch used to build this release is AOMP-191008. It is now locked. With this release, an artifact tarball of the entire source tree is created. This tree includes a Makefile in the root directory used to build AOMP from the release tarball. You can use Spack to build AOMP from this source tarball or build manually without Spack.
+
+For more information about AOMP 0.7-5, see: [AOMP](https://github.com/ROCm-Developer-Tools/aomp/tree/roc-3.0.0)
+
+
+### Fast Fourier Transform Updates
+The Fast Fourier Transform (FFT) is an efficient algorithm for computing the Discrete Fourier Transform. Fast Fourier transforms are used in signal processing, image processing, and many other areas. The following real FFT performance change is made in the ROCm v3.0 release:
+
+•	Implement efficient real/complex 2D transforms for even lengths.
+
+Other improvements:
+
+•	More 2D test coverage sizes.
+
+•	Fix buffer allocation error for large 1D transforms.
+
+•	C++ compatibility improvements.
+
+### MemCopy Enhancement for rocProf
+In the v3.0 release, the rocProf tool is enhanced with an additional capability to dump asynchronous GPU memcopy information into a .csv file. You can use the '-hsa-trace' option to create the results_mcopy.csv file.
+Future enhancements will include column labels.
+
+
+### New features and enhancements in ROCm v2.10
+#### rocBLAS Support for Complex GEMM
+The rocBLAS library is a gpu-accelerated implementation of the standard Basic Linear Algebra Subroutines (BLAS). rocBLAS is designed to enable you to develop algorithms, including high performance computing, image analysis, and machine learning.
+
+In the AMD ROCm release v2.10, support is extended to the General Matrix Multiply (GEMM) routine for multiple small matrices processed simultaneously for rocBLAS in AMD Radeon Instinct MI50. Both single and double precision, CGEMM and ZGEMM, are now supported in rocBLAS.
+
+#### Support for SLES 15 SP1
+In the AMD ROCm v2.10 release, support is added for SUSE Linux® Enterprise Server (SLES) 15 SP1. SLES is a modular operating system for both multimodal and traditional IT.
+
+#### Code Marker Support for rocProfiler and rocTracer Libraries
+Code markers provide the external correlation ID for the calling thread. This function indicates that the calling thread is entering and leaving an external API region.
+
+### New features and enhancements in ROCm 2.9
+
+#### Initial release for Radeon Augmentation Library(RALI)
+The AMD Radeon Augmentation Library (RALI) is designed to efficiently decode and process images from a variety of storage formats and modify them through a processing graph programmable by the user. RALI currently provides C API.
+
+#### Quantization in MIGraphX v0.4
+MIGraphX 0.4 introduces support for fp16 and int8 quantization. For additional details, as well as other new MIGraphX features, see [MIGraphX documentation](https://github.com/ROCmSoftwarePlatform/AMDMIGraphX/wiki/Getting-started:-using-the-new-features-of-MIGraphX-0.4).
+
+#### rocSparse csrgemm
+csrgemm enables the user to perform matrix-matrix multiplication with two sparse matrices in CSR format.
+
+#### Singularity Support
+ROCm 2.9 adds support for Singularity container version 2.5.2.
+
+#### Initial release of rocTX
+ROCm 2.9 introduces rocTX, which provides a C API for code markup for performance profiling.  This initial release of rocTX supports annotation of code ranges and ASCII markers.  For an example, see this [code](https://github.com/ROCm-Developer-Tools/roctracer/blob/amd-master/test/MatrixTranspose_test/MatrixTranspose.cpp).
+
+#### Added support for Ubuntu 18.04.3
+Ubuntu 18.04.3 is now supported in ROCm 2.9.
+
+
+
+### New features and enhancements in ROCm 2.8
+
+#### Support for NCCL2.4.8 API
+Implements ncclCommAbort() and ncclCommGetAsyncError() to match the NCCL 2.4.x API
+
+### New features and enhancements in ROCm 2.7.2
+
+This release is a hotfix for ROCm release 2.7.
+
+#### Issues fixed in ROCm 2.7.2
+
+##### A defect in upgrades from older ROCm releases has been fixed.
+
+##### rocprofiler --hiptrace and --hsatrace fails to load roctracer library
+In ROCm 2.7.2, rocprofiler --hiptrace and --hsatrace fails to load roctracer library defect has been fixed.  
+To generate traces, please provide directory path also using the parameter: -d <$directoryPath> for example:
+```shell
+/opt/rocm/bin/rocprof  --hsa-trace -d $PWD/traces /opt/rocm/hip/samples/0_Intro/bit_extract/bit_extract
+  ```
+All traces and results will be saved under $PWD/traces path
+
+#### Upgrading from ROCm 2.7 to 2.7.2
+
+To upgrade, please remove 2.7 completely as specified [for ubuntu](#how-to-uninstall-from-ubuntu-1604-or-Ubuntu-1804) or [for centos/rhel](#how-to-uninstall-rocm-from-centosrhel-76), and install 2.7.2 as per instructions [install instructions](#installing-from-amd-rocm-repositories)
+
+#### Other notes
+
+  To use rocprofiler features, the following steps need to be completed before using rocprofiler:
+
+  ##### Step-1: Install roctracer
+
+###### Ubuntu 16.04 or Ubuntu 18.04:
+
+  ```shell
+  sudo apt install roctracer-dev
+  ```
+
+######  CentOS/RHEL 7.6:
+
+  ```shell
+  sudo yum install roctracer-dev
+  ```
+  ##### Step-2: Add /opt/rocm/roctracer/lib to LD_LIBRARY_PATH
+  
 ### New features and enhancements in ROCm 2.7

 #### [rocFFT] Real FFT Functional