[vulkan] Update vmfb naming

Update vmfb naming for vulkan devices in order to resolve naming
conflicts in the presence of multiple vulkan devices.

Signed-Off-by: Gaurav Shukla <gaurav@nod-labs.com>
This commit is contained in:
Gaurav Shukla
2023-09-26 21:45:28 +05:30
parent c9d6870105
commit 82f833e87d
2 changed files with 5 additions and 1 deletions

View File

@@ -228,6 +228,7 @@ def chat(
hf_model_path=model_path,
hf_auth_token=args.hf_auth_token,
device=device,
vulkan_target_triple=vulkan_target_triple,
precision=precision,
max_num_tokens=max_toks,
download_vmfb=download_vmfb,