github/AMD-SHARK-Studio
1
1
Fork 0
mirror of https://github.com/nod-ai/AMD-SHARK-Studio.git synced 2026-04-03 03:00:17 -04:00
Code Issues Packages Projects Releases Wiki Activity

download all mlirs (#1727)

Browse Source 
Co-authored-by: Elias Joseph <elias@nod-labs.com>
This commit is contained in:
Eliasj42
2023-08-04 16:22:06 -07:00
committed by Elias Joseph
parent 5a091ae3f0
commit 167c6cc349
1 changed files with 3 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
apps/language_models/scripts/vicuna.py
View File

@@ -1201,6 +1201,9 @@ class ShardedVicuna(VicunaBase):
return self.get_sharded_model(
device=device, compressed=self.compressed
)
return self.get_sharded_model(
device=device, compressed=self.compressed
)
def generate(self, prompt, cli=False):
# TODO: refactor for cleaner integration