mirror of
https://github.com/nod-ai/AMD-SHARK-Studio.git
synced 2026-02-19 11:56:43 -05:00
310d5d0a49
* [Llama2] Add a fix for Llama2 13B downloading/crashing -- This commit fixes downloading/crashing of llama2 13B on wrong .mlir file. -- Also adds support for downloading vmfb from shark_tank in CLI. Signed-off-by: Abhishek Varma <abhishek@nod-labs.com> * [llama2] Add a spec file to run Llama/Vicuna CLI exe -- This commit adds a spec file to run Llama/Vicuna CLI exe. Signed-off-by: Abhishek Varma <abhishek@nod-labs.com> --------- Signed-off-by: Abhishek Varma <abhishek@nod-labs.com>
CodeGen Setup using SHARK-server
Setup Server
- clone SHARK and setup the venv
- host the server using
python apps/stable_diffusion/web/index.py --api --server_port=<PORT> - default server address is
http://0.0.0.0:8080
Setup Client
- fauxpilot-vscode (VSCode Extension):
- Code for the extension can be found here
- PreReq: VSCode extension (will need
nodejsandnpmto compile and run the extension) - Compile and Run the extension on VSCode (press F5 on VSCode), this opens a new VSCode window with the extension running
- Open VSCode settings, search for fauxpilot in settings and modify
server : http://<IP>:<PORT>,Model : codegen,Max Lines : 30
- Others (REST API curl, OpenAI Python bindings) as shown here
- using Github Copilot VSCode extension with SHARK-server needs more work to be functional.