mirror of
https://github.com/nod-ai/AMD-SHARK-Studio.git
synced 2026-02-19 11:56:43 -05:00
6853a33728
Restricts quantized matmul reassociation flags to cpu compiles of llama2 and pins IREE versions for shark 1.0
CodeGen Setup using SHARK-server
Setup Server
- clone SHARK and setup the venv
- host the server using
python apps/stable_diffusion/web/index.py --api --server_port=<PORT> - default server address is
http://0.0.0.0:8080
Setup Client
- fauxpilot-vscode (VSCode Extension):
- Code for the extension can be found here
- PreReq: VSCode extension (will need
nodejsandnpmto compile and run the extension) - Compile and Run the extension on VSCode (press F5 on VSCode), this opens a new VSCode window with the extension running
- Open VSCode settings, search for fauxpilot in settings and modify
server : http://<IP>:<PORT>,Model : codegen,Max Lines : 30
- Others (REST API curl, OpenAI Python bindings) as shown here
- using Github Copilot VSCode extension with SHARK-server needs more work to be functional.