AMD-SHARK-Studio

mirror of https://github.com/nod-ai/AMD-SHARK-Studio.git synced 2026-04-03 03:00:17 -04:00

Files

Vivek Khandelwal d7092aafaa Fix multiple issue for Langchain

This commit fixes the following issue for the Langchain:
1.) Web UI not able to fetch results.
2.) For each query model getting reloaded.
3.) SHARK module not using user provided device and precision.
4.) Create a class for main Langchain code.
5.) Misc issues

2023-07-21 21:56:27 +05:30

langchain

Fix multiple issue for Langchain

2023-07-21 21:56:27 +05:30

scripts

Add support for Llama-2-70b for web and cli, and for hf_auth_token

2023-07-20 14:57:48 +05:30

src

Add support for Llama-2-70b for web and cli, and for hf_auth_token

2023-07-20 14:57:48 +05:30

README.md

Add README for CodeGen server

2023-07-19 23:10:23 +05:30

utils.py

mega vicuna merge

2023-06-14 19:06:29 +05:30

README.md

CodeGen Setup using SHARK-server

Setup Server

clone SHARK and setup the venv
host the server using python apps/stable_diffusion/web/index.py --api --server_port=<PORT>
default server address is http://0.0.0.0:8080

Setup Client

fauxpilot-vscode (VSCode Extension):

Code for the extension can be found here
PreReq: VSCode extension (will need nodejs and npm to compile and run the extension)
Compile and Run the extension on VSCode (press F5 on VSCode), this opens a new VSCode window with the extension running
Open VSCode settings, search for fauxpilot in settings and modify server : http://<IP>:<PORT>, Model : codegen , Max Lines : 30

Others (REST API curl, OpenAI Python bindings) as shown here

using Github Copilot VSCode extension with SHARK-server needs more work to be functional.