AMD-SHARK-Studio

mirror of https://github.com/nod-ai/AMD-SHARK-Studio.git synced 2026-02-19 11:56:43 -05:00

Files

dependabot[bot] f41ad87ef6 Bump langchain in /apps/language_models/langchain (#1926 )

Bumps [langchain](https://github.com/langchain-ai/langchain) from 0.0.202 to 0.0.325.
- [Release notes](https://github.com/langchain-ai/langchain/releases)
- [Commits](https://github.com/langchain-ai/langchain/compare/v0.0.202...v0.0.325)

---
updated-dependencies:
- dependency-name: langchain
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

2023-11-09 11:03:47 -06:00

langchain

Bump langchain in /apps/language_models/langchain (#1926 )

2023-11-09 11:03:47 -06:00

scripts

fix vicuna cli vulkan

2023-11-09 22:27:13 +05:30

src

Add support for Falcon-40b-GPTQ

2023-11-06 19:49:19 +05:30

README.md

Add README for CodeGen server

2023-07-19 23:10:23 +05:30

shark_llama_cli.spec

Fix llama2 13b crashing + add spec file for CLI execution of Llama (#1797 )

2023-08-25 09:36:09 -05:00

utils.py

[Llama2] Fix wrong Vulkan device ID + Add Vulkan compile flags

2023-09-22 22:24:18 +05:30

README.md

CodeGen Setup using SHARK-server

Setup Server

clone SHARK and setup the venv
host the server using python apps/stable_diffusion/web/index.py --api --server_port=<PORT>
default server address is http://0.0.0.0:8080

Setup Client

fauxpilot-vscode (VSCode Extension):

Code for the extension can be found here
PreReq: VSCode extension (will need nodejs and npm to compile and run the extension)
Compile and Run the extension on VSCode (press F5 on VSCode), this opens a new VSCode window with the extension running
Open VSCode settings, search for fauxpilot in settings and modify server : http://<IP>:<PORT>, Model : codegen , Max Lines : 30

Others (REST API curl, OpenAI Python bindings) as shown here

using Github Copilot VSCode extension with SHARK-server needs more work to be functional.