AMD-SHARK-Studio

mirror of https://github.com/nod-ai/AMD-SHARK-Studio.git synced 2026-02-19 11:56:43 -05:00

Files

Eliasj42 5203679f1f Bandaid fix 2 (#1728 )

* download all mlirs

* fixed install method

* download all mlirs (#1727)

Co-authored-by: Elias Joseph <elias@nod-labs.com>

* added taggs

* fix name check for file existence

* Remove SD from all_models.csv (#1706)

Removes SD from pytests as it has its own test suite.

* gpt_langchain.py fixes for pydantic (#1722)

* removed dead code

---------

Co-authored-by: Elias Joseph <elias@nod-labs.com>
Co-authored-by: PhaneeshB <b.phaneesh@gmail.com>
Co-authored-by: Ean Garvey <87458719+monorimet@users.noreply.github.com>
Co-authored-by: Stefan Kapusniak <121311569+one-lithe-rune@users.noreply.github.com>

2023-08-08 12:14:57 -05:00

langchain

[Langchain] Expand pipelines to fix token streaming issue

2023-08-08 10:27:23 +05:30

scripts

Bandaid fix 2 (#1728 )

2023-08-08 12:14:57 -05:00

src

added functionality for int8 vicuna and 4 shards (#1712 )

2023-08-04 14:05:05 -05:00

README.md

Add README for CodeGen server

2023-07-19 23:10:23 +05:30

utils.py

[MiniGPT4] Add MiniGPT4 to SHARK (#1554 )

2023-07-25 09:42:27 -07:00

README.md

CodeGen Setup using SHARK-server

Setup Server

clone SHARK and setup the venv
host the server using python apps/stable_diffusion/web/index.py --api --server_port=<PORT>
default server address is http://0.0.0.0:8080

Setup Client

fauxpilot-vscode (VSCode Extension):

Code for the extension can be found here
PreReq: VSCode extension (will need nodejs and npm to compile and run the extension)
Compile and Run the extension on VSCode (press F5 on VSCode), this opens a new VSCode window with the extension running
Open VSCode settings, search for fauxpilot in settings and modify server : http://<IP>:<PORT>, Model : codegen , Max Lines : 30

Others (REST API curl, OpenAI Python bindings) as shown here

using Github Copilot VSCode extension with SHARK-server needs more work to be functional.