mirror of
https://github.com/microsoft/autogen.git
synced 2026-04-20 03:02:16 -04:00
6a3acc4548
This pull request introduces the integration of the `llama-cpp` library into the `autogen-ext` package, with significant changes to the project dependencies and the implementation of a new chat completion client. The most important changes include updating the project dependencies, adding a new module for the `LlamaCppChatCompletionClient`, and implementing the client with various functionalities. ### Project Dependencies: * [`python/packages/autogen-ext/pyproject.toml`](diffhunk://#diff-095119d4420ff09059557bd25681211d1772c2be0fbe0ff2d551a3726eff1b4bR34-R38): Added `llama-cpp-python` as a new dependency under the `llama-cpp` section. ### New Module: * [`python/packages/autogen-ext/src/autogen_ext/models/llama_cpp/__init__.py`](diffhunk://#diff-42ae3ba17d51ca917634c4ea3c5969cf930297c288a783f8d9c126f2accef71dR1-R8): Introduced the `LlamaCppChatCompletionClient` class and handled import errors with a descriptive message for missing dependencies. ### Implementation of `LlamaCppChatCompletionClient`: * `python/packages/autogen-ext/src/autogen_ext/models/llama_cpp/_llama_cpp_completion_client.py`: - Added the `LlamaCppChatCompletionClient` class with methods to initialize the client, create chat completions, detect and execute tools, and handle streaming responses. - Included detailed logging for debugging purposes and implemented methods to count tokens, track usage, and provide model information.…d chat capabilities <!-- Thank you for your contribution! Please review https://microsoft.github.io/autogen/docs/Contribute before opening a pull request. --> <!-- Please add a reviewer to the assignee section when you create a PR. If you don't have the access to it, we will shortly find a reviewer and assign them to your PR. --> ## Why are these changes needed? <!-- Please give a short summary of the change and the problem this solves. --> ## Related issue number <!-- For example: "Closes #1234" --> ## Checks - [X ] I've included any doc changes needed for https://microsoft.github.io/autogen/. See https://microsoft.github.io/autogen/docs/Contribute#documentation to build and test documentation locally. - [X ] I've added tests (if relevant) corresponding to the changes introduced in this PR. - [ X] I've made sure all auto checks have passed. --------- Co-authored-by: aribornstein <x@x.com> Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com> Co-authored-by: Ryan Sweet <rysweet@microsoft.com>
359 lines
9.8 KiB
YAML
359 lines
9.8 KiB
YAML
name: Checks
|
|
|
|
on:
|
|
push:
|
|
branches:
|
|
- main
|
|
- staging
|
|
pull_request:
|
|
branches:
|
|
- main
|
|
- staging
|
|
|
|
jobs:
|
|
format:
|
|
runs-on: ubuntu-latest
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
- uses: astral-sh/setup-uv@v5
|
|
with:
|
|
enable-cache: true
|
|
version: "0.5.18"
|
|
- uses: actions/setup-python@v5
|
|
with:
|
|
python-version: "3.11"
|
|
- run: uv sync --locked --all-extras
|
|
working-directory: ./python
|
|
- name: Run task
|
|
run: |
|
|
source ${{ github.workspace }}/python/.venv/bin/activate
|
|
poe fmt --check
|
|
working-directory: ./python
|
|
|
|
lint:
|
|
runs-on: ubuntu-latest
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
- uses: astral-sh/setup-uv@v5
|
|
with:
|
|
enable-cache: true
|
|
version: "0.5.18"
|
|
- uses: actions/setup-python@v5
|
|
with:
|
|
python-version: "3.11"
|
|
- run: uv sync --locked --all-extras
|
|
working-directory: ./python
|
|
- name: Run task
|
|
run: |
|
|
source ${{ github.workspace }}/python/.venv/bin/activate
|
|
poe lint
|
|
working-directory: ./python
|
|
|
|
mypy:
|
|
runs-on: ubuntu-latest
|
|
strategy:
|
|
matrix:
|
|
package:
|
|
[
|
|
"./packages/autogen-core",
|
|
"./packages/agbench",
|
|
"./packages/autogen-ext",
|
|
"./packages/autogen-agentchat",
|
|
"./packages/magentic-one-cli",
|
|
]
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
- uses: astral-sh/setup-uv@v5
|
|
with:
|
|
enable-cache: true
|
|
version: "0.5.18"
|
|
- uses: actions/setup-python@v5
|
|
with:
|
|
python-version: "3.11"
|
|
- run: uv sync --locked --all-extras
|
|
working-directory: ./python
|
|
- name: Run task
|
|
run: |
|
|
source ${{ github.workspace }}/python/.venv/bin/activate
|
|
poe --directory ${{ matrix.package }} mypy
|
|
working-directory: ./python
|
|
|
|
pyright:
|
|
runs-on: ubuntu-latest
|
|
strategy:
|
|
matrix:
|
|
package:
|
|
[
|
|
"./packages/autogen-core",
|
|
"./packages/agbench",
|
|
"./packages/autogen-ext",
|
|
"./packages/autogen-agentchat",
|
|
"./packages/magentic-one-cli",
|
|
]
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
- uses: astral-sh/setup-uv@v5
|
|
with:
|
|
enable-cache: true
|
|
version: "0.5.18"
|
|
- uses: actions/setup-python@v5
|
|
with:
|
|
python-version: "3.11"
|
|
- run: uv sync --locked --all-extras
|
|
working-directory: ./python
|
|
- name: Run task
|
|
run: |
|
|
source ${{ github.workspace }}/python/.venv/bin/activate
|
|
poe --directory ${{ matrix.package }} pyright
|
|
working-directory: ./python
|
|
|
|
test:
|
|
runs-on: ubuntu-latest
|
|
strategy:
|
|
matrix:
|
|
package:
|
|
[
|
|
"./packages/autogen-core",
|
|
"./packages/autogen-ext",
|
|
"./packages/autogen-agentchat",
|
|
]
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
- uses: astral-sh/setup-uv@v5
|
|
with:
|
|
enable-cache: true
|
|
version: "0.5.18"
|
|
- uses: actions/setup-python@v5
|
|
with:
|
|
python-version: "3.11"
|
|
- name: Run uv sync
|
|
run: |
|
|
uv sync --locked --all-extras
|
|
echo "PKG_NAME=$(basename '${{ matrix.package }}')" >> $GITHUB_ENV
|
|
|
|
working-directory: ./python
|
|
- name: Run task
|
|
run: |
|
|
source ${{ github.workspace }}/python/.venv/bin/activate
|
|
poe --directory ${{ matrix.package }} test
|
|
working-directory: ./python
|
|
|
|
- name: Move coverage file
|
|
run: |
|
|
mv ${{ matrix.package }}/coverage.xml coverage_${{ env.PKG_NAME }}.xml
|
|
working-directory: ./python
|
|
|
|
- name: Upload coverage artifact
|
|
uses: actions/upload-artifact@v4
|
|
with:
|
|
name: coverage-${{ env.PKG_NAME }}
|
|
path: ./python/coverage_${{ env.PKG_NAME }}.xml
|
|
|
|
test-grpc:
|
|
runs-on: ubuntu-latest
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
- uses: astral-sh/setup-uv@v5
|
|
with:
|
|
enable-cache: true
|
|
version: "0.5.18"
|
|
- uses: actions/setup-python@v5
|
|
with:
|
|
python-version: "3.11"
|
|
- name: Run uv sync
|
|
run: |
|
|
uv sync --locked --all-extras
|
|
working-directory: ./python
|
|
- name: Run task
|
|
run: |
|
|
source ${{ github.workspace }}/python/.venv/bin/activate
|
|
poe --directory ./packages/autogen-ext test-grpc
|
|
working-directory: ./python
|
|
|
|
- name: Move coverage file
|
|
run: |
|
|
mv ./packages/autogen-ext/coverage.xml coverage_autogen-ext-grpc.xml
|
|
working-directory: ./python
|
|
|
|
- name: Upload coverage artifact
|
|
uses: actions/upload-artifact@v4
|
|
with:
|
|
name: coverage-autogen-ext-grpc
|
|
path: ./python/coverage_autogen-ext-grpc.xml
|
|
|
|
test-autogen-ext-pwsh:
|
|
runs-on: windows-latest
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
|
|
- uses: astral-sh/setup-uv@v5
|
|
with:
|
|
enable-cache: true
|
|
version: "0.5.18"
|
|
|
|
- uses: actions/setup-python@v5
|
|
with:
|
|
python-version: "3.11"
|
|
|
|
- name: Install Python deps
|
|
run: |
|
|
uv sync --locked --all-extras --no-extra llama-cpp
|
|
shell: pwsh
|
|
working-directory: ./python
|
|
|
|
- name: Run tests for Windows
|
|
run: |
|
|
.venv/Scripts/activate.ps1
|
|
poe --directory ./packages/autogen-ext test-windows
|
|
shell: pwsh
|
|
working-directory: ./python
|
|
|
|
- name: Move coverage file
|
|
run: |
|
|
mv ./packages/autogen-ext/coverage.xml coverage_autogen_ext_windows.xml
|
|
working-directory: ./python
|
|
|
|
- name: Upload coverage artifact
|
|
uses: actions/upload-artifact@v4
|
|
with:
|
|
name: coverage-autogen-ext-windows
|
|
path: ./python/coverage_autogen_ext_windows.xml
|
|
|
|
codecov:
|
|
runs-on: ubuntu-latest
|
|
needs: [test, test-grpc]
|
|
strategy:
|
|
matrix:
|
|
package:
|
|
[
|
|
"./packages/autogen-core",
|
|
"./packages/autogen-ext",
|
|
"./packages/autogen-agentchat",
|
|
"autogen-ext-grpc",
|
|
]
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
- name: Set up environment
|
|
run: |
|
|
echo "PKG_NAME=$(basename '${{ matrix.package }}')" >> $GITHUB_ENV
|
|
- uses: actions/checkout@v4
|
|
- uses: actions/download-artifact@v4
|
|
with:
|
|
name: coverage-${{ env.PKG_NAME }}
|
|
path: ./
|
|
- uses: codecov/codecov-action@v5
|
|
with:
|
|
files: coverage_${{ env.PKG_NAME }}.xml
|
|
flags: unittests
|
|
name: codecov-umbrella
|
|
fail_ci_if_error: true
|
|
token: ${{ secrets.CODECOV_TOKEN }}
|
|
|
|
docs:
|
|
runs-on: ubuntu-latest
|
|
strategy:
|
|
matrix:
|
|
package: ["./packages/autogen-core"]
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
- uses: astral-sh/setup-uv@v5
|
|
with:
|
|
enable-cache: true
|
|
version: "0.5.18"
|
|
- uses: actions/setup-python@v5
|
|
with:
|
|
python-version: "3.11"
|
|
- run: uv sync --locked --all-extras
|
|
working-directory: ./python
|
|
- name: Run task
|
|
run: |
|
|
source ${{ github.workspace }}/python/.venv/bin/activate
|
|
poe --directory ${{ matrix.package }} docs-check
|
|
working-directory: ./python
|
|
|
|
docs-example-check:
|
|
runs-on: ubuntu-latest
|
|
strategy:
|
|
matrix:
|
|
package: ["./packages/autogen-core"]
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
- uses: astral-sh/setup-uv@v5
|
|
with:
|
|
enable-cache: true
|
|
version: "0.5.18"
|
|
- uses: actions/setup-python@v5
|
|
with:
|
|
python-version: "3.11"
|
|
- run: uv sync --locked --all-extras
|
|
working-directory: ./python
|
|
- name: Run task
|
|
run: |
|
|
source ${{ github.workspace }}/python/.venv/bin/activate
|
|
poe --directory ${{ matrix.package }} docs-check-examples
|
|
working-directory: ./python
|
|
|
|
samples-code-check:
|
|
runs-on: ubuntu-latest
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
- uses: astral-sh/setup-uv@v5
|
|
with:
|
|
enable-cache: true
|
|
version: "0.5.18"
|
|
- uses: actions/setup-python@v5
|
|
with:
|
|
python-version: "3.11"
|
|
- run: uv sync --locked --all-extras
|
|
working-directory: ./python
|
|
- name: Run task
|
|
run: |
|
|
source ${{ github.workspace }}/python/.venv/bin/activate
|
|
poe samples-code-check
|
|
working-directory: ./python
|
|
|
|
markdown-code-lint:
|
|
runs-on: ubuntu-latest
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
- uses: astral-sh/setup-uv@v3
|
|
with:
|
|
enable-cache: true
|
|
version: "0.5.18"
|
|
- uses: actions/setup-python@v5
|
|
with:
|
|
python-version: "3.11"
|
|
- run: uv sync --locked --all-extras
|
|
working-directory: ./python
|
|
- name: Run task
|
|
run: |
|
|
source ${{ github.workspace }}/python/.venv/bin/activate
|
|
poe markdown-code-lint
|
|
working-directory: ./python
|
|
|
|
check-proto-changes-python:
|
|
runs-on: ubuntu-latest
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
- uses: astral-sh/setup-uv@v5
|
|
with:
|
|
enable-cache: true
|
|
version: "0.5.18"
|
|
- uses: actions/setup-python@v5
|
|
with:
|
|
python-version: "3.11"
|
|
- run: uv sync --locked --all-extras
|
|
working-directory: ./python
|
|
- name: Run task
|
|
run: |
|
|
source ${{ github.workspace }}/python/.venv/bin/activate
|
|
poe gen-proto
|
|
poe gen-test-proto
|
|
working-directory: ./python
|
|
- name: Check if there are uncommited changes
|
|
id: changes
|
|
uses: UnicornGlobal/has-changes-action@v1.0.11
|
|
- name: Process changes
|
|
if: steps.changes.outputs.changed == 1
|
|
run: echo "There are changes in the proto files. Please commit them."
|