* #2708 add Add a judgment to the graph constructor
* #2708 add Add a judgment to the graph constructor & added unit test
* #2708#2079 move GraphTests to AutoGen.Tests; delete AutoGen.Core.Tests project
* first draft of agent eval blog post
* adding NextSteps section
* Update website/blog/2024-06-21-AgentEval/index.mdx
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Update website/blog/2024-06-21-AgentEval/index.mdx
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* addressing some pr comments
* fixing whitespace
* fixing typo
* adding bit about sequential chats
* fixing whitespace
* adding more about verifier
---------
Co-authored-by: Beibin Li <BeibinLi@users.noreply.github.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* First pass together.ai client class
* Config handling, models and cost
* Added tests, moved param management to create function
* Tests, parameter, validation, logging updates
* Added use of client_utils PR 2949
* Updated to return OAI response
* Notebook example
* Improved function calling, updated tests, updated notebook with Chess example
* Tidied up together client class, better parameter handling, simpler exception capture, warning for no cost, reuse in tests, cleaner tests
* Update of documentation notebook, replacement of old version
* Fix of messages parameter for hide_tools function call
* Update autogen/oai/together.py
Co-authored-by: Qingyun Wu <qingyun0327@gmail.com>
* Update together.py to fix text
---------
Co-authored-by: Qingyun Wu <qingyun0327@gmail.com>
Co-authored-by: Yiran Wu <32823396+yiranwu0@users.noreply.github.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* add claude 3.5 sonnet to pricing
* Fix import error for client_utils
* fix import order for ruff formatter
* name key is not supported in anthropic message so let's remove it
* Improved tool use message conversion, changed create to return standard response
* Converted tools to messages for speaker selection, moved message conversion to function, corrected bugs
* Minor bracket typo.
* Renaming function
* add groupchat and run notebook
---------
Co-authored-by: Mark Sze <mark@sze.family>
Co-authored-by: Qingyun Wu <qingyun0327@gmail.com>
Co-authored-by: HRUSHIKESH DOKALA <96101829+Hk669@users.noreply.github.com>
* Initial commit of Mistral client class
* Updated to manage final system message for reflection_with_llm
* Add Mistral support to client class
* Add Mistral support across the board (based on Gemini changes)
* Test file for Mistral client
* Updated handling of config, added notebook for documentation
* Added support for additional API parameters
* Remove unneeded code, updated exception raising
* Updated handling of keywords, including type checks, defaults, warnings. Updated notebook example to remove logging warnings.
* Added class description.
* Updated tests to support new config handling.
* Moved parameter parsing to create function, minimised init, added parameter tests
* Refined parameter validation
* Correct spacing
* Fixed string concat in parameter validation
* Corrected upper/lower bound warning
* Use client_tools, tidy up Mistral create, better handle tool call response, tidy tests
* Update of documentation notebook, replacement of old version
* Update to handle multiple tool_call recommendations in a message
* Updated tests to accommodate multiple tool_calls as well as content in message
* Update autogen/oai/mistral.py comment
Co-authored-by: Qingyun Wu <qingyun0327@gmail.com>
* cleanup, rewrite mock
* update
---------
Co-authored-by: Qingyun Wu <qingyun0327@gmail.com>
Co-authored-by: kevin666aa <yrwu000627@gmail.com>
* Used absolute path of virtual environment bin path in local command executors
* Checked if the expected venv is used or not
* Added code comments for documentation
* fix: format issue - shutil lib
---------
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: Li Jiang <bnujli@gmail.com>
* intial setup for the anthropic client with cost config
* update: other methods added
* fix: formatting
* fix: config unused
* update: changes made in the client
* update: test added to the workflow
* update: added tests to the anthropic client
* fix: errors in workflows and client
* fix
* fix: anthropic tools type
* update: notebook anthropic
* Nonetype fixed
* fix-tests config
* update: tests and client issues
* logger support
* remove sys path
* updated the functioning of the client
* update: type hints and stream
* skip tests- importerror
* fix: anthropic client and tests
* none fix
* Alternating roles, parameter keywords, cost on response,
* update: anthropic notebook
* update: notebook with more details
* devcontainer
* update: added validate_params from the client_utils
* fix: formatting
* fix: minor comment
---------
Co-authored-by: Mark Sze <mark@sze.family>
* Addition of client utilities, initially for parameter validation
* Corrected test
* update: type checks and few tests
* fix: docs, tests
---------
Co-authored-by: Hk669 <hrushi669@gmail.com>
* fix missing message in history
* fix message handling
* add list of Parts to Content object
* add test for gemini message conversion function
* add test for gemini message conversion
* add message to asserts
* add safety setting support for vertexai
* remove vertexai safety settings
* identify model with tags instead of model name
* models
* model to tag
* add more model name
* format
* Update test/agentchat/test_function_call.py
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Update test/agentchat/test_function_call.py
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Update test/agentchat/test_tool_calls.py
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Update test/agentchat/test_tool_calls.py
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* remove uncessary tags
* use gpt-4 as tag
* model to tag
* add tag for teachable agent test
---------
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: AutoGen-Hub <flaml20201204@gmail.com>
* Update Autobuild.
* merge main into autobuild
* update test for new autobuild
* update author info
* fix pre-commit
* Update autobuild notebook
* Update autobuild_agent_library.ipynb
* Update autobuild_agent_library.ipynb
* Fix pre-commit failures.
---------
Co-authored-by: Linxin Song <rm.social.song1@gmail.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Calculate the dimension size based off model chosen.
* Added example docstring.
* Validated working notebook with sentence models of different dimensions.
* Validated removal of model_name working.
* Second example uses conn object.
* embedding_function no longer directly references .encode
* Fixed pre-commit issue.
* Use try/except to raise error when shape is not found in embedding function.
* Re-ran notebook.
* Update autogen/agentchat/contrib/vectordb/pgvectordb.py
Co-authored-by: Li Jiang <bnujli@gmail.com>
* Update autogen/agentchat/contrib/vectordb/pgvectordb.py
Co-authored-by: Li Jiang <bnujli@gmail.com>
* Added .encode
* Removed example comment.
* Fix overwrite doesn't work with existing collection when custom embedding function has different dimension from default one
---------
Co-authored-by: Li Jiang <bnujli@gmail.com>
