Commit Graph

3376 Commits

Author SHA1 Message Date
afourney
f8b4b4259b Adds the GAIA benchark to the Testbed. This PR depends on #792 (#810)
* Re-added completion logging when using older versions of autogen.

* Extended scenario definitions and templating to include folders.

* Prepare collate_human_eval.py for working with group chat scenarios.

* Converted HumanEval to the folder-based approach, and added GroupChat scenarios.

* Fixed the default termination message.

* Fixed another termination condition.

* Updated compatible autogen versions.

* Added initial support for GAIA benchmark.

* Fixed a bug in executing the finalize scripts.

* Generalized the template further to support multiple folder copy operations.

* Refined GAIA support, and broke scenarios down by difficulty.

* Added some experimental scripts for computing metrics over GAIA. This is a first version, and will likely need refinement.

* Added instructions for cloning GAIA

* Updated README to fix some typos.

* Added a script to format GAIA reslts for the leaderboard.

* Update samples/tools/testbed/scenarios/GAIA/Templates/BasicTwoAgents/scenario.py

Co-authored-by: LeoLjl <3110503618@qq.com>

---------

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
Co-authored-by: LeoLjl <3110503618@qq.com>
2023-12-06 01:46:10 +00:00
Chi Wang
73d7e9203b bump version to 0.2.1 (#867)
* bump version to 0.2.1

* remove example link

* update

---------

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
Co-authored-by: kevin666aa <yrwu000627@gmail.com>
2023-12-05 21:09:05 +00:00
axa99
195c87e309 corrected openai utils example (#869) 2023-12-05 19:13:13 +00:00
Linxin Song
fa5f4ca8e3 Add details to AutoBuild's blog and fix test error. This PR is related to #846 (#865)
* try to fix blog

* modify blog

* fix test error in #717; fix blog typo in installation; update blogs with output examples.

* pre-commit

* pre-commit

* Update website/blog/2023-11-26-Agent-AutoBuild/index.mdx

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

* add future work

* fix grammar

---------

Co-authored-by: Jieyu Zhang <jieyuz2@cs.washington.edu>
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-12-05 18:50:17 +00:00
Joshua Kim
bb2bb8ed37 Clarifies #853 (#876) 2023-12-05 14:30:46 +00:00
Burhanuddin Mustafa Lakdawala
f8d3c6bca3 fix 0.2 release tag link (#872)
It had to be a complete link because the relative link tries to go to main/blob/releases which is invalid
2023-12-05 05:18:47 +00:00
afourney
a107233e23 Testbed can now read the OPENAI_API_KEY in addition to the OAI_CONFIG_LIST (#848)
Co-authored-by: Victor Dibia <victordibia@microsoft.com>
2023-12-04 22:14:00 +00:00
Ian
26f6e0cfb2 add a verbose flag to print more information of runtime (#717)
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-12-04 15:02:32 +00:00
Linxin Song
55b9d0bfe1 AutoBuild blog refinement (#856)
* try to fix blog

* modify blog
2023-12-04 03:19:02 +00:00
Qingyun Wu
c3cebd7efe Minor grammar and wording issues (#854)
* wording

* grammar and wording

* readability suggested by shruti222patel

* period
2023-12-04 02:57:06 +00:00
Linxin Song
707d75641a try to fix blog (#855) 2023-12-04 02:40:24 +00:00
Linxin Song
83f0c744b2 Testing AutoBuild (#846)
* init notebook for agent set up

* complete AgentCreator

* AgentCreator first step features completed.

* update AgentCreator

* update AgentCreator

* update AgentCreator (modify params of build)

* [update AgentCreator] add auto judgement of coding

* add autobuild

* rename autobuild notebook

* Add step-by-step command.

* modify name

* fix bugs

* update for new openai api

* add example

* add load_config, save_config, and add task in build and start

* modify notebook

* rewrite save and load function; update notebook

* update description

* update description

* update description

* change member variable of agent_creator.py

* update notebook

* new feature: auto-generate agent name and system message

* new feature: add gpts support

* update notebook

* update notebook

* beautify; add docstring for build

* Update notebook; PR version

* typo

* update notebook

* fix typo

* try to run llama

* try to run llama

* switch api_base to base_url

* add details for Step 6; add print in clear_all_agents()

* Change description of Step 5

* delete ASSISTANT_CONFIG_LIST

* add Linxin to blog authors

* add blog

* Update index.mdx

* add test; add user proxy constrain; change show case in notebook

* modify blog for test

* change test file name; modify test

* modify test

* modify test

* add try/catch for dependency

* add version requirement for openai

* add exception for DistributionNotFound error

* add requirement

* change assertion

* rename test; modify index.mdx

* change config file name

* Update agent_chat.md

* Update agent_chat.md

* Update AgentChat.md

* complete blog; fix typos in notebook

* add autobuild banner

* try to merge

* Update Examples.md

* update test

* skip if openai not installed

* pre-commit

* Update website/blog/2023-11-26-Agent-AutoBuild/index.mdx

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* update contrib-openai.yml

* change pull_request_target to pull_request

* disable other openai tests

* address issues from ekzhu; modify notebook; modify blog; modify test

* update test example

* update test

* Update agent_chat.md

* Update Examples.md

* address issues from qingyun; update agent_builder.py; update notebook

* recover contrib-openai.yml

* pre-commit solve

---------

Co-authored-by: Jieyu Zhang <jieyuz2@cs.washington.edu>
Co-authored-by: JieyuZ2 <jieyuzhang97@gmail.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-12-04 02:12:26 +00:00
Qingyun Wu
02593ff7be Add examples (#851)
* add human involvement

* citation

* AgentEval and invalid links

* numbering

* add cost to documentation

* add cost notebook

* oai config list utilities

* add utility link

* title
2023-12-03 23:46:38 +00:00
Yiran Wu
7a4ba1a732 Add cost summary to client.py (#812)
* init commit

* add doc, notebook and test

* fix test

* update

* update

* update

* update
2023-12-03 21:06:46 +00:00
Shobhit Vishnoi
5c92fb378b Register async human input handler (#794)
* Update conversable_agent.py

* Add files via upload

* Delete notebook/Async_human_input.ipynb

* Add files via upload

* refactor:formatter

* feat:updated position

---------

Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2023-12-03 16:45:24 +00:00
Beibin Li
c19f234149 Message "content" now supports both str and List in Agents (#713)
* Change "content" type in Conversable Agent

* content and system_message support str and List
Update for all other agents

* Content_str now also takes None as input

* Group Chat now works with LMM too

* Style: newline for import in Conversable Agentt

* Add test for gourpchat + lmm

* Resolve comments
1. Undo AssistantAgent changes
2. Modify the asserts and raises in `content_str` function and update
test accordingly.

* Undo AssistantAgent

* Update comments and add assertion for LMM

* Typo fix in docstring for content_str

* Remove “None” out conversable_agent.py

* Lint message to dict in multimodal_conversable_agent.py

* Address lint issues

* linting

* Move lmm test into contrib test

* Resolve 2 comments

* Move img_utils into contrib folder

* Resolve img_utils path issues
2023-12-03 01:40:50 +00:00
Qingyun Wu
77e1d28c1b improve ecosystem page (#823)
* restucture

* update examples references

* fix citation
2023-12-03 01:09:55 +00:00
Qingyun Wu
6f4d16e945 fix citations (#843)
* fix citations

* make citation more explicit

* add link

* emoji

* add link

* link

* add citation

* flaml link
2023-12-02 22:40:45 +00:00
Chi Wang
45036794e7 update the news for v0.2 release (#844)
* update the news for v0.2 release

* fix format
2023-12-02 18:41:28 +00:00
Victor Dibia
6258031adb Add a Blog Post on the AutoGen Assistant (#834)
* add autogenassistant blog post

* update formatting in blog plst

* Fix typo

* Fix typo

* Update title

* Improve language

* Update website/blog/2023-12-01-AutoGenAssistant/index.mdx

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* Update website/blog/2023-12-01-AutoGenAssistant/index.mdx

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

---------

Co-authored-by: gagb <gagb@users.noreply.github.com>
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2023-12-02 11:04:28 +00:00
Nicolas Marchildon
17c51fd2f0 Enable defining new functions after agent creation (#285)
* Enable defining new functions after agent creation

* Add notebook for function inception example

* format

* 1. fix bug 2. support remove function

* 1. fix bug 2. support remove function

* 1. add example doc 2. change test file 3. change ipynb title

* Update website/docs/Examples.md

---------

Co-authored-by: Li Jiang <bnujli@gmail.com>
Co-authored-by: “skzhang1” <“shaokunzhang529@gmail.com”>
Co-authored-by: Shaokun Zhang <shaokunzhang529@gmail.com>
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-12-02 01:05:54 +00:00
Victor Dibia
5547e3b919 Improvements to AutoGen Assistant (#828)
* improve template for files, integreate files in db

* ui update, improvements to file display grid

* add new global skill for image generation

* update readme to address #739

* utils.py refactor, separate db uitls for ease of development

* db utils

* add support for sessions both in backend api and ui

* improve implementation for session support

* add early v1 support for a gallery and publishing to a gallery

* rewrite logic for file storage representation. Store only file references on in db

* update generate image logic

* update ui layout

* fix light dark mode bug

* v1 support for showing items added to gallery

* remove viewer as it is merged in gallery

* formatting updates

* QOL refactoring

* readme and general updates

* add example notebook on assistant api

* imporve naming conventions and formatting

* readme update

* Update samples/apps/autogen-assistant/pyproject.toml

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* Update samples/apps/autogen-assistant/notebooks/tutorial.ipynb

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

---------

Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2023-12-02 00:22:02 +00:00
Charles Packer
1fb60e2d38 Update Ecosystem.md (#838) 2023-12-01 23:19:13 +00:00
Chi Wang
9ce60c454d update about pyautogen 0.2 (#826) 2023-12-01 04:07:23 +00:00
Shaokun Zhang
ba5a07a945 Add ecosystem page for website (#803)
* add ecosystem for web

* 1. change to Resources and Examples tables 2. reformat

* fix

* fix

* fix

* update

* update

* update

* update

* update

* Update website/docs/Ecosystem.md

* update

---------

Co-authored-by: “skzhang1” <“shaokunzhang529@gmail.com”>
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-11-30 18:31:08 +00:00
afourney
45c2a78970 Testbed folders (#792)
* Re-added completion logging when using older versions of autogen.

* Extended scenario definitions and templating to include folders.

* Prepare collate_human_eval.py for working with group chat scenarios.

* Converted HumanEval to the folder-based approach, and added GroupChat scenarios.

* Fixed the default termination message.

* Fixed another termination condition.

* Updated compatible autogen versions.

* Fixed a bug in executing the finalize scripts.

* Generalized the template further to support multiple folder copy operations.

* Add tests from AutoGPT.

* Update README.md

* Fix typo

* Update samples/tools/testbed/README.md

---------

Co-authored-by: LeoLjl <3110503618@qq.com>
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-11-30 16:43:03 +00:00
Li Jiang
ae7066be57 Add a warning message if docs_path not explicitly set (#814)
* Add a warning message if docs_path not explicitly set

* update

* Add how to suppress warning message

* Fix tests errors

* Fix tests errors

* Fix tests errors
2023-11-30 16:34:45 +00:00
Matt Hodges
f65494664d Fix Langchain link in examples doc (#811) 2023-11-30 04:46:02 +00:00
afourney
8d5f1766c9 GroupChat handle is_termination_msg (#804)
* Have GroupChatManager check is_termination_msg

* Added test cases.
2023-11-29 20:43:57 +00:00
Li Jiang
3c2a38ec06 Improve docstring of query_texts and search_string (#795)
* Improve docstring of query_texts and search_string

* Update docstring

* Update docstring
2023-11-29 17:19:40 +00:00
afourney
4fde1211c2 Quick fix for the str concatenation bug, but it remains to be discovered why we are getting a 'ChatCompletionMessage' rather than a str. (#809) 2023-11-29 17:15:44 +00:00
Ricky Loynd
f96963ed43 Progress bar for learn_from_user_feedback (#776)
* Use tqdm to report progress in learn_from_user_feedback()

* Update contrib-openai.yml

Append `pytest-asyncio` to `pip install coverage` for TeachableAgent.

* Replace pytest-asyncio with pytest

* Temporary usage of pull_request action.

* Restore pull_request_target action.
2023-11-29 00:38:56 +00:00
Yiran Wu
f812a238b1 add cost calculation to client (#769)
* add cost calculation

* Update autogen/oai/client.py

Co-authored-by: Joshua Kim <joshkyh@users.noreply.github.com>

* Update autogen/oai/client.py

Co-authored-by: Joshua Kim <joshkyh@users.noreply.github.com>

* update

* add doc

---------

Co-authored-by: Joshua Kim <joshkyh@users.noreply.github.com>
2023-11-28 19:47:53 +00:00
Qingyun Wu
b30ead2945 Update application figure (#352)
* update app fig

* space

* update fig

* format

* update fig
2023-11-27 21:07:53 +00:00
Li Jiang
4edceab800 Remove version condition to fix issue #775 (#777) 2023-11-27 05:00:37 +00:00
Olaoluwa Ademola Salami
34b90e478c how to register a rely function Issue-478 (#579)
* how to register a rely function Issue-478

* updated PR

* added example

* wip

* fixed erors
2023-11-27 04:09:06 +00:00
Olaoluwa Ademola Salami
37ec15497d Add links to newly added notebooks in the website #756 (#772)
* wip

* remove spaces

* :

* pr updated

* change to wip

* Created a new subsection
2023-11-27 04:08:36 +00:00
Ricky Loynd
0468f53210 Restore TeachableAgent tests (#761)
* Update chat_with_teachable_agent.py to v2.

* Update agentchat_teachability.ipynb to v2.

* Add test of teachability accuracy.

* Update installation instructions.

* Add to contrib tests.

* pre-commit fixes

* Apply reviewer suggestions to test workflows.
2023-11-27 02:10:02 +00:00
Qingyun Wu
d8d05279a5 update readmex (#759) v0.2.0 2023-11-24 19:50:39 +00:00
Chi Wang
b257afea5a bump version to 0.2.0 (#758) 2023-11-24 18:55:13 +00:00
Monarch Wadia
28001126e7 Fixed #279 (#757)
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-11-24 18:54:28 +00:00
Ian
c705c6a6f8 support retrievaling assistant by name (#718)
* support assistant retrieval using name

* address comment

* Update autogen/agentchat/contrib/gpt_assistant_agent.py

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* make code more reading friendly

* ignore test error

* format code

* Update autogen/agentchat/contrib/gpt_assistant_agent.py

typo fix

* fix test case

---------

Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-11-24 17:46:50 +00:00
Beibin Li
6087b5a4f8 Add DALLE Notebook Example (#744)
* Add DALLE Example

* md update for notebook

* Update notebook/agentchat_dalle_and_gpt4v.ipynb

---------

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-11-24 15:19:42 +00:00
Jia Ji Chen
140a023b13 Update OAI_CONFIG_LIST_sample (#655)
* Update OAI_CONFIG_LIST_sample

replace to api_base from base_url.  api_base is the correct name, otherwise it will error with invalid URL

* put base_url back, add a comment that "api_base" should be used for v0.1.x

* fix typo

* Update OAI_CONFIG_LIST_sample

grammar fix

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

---------

Co-authored-by: Li Jiang <bnujli@gmail.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2023-11-22 21:28:29 +00:00
gagb
8f7f870814 Update agentchat_oai_assistant_retrieval.ipynb (#732)
* Update agentchat_oai_assistant_retrieval.ipynb

our -> your to reduce confusion

* Update notebook/agentchat_oai_assistant_retrieval.ipynb

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

---------

Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2023-11-22 21:23:08 +00:00
Ikko Eltociear Ashimine
49fe9d729b doc: Update FAQ.md (#742)
occurences -> occurrences
2023-11-22 21:22:21 +00:00
Joshua Kim
9d2ee46ebc Controlling select_speaker using Graph Modelling Language (#720)
* Completed notebook on using GML

* Added optional dependencies for graph

* Run pre-commit

* Added pytest

* Added LLM to pick an agent before catch-all

* Updated website links to notebook

* Reviewer's suggestions

* pre-commit checked

* pre-commit passed

* Change beta version
2023-11-22 20:36:52 +00:00
Markus Archer Goulden Dreyer
f6498dc395 Update OAI_CONFIG_LIST_sample (#734) 2023-11-21 18:08:54 +00:00
Dear.Va
d22664f7e7 improve CODE_BLOCK_PATTERN for a more robust code match (#571)
* improve CODE_BLOCK_PATTERN for more robust match

* improve and add tests

* Add support for \r\n

* Updated the regex to support indented code blocks (per the Markdown spec). Added test cases for both.

* Update formatting

---------

Co-authored-by: Adam Fourney <adamfo@microsoft.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
v0.2.0b6
2023-11-21 05:06:56 +00:00
Julia Kiseleva
19c7da2dd1 Adding first version of AgentEval -- a framework for assessing task utility for LLM-powered applications (#681)
* add agenteval-notebook for math problems and the blog post about it

* update gitignore

* updates to notebook

* adding folder for the logs

* adding math problems logs

* adding folder for alfworld logs

* added limitiation and future work to blog post

* minor edits blog post

* adding changes

* reorg

* modify the main notebook

* modification of the main notebook

* remove wrong notebook

* uploading new notebook

* update agenteval notebook

* change the sample

* Update agenteval_cq_math.ipynb

* adding final changes to notebook

* updated framework picture

* Update index.mdx

* Update index.md

* Add files via upload

* updates to notebool

* revise the blog

* revise the blog

* update the agent img

* revise the blog

* revise the blog

* Excluded model logs from the main branch, you can find them in agenteval branch

* Fixed pre-commit formatting.

* Update website/blog/2023-11-11-AgentEval/index.mdx

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* update gitignore

* update index.mdx

* update authors.yml by adding Negar and Julia

* remove md file

* remove md file

* update gitignore

* update authors file

* pre-commit checks

* pre-commit checks on authors.yml

* pre-commit checks on authors.yml

* update index.mdx

* update authors.yml by adding Negar and Julia

* updated the blog-post version 1

* updated the blog-post: TL;DR is ready

* updated the blog-post: first part of introduction is ready

* updated figures: typos on fig 1, changed terminology on the fig 2

* upadated the Framework part

* fixed redering issues

* upload zip file instead of single samples

* update prealgebra.zip

* update

* upload

* update z

* update naming

* update zip

* update the agenteval notebook

* update the notebook - removing unmercenary logs

* updated fig 1 and references to it

* updated fig 1

* incorporated PR comments

* merged agenteval branch

* final changes to the blog

* updated taxonomy

* update notebook

* minor changes to the blog

* Fixed formatting

* Update the link in agenteval_cq_math.ipynb

* update the blog and link in notebook

* Update index.mdx

* change folder name

* Changes to be committed:
	modified:    OAI_CONFIG_LIST_sample.txt

* add sample OAI file

* fix the url link to colab and typos

* fix the url link to colab and typos

* add authors

* update profile pic

* "update authors"

* fixing the problem in test_groupchat.py

* update the title lower case

* reverting changes in setup.py

* rerun pre-commit

---------

Co-authored-by: Negar Arabzadeh <ngr.arabzadeh@gmail.com>
Co-authored-by: Julia Kiseleva <jukisele@microsoft.com>
Co-authored-by: afourney <adamfo@microsoft.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-11-21 04:07:33 +00:00