322 Commits

Author SHA1 Message Date
Julia Kiseleva
19c7da2dd1 Adding first version of AgentEval -- a framework for assessing task utility for LLM-powered applications (#681)
* add agenteval-notebook for math problems and the blog post about it

* update gitignore

* updates to notebook

* adding folder for the logs

* adding math problems logs

* adding folder for alfworld logs

* added limitiation and future work to blog post

* minor edits blog post

* adding changes

* reorg

* modify the main notebook

* modification of the main notebook

* remove wrong notebook

* uploading new notebook

* update agenteval notebook

* change the sample

* Update agenteval_cq_math.ipynb

* adding final changes to notebook

* updated framework picture

* Update index.mdx

* Update index.md

* Add files via upload

* updates to notebool

* revise the blog

* revise the blog

* update the agent img

* revise the blog

* revise the blog

* Excluded model logs from the main branch, you can find them in agenteval branch

* Fixed pre-commit formatting.

* Update website/blog/2023-11-11-AgentEval/index.mdx

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* update gitignore

* update index.mdx

* update authors.yml by adding Negar and Julia

* remove md file

* remove md file

* update gitignore

* update authors file

* pre-commit checks

* pre-commit checks on authors.yml

* pre-commit checks on authors.yml

* update index.mdx

* update authors.yml by adding Negar and Julia

* updated the blog-post version 1

* updated the blog-post: TL;DR is ready

* updated the blog-post: first part of introduction is ready

* updated figures: typos on fig 1, changed terminology on the fig 2

* upadated the Framework part

* fixed redering issues

* upload zip file instead of single samples

* update prealgebra.zip

* update

* upload

* update z

* update naming

* update zip

* update the agenteval notebook

* update the notebook - removing unmercenary logs

* updated fig 1 and references to it

* updated fig 1

* incorporated PR comments

* merged agenteval branch

* final changes to the blog

* updated taxonomy

* update notebook

* minor changes to the blog

* Fixed formatting

* Update the link in agenteval_cq_math.ipynb

* update the blog and link in notebook

* Update index.mdx

* change folder name

* Changes to be committed:
	modified:    OAI_CONFIG_LIST_sample.txt

* add sample OAI file

* fix the url link to colab and typos

* fix the url link to colab and typos

* add authors

* update profile pic

* "update authors"

* fixing the problem in test_groupchat.py

* update the title lower case

* reverting changes in setup.py

* rerun pre-commit

---------

Co-authored-by: Negar Arabzadeh <ngr.arabzadeh@gmail.com>
Co-authored-by: Julia Kiseleva <jukisele@microsoft.com>
Co-authored-by: afourney <adamfo@microsoft.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-11-21 04:07:33 +00:00
Victor Dibia
143e49c6e8 Sample Web Application Built with AutoGen (#695)
* Adding research assistant code

* Adding research assistant code

* checking in RA files

* Remove used text file

* Update README.md to include Saleema's name to the Contributors list.

* remove extraneous files

* update gitignore

* improve structure on global skills

* fix linting error

* readme update

* readme update

* fix wrong function bug

* readme update

* update ui build

* cleanup, remove unused modules

* readme and docs updates

* set default user

* ui build update

* add screenshot to improve instructions

* remove logout behaviour, replace with note to developers to add their own logout logic

* Create blog and edit ARA README

* Added the stock prices example in the readme for ARA

* Include edits from review with Saleema

* fix format issues

* Cosmetic changes for betting debug messages

* edit authors

* remove references to request_timeout to support autogen v0.0.2

* update bg color for UI

* readme update

* update research assistant blog post

* omit samples folder from codecov

* ui build update + precommit refactor

* formattiing updates  fromo pre-commit

* readme update

* remove compiled source files

* update gitignore

* refactor, file removals

* refactor for improved structure - datamodel, chat and db helper

* update gitignore

* refactor, file removals

* refactor for improved structure - datamodel, chat and db helper

* refactor skills view

* general refactor

* gitignore update and general refactor

* skills update

* general refactor

* ui folder structure refactor

* improve support for skills loading

* add fetch profile default skill

* refactor chat to autogenchat

* qol refactor

* improve metadata display

* early support for autogenflow in ui

* docs update general refactor

* general refactor

* readme update

* readme update

* readme and cli update

* pre-commit updates

* precommit update

* readme update

* add steup.py for older python build versions

* add manifest.in, update app icon

* in-progress changes to agent specification

* remove use_cache refs

* update datamodel, and fix for default serverurl

* request_timeout

* readme update, fix autogen values

* fix pyautogen version

* precommit formatting and other qol items

* update folder structure

* req update

* readme and docs update

* docs update

* remove duplicate in yaml file

* add support for explicit skills addition

* readme and documentation updates

* general refactor

* remove blog post, schedule for future PR

* readme update, add info on llmconfig

* make use_cache False by default unless set

* minor ui updates

* upgrade ui to use latest uatogen lib version 0.2.0b5

* Ui refactor, support for adding arbitrary model specifications

* formatting/precommit checks

* update readme, utils default skill

---------

Co-authored-by: Piali Choudhury <pialic@microsoft.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2023-11-20 18:40:30 +00:00
gagb
1b1cfaf450 Update FAQ.md with api_base vs base_url question (#672)
added a faq for api_base vs base_url because people were asking about it frequently.
2023-11-18 12:58:06 +00:00
Shaokun Zhang
3ab8c97eb6 update side bar (#702)
Co-authored-by: “skzhang1” <“shaokunzhang529@gmail.com”>
2023-11-17 12:40:33 +00:00
gagb
fe0092516b Add RAG gptassistant example notebook (#694)
* Add RAG gptassistant example notebook

* add notebook links

* Update notebook md

---------

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-11-16 17:15:21 +00:00
Haotian Zheng
4e3723dd54 Update index.mdx (#696) 2023-11-16 15:02:25 +00:00
Olaoluwa Ademola Salami
d542340856 Issue-560 (#578)
* Issue-560

* fixed

* answers bothe question
2023-11-14 03:08:06 +00:00
gagb
a5e3c9daa1 Update index.mdx with version number (#670) 2023-11-13 22:05:55 +00:00
gagb
467f73847b Fix typos in affiliation (#667) 2023-11-13 21:45:49 +00:00
Qingyun Wu
841b533da8 add doc about openai assistants (#659)
* add doc for openai assistants

* Update README.md

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* add basic notebook

---------

Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2023-11-13 21:05:30 +00:00
gagb
08145bfbce Add blog post for open ai assistants (#638)
* Add outline + update author list

* Update blog

* Fix typo

* Update website/blog/2023-11-13-OAI-assistants/index.mdx

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

* Update website/blog/2023-11-13-OAI-assistants/index.mdx

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

* Update website/blog/2023-11-13-OAI-assistants/index.mdx

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

* Add version number

* Add acknowledgements

* Update

---------

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-11-13 20:26:05 +00:00
Jieyu Zhang
2ffc3fddac fix tag in EcoAssistant blog (#657) 2023-11-13 17:27:32 +00:00
Jieyu Zhang
c1d6a5e54c add EcoAssistant blog (#647)
* add EcoAssistant blog

* add blog

* Rename blog.md to blog.mdx

* Rename blog.mdx to index.mdx

* Update index.mdx

* Update index.mdx
2023-11-13 00:13:36 +00:00
Jieyu Zhang
0b926f4f2d Add EcoAssistant to the research page (#612)
* Update Research.md

* Update Research.md

* Update Research.md
2023-11-09 21:08:40 +00:00
Joshua Kim
98115e801a Added link to the new notebook (#594) 2023-11-09 14:38:38 +00:00
Chi Wang
dfcbea9777 seed -> cache_seed (#600) 2023-11-08 23:39:02 +00:00
Beibin Li
b41b366549 Large Multimodal Models in AgentChat (#554)
* LMM Code added

* LLaVA notebook update

* Test cases and Notebook modified for OpenAI v1

* Move LMM into contrib
To resolve test issues and deploy issues
In the future, we can install pillow by default, and then move back
LMM agents into agentchat

* LMM test setup update

* try...except... clause for LMM tests

* disable patch for llava agent test
To resolve dependencies issue for build

* Add LMM Blog

* Change docstring for LMM agents

* Docstring update patch

* llava: insert reply at position 1 now
So, it can still handle human_input_mode
and max_consecutive_reply

* Resolve comments
Fixing: typos, blogs, yml, and add OpenAIWrapper

* Signature typo fix for LMM agent: system_message

* Update LMM "content" from latest OpenAI release
Reference  https://platform.openai.com/docs/guides/vision

* update LMM test according to latest OpenAI release

* Fully support GPT-4V now
1. Add a notebook for GPT-4V. LLava notebook also updated.
2. img_utils updated
3. GPT-4V formatter now return base64 image with mime type
4. Infer mime type directly from b64 image content (while loading
   without suffix)
5. Test cases modified according to all the related changes.

* GPT-4V link updated in blog

---------

Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2023-11-06 21:33:51 +00:00
AkariLan
8593807359 fix wrong 'Langchain Provided Tools as Functions' doc ref (#495)
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2023-11-05 18:29:33 +00:00
Li Jiang
f052977e24 Add support to unstructrued (#501)
* Add support to unstructrued

* Fix tests

* Add test and documents

* Fix tests

* Fix tests

* Test unstructured on linux and mac
2023-11-05 13:30:28 +00:00
hung_ng__
0dd0fc5aa2 Fix typo import autogen (#549) 2023-11-04 17:12:41 +00:00
Chi Wang
c4f8b1c761 Dev/v0.2 (#393)
* api_base -> base_url (#383)

* InvalidRequestError -> BadRequestError (#389)

* remove api_key_path; close #388

* close #402 (#403)

* openai client (#419)

* openai client

* client test

* _client -> client

* _client -> client

* extra kwargs

* Completion -> client (#426)

* Completion -> client

* Completion -> client

* Completion -> client

* Completion -> client

* support aoai

* fix test error

* remove commented code

* support aoai

* annotations

* import

* reduce test

* skip test

* skip test

* skip test

* debug test

* rename test

* update workflow

* update workflow

* env

* py version

* doc improvement

* docstr update

* openai<1

* add tiktoken to dependency

* filter_func

* async test

* dependency

* migration guide (#477)

* migration guide

* change in kwargs

* simplify header

* update optigude description

* deal with azure gpt-3.5

* add back test_eval_math_responses

* timeout

* Add back tests for RetrieveChat (#480)

* Add back tests for RetrieveChat

* Fix format

* Update dependencies order

* Fix path

* Fix path

* Fix path

* Fix tests

* Add not run openai on MacOS or Win

* Update skip openai tests

* Remove unnecessary dependencies, improve format

* Add py3.8 for testing qdrant

* Fix multiline error of windows

* Add openai tests

* Add dependency mathchat, remove unused envs

* retrieve chat is tested

* bump version to 0.2.0b1

---------

Co-authored-by: Li Jiang <bnujli@gmail.com>
2023-11-04 04:01:49 +00:00
Marc Green
46e8948d81 Update FAQ with workaround for Issue #251 (#405)
* Update FAQ with workaround for Issue #251

* Update website/docs/FAQ.md

* Update website/docs/FAQ.md

---------

Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2023-10-30 01:49:00 +00:00
gagb
5694486272 Update Installation.md (#456)
* Update Installation.md

Replace autogen->pyautogen in env setup to avoid confusion

Related issue: #211

* Update Installation.md

Add deactivation instructions

* Update website/docs/Installation.md

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

---------

Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2023-10-28 05:51:28 +00:00
Aaron
cde99e05c5 Update FAQ section in documentation (#390)
* UPDATE - FAQ section in documentation

* FIX - formatting test failure

* FIX - added disclaimer

* pre-commit

* Update website/docs/FAQ.md

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* Update website/docs/FAQ.md

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* Update website/docs/FAQ.md

Co-authored-by: Chi Wang <wang.chi@microsoft.com>

* UPDATE - notebook and FAQ information for config_list_from_models

---------

Co-authored-by: Ward <award40@LAMU0CLP74YXVX6.uhc.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: Li Jiang <bnujli@gmail.com>
2023-10-27 12:52:26 +00:00
Ricky Loynd
09bf41a1ed TeachableAgent blog post (#436)
* Authors

* initial checkin

* completed blog post

* trim trailing whitespace

* date

* Address reviewer feedback.
2023-10-27 12:49:21 +00:00
Anush
50ac547637 feat: Qdrant vector store support (#303)
* feat: QdrantRetrieveUserProxyAgent

* fix: QdrantRetrieveUserProxyAgent docstring

* chore: batch of 500 all CPU cores

* chore: conditional import for tests

* chore: config parallel, batch 100

* chore: collection creation params

* chore: conditonal payload indexing
fastembed import check

* docs: notebook for QdrantRetrieveUserProxyAgent

* docs: update docs link

* docs: notebook examples update

* chore: hnsw, payload index reference

* docs: notebook docs_path update

* Update test/agentchat/test_qdrant_retrievechat.py

Co-authored-by: Li Jiang <bnujli@gmail.com>

* chore: update notebook output

* Fix format

---------

Co-authored-by: Li Jiang <bnujli@gmail.com>
2023-10-25 05:08:43 +00:00
Li Jiang
f9acb69aea Update docs in RetrieveChat notebook and Installation (#379)
* Update comments to make it more clear

* Update Installation
2023-10-23 22:28:38 +00:00
Sheetali Maity
6438625063 Add link to OptiGuide #371 (#376)
* OptiGuide Link

* Update AutoGen-AgentChat.md

* fixes
2023-10-23 16:16:53 +00:00
Chi Wang
6e74e2d51a headsup about dependency change (#378)
* headsup about dependency change

* more change
2023-10-23 15:34:32 +00:00
Qingyun Wu
c2e0ddf667 format (#358) 2023-10-22 04:08:59 +00:00
Ansh Babbar
ec52087c95 Updating Examples to follow new categorical structure. #273 (#327)
* Updating Examples to follow new categorical structure. #273

Addressing the remaining task for #273, I have copied over the changes from /Usecases to /Examples to follow the new categorical example notebooks structure.

* Add the new example notebook

---------

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-10-21 23:00:50 +00:00
Gourav
15d85aa1ad Added Roadmap to Getting-Started.md (#324) 2023-10-21 17:35:31 +00:00
Ricky Loynd
d22b6b2006 TeachableAgent (#278)
* Initial commit.

* Disable LLM response caching.

* Add teachability option to setup.py

* Modify test to use OAI_CONFIG_LIST as suggested in the docs.

* Expand unit test.

* Complete unit test.

* Add filter_dict

* details

* AnalysisAgent

* details

* More documentation and debug output.

* Support retrieval of any number of relevant memos, including zero.

* More robust analysis separator.

* cleanup

* teach_config

* refactoring

* For robustness, allow more flexibility on memo storage and retrieval.

* de-dupe the retrieved memos.

* Simplify AnalysisAgent. The unit tests now pass with gpt-3.5

* comments

* Add a verbosity level to control analyzer messages.

* refactoring

* comments

* Persist memory on disk.

* cleanup

* Use markdown to format retrieved memos.

* Use markdown in TextAnalyzerAgent

* Add another verbosity level.

* clean up logging

* notebook

* minor edits

* cleanup

* linter fixes

* Skip tests that fail to import openai

* Address reviewer feedback.

* lint

* refactoring

* Improve wording

* Improve code coverage.

* lint

* Use llm_config to control caching.

* lowercase notebook name

* Sort out the parameters passed through to ConversableAgent, and supply full docstrings for the others.

* lint

* Allow TextAnalyzerAgent to be given a different llm_config than TeachableAgent.

* documentation

* Modifications to run openai workflow.

* Test on just python 3.10.
Replace agent with agent teachable_agent as recommended.

* Test on python 3.9 instead of 3.10.

* Remove space from name -> teachableagent

---------

Co-authored-by: Li Jiang <bnujli@gmail.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2023-10-21 02:27:10 +00:00
Chi Wang
b1e1f416b0 guidance for contribution (#320) 2023-10-20 23:50:18 +00:00
Li Jiang
a456b512d5 Fix format and links in documentations (#310)
* Fix format and links

* Update title

* Sync title

* Add examples to installation
2023-10-20 02:23:29 +00:00
Haseeb Ansari
e20ecfd259 doc: Update FAQ.md (#282)
Isssue #277
2023-10-20 02:23:03 +00:00
Li Jiang
749757aca3 Update docs (#297)
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-10-19 17:51:49 +00:00
Victor Dibia
af879bdcda Organize notebooks into logical groups #273 (#288)
* Organize notebooks into logical groups #273

* update multiagent group to mention >3 agents
2023-10-19 15:54:54 +00:00
Surav Shrestha
1983575520 fix typo in website/blog/2023-05-18-GPT-adaptive-humaneval/index.mdx (#299)
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-10-19 15:31:24 +00:00
Li Jiang
bed85a332f Add a blog for RAG agents (#284)
* Init blog

* Update blog

* Add more contents

* Restore notebook
2023-10-18 20:26:42 +00:00
dependabot[bot]
9e876abf23 Bump @babel/traverse from 7.20.1 to 7.23.2 in /website (#283)
Bumps [@babel/traverse](https://github.com/babel/babel/tree/HEAD/packages/babel-traverse) from 7.20.1 to 7.23.2.
- [Release notes](https://github.com/babel/babel/releases)
- [Changelog](https://github.com/babel/babel/blob/main/CHANGELOG.md)
- [Commits](https://github.com/babel/babel/commits/v7.23.2/packages/babel-traverse)

---
updated-dependencies:
- dependency-name: "@babel/traverse"
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-18 16:47:21 +00:00
Maxim Saplin
47df9d53be Update Getting-Started.md (#275)
Co-authored-by: Li Jiang <bnujli@gmail.com>
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-10-18 02:43:01 +00:00
Ayush Kumar Pandit
45677e3e08 docs: added virtual environment setup process (#249)
* docs: added virtual environment setup process

* Update website/docs/Installation.md

---------

Co-authored-by: Li Jiang <bnujli@gmail.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2023-10-17 23:51:24 +00:00
Maxim Saplin
f594333f72 Update FAQ.md, elaborate on how to customise docker image and pick 'python:3' to solve typical errors (#269)
* Update FAQ.md

* Update website/docs/FAQ.md

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

* Update website/docs/FAQ.md

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

* Update website/docs/FAQ.md

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>

---------

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-10-17 14:57:31 +00:00
Olaoluwa Ademola Salami
356f6e599f document retrieve chat (#258)
* document retrieve chat

* Ran pre commit hook
2023-10-16 16:41:51 +00:00
Chi Wang
1394e29326 bump version to 0.1.11 (#242)
* bump version to 0.1.11

* fix format issue
2023-10-15 15:01:05 +00:00
Qingyun Wu
6156faaa0a Typo (#234)
* fix typo

* wording

* typo
2023-10-13 22:07:17 +00:00
Hitesh Bansal
e69916d445 Update Installation.md-with detailed explanation on add a period or newline #219 (#231)
* Update Installation.md

Usage and importance of Docker is explained in more precise and to the point

* Update website/docs/Installation.md

---------

Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-10-13 20:12:17 +00:00
Javid Jamae
fbf8faeac1 Update Getting-Started.md (#213)
Fixed minor typo

Co-authored-by: Chi Wang <wang.chi@microsoft.com>
2023-10-12 16:06:31 +00:00
Yiran Wu
b61aeb6cce Improving logging in oai.completion to show token_count (#179)
* update

* update doc

---------

Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: Qingyun Wu <qingyun.wu@psu.edu>
2023-10-12 14:31:52 +00:00