* improved deprecation warnings
* compressible_agent test fix
* fix retrieve chat history test
---------
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
* first pass at offline agent eval integration
* Integrating AgentEval for offline scenarios
* removing old changes
* fixing notebook, updating docs
* fixing subcriteria bug
* updating class comment
* cleaning up agent constructors
* moving AgentEval agents to separate folder and adding a brief README
* fixing build breaks
* fixing formatting break
* fixing comments
* consolidating files in the agenteval folder under contrib and cleaning up imports
* fixing import ordering
* adding basic agenteval tests and fixing criteria parsing bug
* first try at adding openai agenteval tests to build process
* adding non-openai agenteval tests to build process
* updating test settings
* updating openai test
* Update test/agentchat/contrib/agent_eval/test_agent_eval.py
Co-authored-by: Wael Karkoub <wael.karkoub96@gmail.com>
* Update .github/workflows/contrib-openai.yml
Co-authored-by: Wael Karkoub <wael.karkoub96@gmail.com>
* test commit
* updating typing and converting to pydantic objects
* fixing test file
---------
Co-authored-by: Beibin Li <BeibinLi@users.noreply.github.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
Co-authored-by: Wael Karkoub <wael.karkoub96@gmail.com>
* Re-added missing notebook
* Test installing postgres
* Error handle the connection.
* Fixed import.
* Fixed import.
* Fixed creation of collection without client.
* PGVector portion working. OpenAI untested.
* Fixed prints.
* Added output.
* Fixed pre-commits.
* Run pgvector notebook
* Improve efficiency of get_collection
* Fix delete_collection
* Fixed issues with pytests and validated functions.
* Validated pytests.
* Fixed pre-commits
* Separated extra_requires to allow more logic. Retrieve_chat base dependencies included on pgvector and qdrant.
* Fixed extra newline.
* Added username and password fields.
* URL Encode the connection string parameters to support symbols like %
* Fixed pre-commits.
* Added pgvector service
* pgvector doesn't have health intervals.
* Switched to colon based key values.
* Run on Ubuntu only. Linux is only option with container service support.
* Using default credentials instead.
* Fix postgres setup
* Fix postgres setup
* Don't skip tests on win and mac
* Fix command error
* Try apt install postgresql
* Assert table does not exist when deleted.
* Raise value error on a empty list or None value provided for IDs
* pre-commit
* Add install pgvector
* Add install pgvector
* Reorg test files, create a separate job for test pgvector
* Fix format
* Fix env format
* Simplify job name, enable test_retrieve_config
* Fix test_retrieve_config
* Corrected behavior for get_docs_by_ids with no ids returning all docs.
* Corrected behavior for get_docs_by_ids with no ids returning all docs.
* Fixed pre-commits.
* Added return values for all functions.
* Validated distance search is implemented correctly.
* Validated all pytests
* Removed print.
* Added default clause.
* Make ids optional
* Fix test, make it more robust
* Bump version of openai for the vector_store support
* Added support for choosing the sentence transformer model.
* Added error handling for model name entered.
* Updated model info.
* Added model_name db_config param.
* pre-commit fixes and last link fix.
* Use secrets password.
* fix: link fixed
* updated tests
* Updated config_list.
* pre-commit fix.
* Added chat_result to all output.
Unable to re-run notebooks.
* Pre-commit fix detected this requirement.
* Fix python 3.8 and 3.9 not supported for macos
* Fix python 3.8 and 3.9 not supported for macos
* Fix format
* Reran notebook with MetaLlama3Instruct7BQ4_k_M
* added gpt model.
* Reran notebook
---------
Co-authored-by: Li Jiang <bnujli@gmail.com>
Co-authored-by: Hk669 <hrushi669@gmail.com>
* PGVector Contrib Initial Commit - KnucklesTeam:autogen:pgvector_contrib fork
* Update website/docs/ecosystem/pgvector.md
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Updated qdrant installation instructions.
* Fixed openai version.
* Added dependencies to install for qdrant and pgvector in contrib tests.
* Added dependencies to install for qdrant and pgvector in contrib tests.
* Cleaned up dependencies.
* Removed flaml out of setup.py. Used only for notebook example.
* Added PGVector notebook link
---------
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Start Gemini integration: works ok with Text now
* Gemini notebook lint
* try catch "import" for Gemini
* Debug: id issue for chat completion in Gemini
* Add RAG example
* Update docs for RAG
* Fix missing pydash
* Remove temp folder
* Fix test error in runs/7206014032/job/19630042864
* Fix tqdm warning
* Fix notebook output
* Gemini's vision model is supported now
* Install instructions for the Gemini branch
* Catch and retry when see Interval Server Error 500
* Allow gemini to take more flexible messages
i.e., it can take messages where "user" is not the last role.
* Use int time for Gemini client
* Handle other exceptions in gemini call
* rename to "create" function for gemini
* GeminiClient compatible with ModelClient now
* Lint
* Update instructions in Gemini notebook
* Lint
* Remove empty blocks from Gemini notebook
* Add gemini into example page
* self.create instead of call
* Add py and Py into python execution
* Remove error code from merging
* Remove pydash dependency for gemini
* Add cloud-gemini doc
* Remove temp file
* cache import update
* Add test case for summary with mm input
* Lint: warnings instead of print
* Add test cases for gemini
* Gemini test config
* Disable default model for gemini
* Typo fix in gemini workflow
* Correct grammar in example notebook
* Raise if "model" is not provided in create(...)
* Move TODOs into a roadmap
* Update .github/workflows/contrib-tests.yml
Co-authored-by: Davor Runje <davor@airt.ai>
* Gemini test config update
* Update setup.py
Co-authored-by: Davor Runje <davor@airt.ai>
* Update test/oai/test_gemini.py
Co-authored-by: Davor Runje <davor@airt.ai>
* Update test/oai/test_gemini.py
Co-authored-by: Davor Runje <davor@airt.ai>
* Remove python 3.8 from gemini
No google's generativeai for Windows with Python 3.8
* Update import error handling for gemini
* Count tokens and cost for gemini
---------
Co-authored-by: Li Jiang <bnujli@gmail.com>
Co-authored-by: Davor Runje <davor@airt.ai>
* Added vectordb base and chromadb
* Remove timer and unused functions
* Added filter by distance
* Added test utils
* Fix format
* Fix type hint of dict
* Rename test
* Add test chromadb
* Fix test no chromadb
* Add coverage
* Don't skip test vectordb utils
* Add types
* Fix tests
* Fix docs build error
* Add types to base
* Update base
* Update utils
* Update chromadb
* Add get_docs_by_ids
* Improve docstring
* Add get all docs
* Move chroma_results_to_query_results to utils
* Improve type hints
* Update logger
* Update init, add embedding func
* Improve docstring of vectordb, add two attributes
* Improve test workflow
* Implement user defined functions feature for local cli exec, add docs
* add tests, update docs
* fixes
* fix test
* add pandas test dep
* install test
* provide template as func
* formatting
* undo change
* address comments
* add test deps
* formatting
* test only in 1 env
* formatting
* remove test for local only
---------
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
* Introducing IOStream
* bug fixing
* polishing
* refactoring
* refactoring
* refactoring
* wip: async tests
* websockets added
* wip
* merge with main
* notebook added
* FastAPI example added
* wip
* merge
* getter/setter to iostream added
* website/blog/2024-03-03-AutoGen-Update/img/dalle_gpt4v.png: convert to Git LFS
* website/blog/2024-03-03-AutoGen-Update/img/gaia.png: convert to Git LFS
* website/blog/2024-03-03-AutoGen-Update/img/teach.png: convert to Git LFS
* add SSL support
* wip
* wip
* exception handling added to on_connect()
* refactoring: default iostream is being set in a context manager
* test fix
* polishing
* polishing
* polishing
* fixed bug with new thread
* polishing
* a bit of refactoring and docs added
* notebook added to docs
* type checking added to CI
* CI fix
* CI fix
* CI fix
* polishing
* obsolete todo comment removed
* fixed precommit error
---------
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
* Add vision capability
* Configurate: description_prompt
* Print warning instead of raising issues for type
* Skip vision capability test if dependencies not installed
* Append "vision" to agent's system message when enabled VisionCapability
* GPT-4V notebook update with ConversableAgent
* Clean GPT-4V notebook
* Add vision capability test to workflow
* Lint import
* Update system message for vision capability
* Add a `custom_caption_func` to VisionCapability
* Add custom function example for vision capability
* Skip test Vision capability custom func
* GPT-4V notebook metadata to website
* Remove redundant files
* The custom caption function takes more inputs now
* Add a more complex example of custom caption func
* Remove trailing space
---------
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Add mypy check in pre-commit
* Add mypy check in pre-commit
* bug fix
* CI fix
* add python version matrix for checking types in CI
* update github actions
* revert some accidental changes
* revert some accidental changes
* revert some accidental changes
* revert some accidental changes
---------
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
Co-authored-by: Chi Wang <wang.chi@microsoft.com>
* Add mypy check in pre-commit
* Add mypy check in pre-commit
* bug fix
* CI fix
* add python version matrix for checking types in CI
* added 3.12 to CI
---------
Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>
* Upgrade quarto and include mitigation for title issue, fix links
* repo_root
* dont run quarto independently
* test paths
* test
* resolve intermediate parents
* remove print
* add doc about effects for capabilities
* remove unnecessary imports
* improve doc
* test
* test location
* polish
* improve import of colored
* termcolor
* termcolor
* use pull request for openai test
## What
This modification asks the user to explicitly mention the model used in their experiments.
## Why
Frequently, many issues can be better understood by reviewing the model used. For example, small models have limitations in their ability to generate code in code blocks or follow complex instructions leading to errors.
