mirror of
https://github.com/All-Hands-AI/OpenHands.git
synced 2026-04-29 03:00:45 -04:00
Compare commits
29 Commits
| Author | SHA1 | Date | |
|---|---|---|---|
| 352979578f | |||
| 05ca829723 | |||
| 07b96cc8c9 | |||
| 3a65b7b07d | |||
| 5c83698524 | |||
| cde7ce49be | |||
| 24a83eb52d | |||
| 2a78b3323b | |||
| a3977621ed | |||
| 018080aae0 | |||
| 302e41d7bb | |||
| 3c61a9521b | |||
| c9ed9b166b | |||
| e052c25572 | |||
| f0ca45c59e | |||
| 7f5022c8fe | |||
| de07fcfddc | |||
| ff84a3eede | |||
| 1f723293db | |||
| 2c580387c5 | |||
| ca64c69b4a | |||
| a531413d86 | |||
| 422104c877 | |||
| c75ca7d976 | |||
| 6b89386398 | |||
| a87b8599eb | |||
| de821718fd | |||
| 088e895a3d | |||
| 104f52bcdd |
@@ -44,7 +44,11 @@ jobs:
|
||||
run: pip install pre-commit==3.7.0
|
||||
- name: Fix python lint issues
|
||||
run: |
|
||||
pre-commit run --files openhands/**/* evaluation/**/* tests/**/* --config ./dev_config/python/.pre-commit-config.yaml
|
||||
pre-commit run trailing-whitespace --files openhands/**/* evaluation/**/* tests/**/* --config ./dev_config/python/.pre-commit-config.yaml
|
||||
pre-commit run end-of-file-fixer --files openhands/**/* evaluation/**/* tests/**/* --config ./dev_config/python/.pre-commit-config.yaml
|
||||
pre-commit run pyproject-fmt --files openhands/**/* evaluation/**/* tests/**/* --config ./dev_config/python/.pre-commit-config.yaml
|
||||
pre-commit run ruff --files openhands/**/* evaluation/**/* tests/**/* --config ./dev_config/python/.pre-commit-config.yaml
|
||||
pre-commit run ruff-format --files openhands/**/* evaluation/**/* tests/**/* --config ./dev_config/python/.pre-commit-config.yaml
|
||||
|
||||
# Commit and push changes if any
|
||||
- name: Check for changes
|
||||
|
||||
@@ -40,7 +40,6 @@ permissions:
|
||||
issues: write
|
||||
|
||||
jobs:
|
||||
|
||||
auto-fix:
|
||||
if: |
|
||||
github.event_name == 'workflow_call' ||
|
||||
@@ -76,7 +75,18 @@ jobs:
|
||||
cat requirements.txt
|
||||
|
||||
- name: Cache pip dependencies
|
||||
if: github.event.label.name != 'fix-me-experimental'
|
||||
if: |
|
||||
!(
|
||||
github.event.label.name == 'fix-me-experimental' ||
|
||||
(
|
||||
(github.event_name == 'issue_comment' || github.event_name == 'pull_request_review_comment') &&
|
||||
startsWith(github.event.comment.body, inputs.macro || '@openhands-agent-exp')
|
||||
) ||
|
||||
(
|
||||
github.event_name == 'pull_request_review' &&
|
||||
startsWith(github.event.review.body, inputs.macro || '@openhands-agent-exp')
|
||||
)
|
||||
)
|
||||
uses: actions/cache@v3
|
||||
with:
|
||||
path: ${{ env.pythonLocation }}/lib/python3.12/site-packages/*
|
||||
@@ -140,7 +150,11 @@ jobs:
|
||||
|
||||
- name: Install OpenHands
|
||||
run: |
|
||||
if [ "${{ github.event.label.name }}" == "fix-me-experimental" ]; then
|
||||
if [[ "${{ github.event.label.name }}" == "fix-me-experimental" ]] ||
|
||||
([[ "${{ github.event_name }}" == "issue_comment" || "${{ github.event_name }}" == "pull_request_review_comment" ]] &&
|
||||
[[ "${{ github.event.comment.body }}" == "@openhands-agent-exp"* ]]) ||
|
||||
([[ "${{ github.event_name }}" == "pull_request_review" ]] &&
|
||||
[[ "${{ github.event.review.body }}" == "@openhands-agent-exp"* ]]); then
|
||||
python -m pip install --upgrade pip
|
||||
pip install git+https://github.com/all-hands-ai/openhands.git
|
||||
else
|
||||
|
||||
@@ -0,0 +1,43 @@
|
||||
# 🙌 The OpenHands Community
|
||||
|
||||
The OpenHands community is built around the belief that (1) AI and AI agents are going to fundamentally change the way
|
||||
we build software, and (2) if this is true, we should do everything we can to make sure that the benefits provided by
|
||||
such powerful technology are accessible to everyone.
|
||||
|
||||
If this resonates with you, we'd love to have you join us in our quest!
|
||||
|
||||
## 🤝 How to Join
|
||||
|
||||
Check out our [How to Join the Community section.](https://github.com/All-Hands-AI/OpenHands?tab=readme-ov-file#-how-to-join-the-community)
|
||||
|
||||
## 💪 Becoming a Contributor
|
||||
|
||||
We welcome contributions from everyone! Whether you're a developer, a researcher, or simply enthusiastic about advancing
|
||||
the field of software engineering with AI, there are many ways to get involved:
|
||||
|
||||
- **Code Contributions:** Help us develop new core functionality, improve our agents, improve the frontend and other
|
||||
interfaces, or anything else that would help make OpenHands better.
|
||||
- **Research and Evaluation:** Contribute to our understanding of LLMs in software engineering, participate in
|
||||
evaluating the models, or suggest improvements.
|
||||
- **Feedback and Testing:** Use the OpenHands toolset, report bugs, suggest features, or provide feedback on usability.
|
||||
|
||||
For details, please check [CONTRIBUTING.md](./CONTRIBUTING.md).
|
||||
|
||||
## Code of Conduct
|
||||
|
||||
We have a [Code of Conduct](./CODE_OF_CONDUCT.md) that we expect all contributors to adhere to.
|
||||
Long story short, we are aiming for an open, welcoming, diverse, inclusive, and healthy community.
|
||||
All contributors are expected to contribute to building this sort of community.
|
||||
|
||||
## 🛠️ Becoming a Maintainer
|
||||
|
||||
For contributors who have made significant and sustained contributions to the project, there is a possibility of joining
|
||||
the maintainer team. The process for this is as follows:
|
||||
|
||||
1. Any contributor who has made sustained and high-quality contributions to the codebase can be nominated by any
|
||||
maintainer. If you feel that you may qualify you can reach out to any of the maintainers that have reviewed your PRs and ask if you can be nominated.
|
||||
2. Once a maintainer nominates a new maintainer, there will be a discussion period among the maintainers for at least 3 days.
|
||||
3. If no concerns are raised the nomination will be accepted by acclamation, and if concerns are raised there will be a discussion and possible vote.
|
||||
|
||||
Note that just making many PRs does not immediately imply that you will become a maintainer. We will be looking
|
||||
at sustained high-quality contributions over a period of time, as well as good teamwork and adherence to our [Code of Conduct](./CODE_OF_CONDUCT.md).
|
||||
+1
-1
@@ -54,7 +54,7 @@ The agent needs a place to run code and commands. When you run OpenHands on your
|
||||
to do this by default. But there are other ways of creating a sandbox for the agent.
|
||||
|
||||
If you work for a company that provides a cloud-based runtime, you could help us add support for that runtime
|
||||
by implementing the [interface specified here](https://github.com/All-Hands-AI/OpenHands/blob/main/openhands/runtime/runtime.py).
|
||||
by implementing the [interface specified here](https://github.com/All-Hands-AI/OpenHands/blob/main/openhands/runtime/base.py).
|
||||
|
||||
#### Testing
|
||||
When you write code, it is also good to write tests. Please navigate to the `tests` folder to see existing test suites.
|
||||
|
||||
@@ -77,25 +77,16 @@ To learn more about the project, and for tips on using OpenHands,
|
||||
There you'll find resources on how to use different LLM providers,
|
||||
troubleshooting resources, and advanced configuration options.
|
||||
|
||||
## 🤝 How to Contribute
|
||||
## 🤝 How to Join the Community
|
||||
|
||||
OpenHands is a community-driven project, and we welcome contributions from everyone.
|
||||
Whether you're a developer, a researcher, or simply enthusiastic about advancing the field of
|
||||
software engineering with AI, there are many ways to get involved:
|
||||
OpenHands is a community-driven project, and we welcome contributions from everyone. We do most of our communication
|
||||
through Slack, so this is the best place to start, but we also are happy to have you contact us on Discord or Github:
|
||||
|
||||
- **Code Contributions:** Help us develop new agents, core functionality, the frontend and other interfaces, or sandboxing solutions.
|
||||
- **Research and Evaluation:** Contribute to our understanding of LLMs in software engineering, participate in evaluating the models, or suggest improvements.
|
||||
- **Feedback and Testing:** Use the OpenHands toolset, report bugs, suggest features, or provide feedback on usability.
|
||||
- [Join our Slack workspace](https://join.slack.com/t/openhands-ai/shared_invite/zt-2tom0er4l-JeNUGHt_AxpEfIBstbLPiw) - Here we talk about research, architecture, and future development.
|
||||
- [Join our Discord server](https://discord.gg/ESHStjSjD4) - This is a community-run server for general discussion, questions, and feedback.
|
||||
- [Read or post Github Issues](https://github.com/All-Hands-AI/OpenHands/issues) - Check out the issues we're working on, or add your own ideas.
|
||||
|
||||
For details, please check [CONTRIBUTING.md](./CONTRIBUTING.md).
|
||||
|
||||
## 🤖 Join Our Community
|
||||
|
||||
Whether you're a developer, a researcher, or simply enthusiastic about OpenHands, we'd love to have you in our community.
|
||||
Let's make software engineering better together!
|
||||
|
||||
- [Slack workspace](https://join.slack.com/t/openhands-ai/shared_invite/zt-2tom0er4l-JeNUGHt_AxpEfIBstbLPiw) - Here we talk about research, architecture, and future development.
|
||||
- [Discord server](https://discord.gg/ESHStjSjD4) - This is a community-run server for general discussion, questions, and feedback.
|
||||
See more about the community in [COMMUNITY.md](./COMMUNITY.md) or find details on contributing in [CONTRIBUTING.md](./CONTRIBUTING.md).
|
||||
|
||||
## 📈 Progress
|
||||
|
||||
|
||||
@@ -14,4 +14,4 @@ Pour utiliser l'Action GitHub OpenHands dans le dépôt OpenHands, un mainteneur
|
||||
|
||||
## Installation de l'Action dans un nouveau dépôt
|
||||
|
||||
Pour installer l'Action GitHub OpenHands dans votre propre dépôt, suivez les [instructions dans le dépôt OpenHands Resolver](https://github.com/All-Hands-AI/OpenHands-resolver?tab=readme-ov-file#using-the-github-actions-workflow).
|
||||
Pour installer l'Action GitHub OpenHands dans votre propre dépôt, suivez les [instructions dans le dépôt OpenHands Resolver](https://github.com/All-Hands-AI/OpenHands/blob/main/openhands/resolver/README.md).
|
||||
|
||||
+1
-1
@@ -12,4 +12,4 @@
|
||||
|
||||
## 在新仓库中安装 Action
|
||||
|
||||
要在你自己的仓库中安装 OpenHands GitHub Action,请按照 [OpenHands Resolver 仓库中的说明](https://github.com/All-Hands-AI/OpenHands-resolver?tab=readme-ov-file#using-the-github-actions-workflow) 进行操作。
|
||||
要在你自己的仓库中安装 OpenHands GitHub Action,请按照 [OpenHands Resolver 仓库中的说明](https://github.com/All-Hands-AI/OpenHands/blob/main/openhands/resolver/README.md) 进行操作。
|
||||
|
||||
@@ -21,9 +21,6 @@ OpenHands is built using a combination of powerful frameworks and libraries, pro
|
||||
|
||||
Please note that the selection of these technologies is in progress, and additional technologies may be added or existing ones may be removed as the project evolves. We strive to adopt the most suitable and efficient tools to enhance the capabilities of OpenHands.
|
||||
|
||||
## Licensing, Contributing, Community Servers
|
||||
## License
|
||||
|
||||
Distributed under MIT [License](https://github.com/All-Hands-AI/OpenHands/blob/main/LICENSE).
|
||||
|
||||
For guides on how to contribute to OpenHands, joining our Discord and Slack servers
|
||||
[check out the OpenHands README.](https://github.com/All-Hands-AI/OpenHands?tab=readme-ov-file#-how-to-contribute)
|
||||
|
||||
@@ -4,13 +4,42 @@ This guide explains how to use the OpenHands GitHub Action, both within the Open
|
||||
|
||||
## Using the Action in the OpenHands Repository
|
||||
|
||||
To use the OpenHands GitHub Action in the OpenHands repository, an OpenHands maintainer can:
|
||||
To use the OpenHands GitHub Action in a repository, you can:
|
||||
|
||||
1. Create an issue in the repository.
|
||||
2. Add the `fix-me` label to the issue.
|
||||
3. The action will automatically trigger and attempt to resolve the issue.
|
||||
2. Add the `fix-me` label to the issue or leave a comment on the issue starting with `@openhands-agent`.
|
||||
|
||||
The action will automatically trigger and attempt to resolve the issue.
|
||||
|
||||
## Installing the Action in a New Repository
|
||||
|
||||
To install the OpenHands GitHub Action in your own repository, follow
|
||||
the [README for the OpenHands Resolver](https://github.com/All-Hands-AI/OpenHands/blob/main/openhands/resolver/README.md).
|
||||
|
||||
## Usage Tips
|
||||
|
||||
### Iterative resolution
|
||||
|
||||
1. Create an issue in the repository.
|
||||
2. Add the `fix-me` label to the issue, or leave a comment starting with `@openhands-agent`
|
||||
3. Review the attempt to resolve the issue by checking the pull request
|
||||
4. Follow up with feedback through general comments, review comments, or inline thread comments
|
||||
5. Add the `fix-me` label to the pull request, or address a specific comment by starting with `@openhands-agent`
|
||||
|
||||
### Label versus Macro
|
||||
|
||||
- Label (`fix-me`): Requests OpenHands to address the **entire** issue or pull request.
|
||||
- Macro (`@openhands-agent`): Requests OpenHands to consider only the issue/pull request description and **the specific comment**.
|
||||
|
||||
## Advanced Settings
|
||||
|
||||
### Add custom repository settings
|
||||
|
||||
You can provide custom directions for OpenHands by following the [README for the resolver](https://github.com/All-Hands-AI/OpenHands/blob/main/openhands/resolver/README.md#providing-custom-instructions).
|
||||
|
||||
### Configure custom macro
|
||||
|
||||
To customize the default macro (`@openhands-agent`):
|
||||
|
||||
1. [Create a repository variable](https://docs.github.com/en/actions/writing-workflows/choosing-what-your-workflow-does/store-information-in-variables#creating-configuration-variables-for-a-repository) named `OPENHANDS_MACRO`
|
||||
2. Assign the variable a custom value
|
||||
|
||||
Generated
+2325
-343
File diff suppressed because it is too large
Load Diff
+5
-5
@@ -15,10 +15,10 @@
|
||||
"typecheck": "tsc"
|
||||
},
|
||||
"dependencies": {
|
||||
"@docusaurus/core": "^3.6.0",
|
||||
"@docusaurus/plugin-content-pages": "^3.6.0",
|
||||
"@docusaurus/preset-classic": "^3.6.0",
|
||||
"@docusaurus/theme-mermaid": "^3.6.0",
|
||||
"@docusaurus/core": "^3.6.2",
|
||||
"@docusaurus/plugin-content-pages": "^3.6.2",
|
||||
"@docusaurus/preset-classic": "^3.6.2",
|
||||
"@docusaurus/theme-mermaid": "^3.6.2",
|
||||
"@mdx-js/react": "^3.1.0",
|
||||
"clsx": "^2.0.0",
|
||||
"prism-react-renderer": "^2.4.0",
|
||||
@@ -29,7 +29,7 @@
|
||||
},
|
||||
"devDependencies": {
|
||||
"@docusaurus/module-type-aliases": "^3.5.1",
|
||||
"@docusaurus/tsconfig": "^3.6.0",
|
||||
"@docusaurus/tsconfig": "^3.6.2",
|
||||
"@docusaurus/types": "^3.5.1",
|
||||
"typescript": "~5.6.3"
|
||||
},
|
||||
|
||||
+829
-212
File diff suppressed because it is too large
Load Diff
@@ -250,9 +250,6 @@ def process_instance(
|
||||
|
||||
config = get_config(metadata)
|
||||
|
||||
# use a session id for concurrent evaluation
|
||||
sid = 'ID_' + str(instance.instance_id)
|
||||
|
||||
# Setup the logger properly, so you can run
|
||||
# multi-processing to parallelize the evaluation
|
||||
if reset_logger:
|
||||
@@ -284,7 +281,7 @@ def process_instance(
|
||||
instruction += AGENT_CLS_TO_INST_SUFFIX[metadata.agent_class]
|
||||
|
||||
# Here's how you can run the agent (similar to the `main` function) and get the final task state
|
||||
runtime = create_runtime(config, sid=sid)
|
||||
runtime = create_runtime(config)
|
||||
call_async_from_sync(runtime.connect)
|
||||
initialize_runtime(runtime, instance.data_files)
|
||||
|
||||
|
||||
@@ -145,7 +145,7 @@ def get_config(
|
||||
platform='linux/amd64',
|
||||
api_key=os.environ.get('ALLHANDS_API_KEY', None),
|
||||
remote_runtime_api_url=os.environ.get('SANDBOX_REMOTE_RUNTIME_API_URL'),
|
||||
keep_remote_runtime_alive=False,
|
||||
keep_runtime_alive=False,
|
||||
remote_runtime_init_timeout=3600,
|
||||
),
|
||||
# do not mount workspace
|
||||
|
||||
@@ -3,9 +3,11 @@ import logging
|
||||
import multiprocessing as mp
|
||||
import os
|
||||
import pathlib
|
||||
import signal
|
||||
import subprocess
|
||||
import time
|
||||
import traceback
|
||||
from contextlib import contextmanager
|
||||
from typing import Any, Awaitable, Callable, TextIO
|
||||
|
||||
import pandas as pd
|
||||
@@ -92,6 +94,27 @@ class EvalException(Exception):
|
||||
pass
|
||||
|
||||
|
||||
class EvalTimeoutException(Exception):
|
||||
pass
|
||||
|
||||
|
||||
@contextmanager
|
||||
def timeout(seconds: int):
|
||||
def timeout_handler(signum, frame):
|
||||
raise EvalTimeoutException(f'Function timed out after {seconds} seconds')
|
||||
|
||||
# Set up the signal handler
|
||||
original_handler = signal.signal(signal.SIGALRM, timeout_handler)
|
||||
signal.alarm(seconds)
|
||||
|
||||
try:
|
||||
yield
|
||||
finally:
|
||||
# Restore the original handler and disable the alarm
|
||||
signal.alarm(0)
|
||||
signal.signal(signal.SIGALRM, original_handler)
|
||||
|
||||
|
||||
def codeact_user_response(
|
||||
state: State,
|
||||
encapsulate_solution: bool = False,
|
||||
@@ -280,15 +303,33 @@ def _process_instance_wrapper(
|
||||
metadata: EvalMetadata,
|
||||
use_mp: bool,
|
||||
max_retries: int = 5,
|
||||
timeout_seconds: int | None = None,
|
||||
) -> EvalOutput:
|
||||
"""Wrap the process_instance_func to handle retries and errors.
|
||||
|
||||
Retry an instance up to max_retries times if it fails (e.g., due to transient network/runtime issues).
|
||||
"""
|
||||
"""Wrap the process_instance_func to handle retries and errors."""
|
||||
for attempt in range(max_retries + 1):
|
||||
try:
|
||||
result = process_instance_func(instance, metadata, use_mp)
|
||||
if timeout_seconds is not None:
|
||||
with timeout(timeout_seconds):
|
||||
result = process_instance_func(instance, metadata, use_mp)
|
||||
else:
|
||||
result = process_instance_func(instance, metadata, use_mp)
|
||||
return result
|
||||
except EvalTimeoutException as e:
|
||||
error = f'Timeout after {timeout_seconds} seconds'
|
||||
stacktrace = traceback.format_exc()
|
||||
msg = (
|
||||
'-' * 10
|
||||
+ '\n'
|
||||
+ f'Timeout ({timeout_seconds} seconds) in instance [{instance.instance_id}], Stopped evaluation for this instance.'
|
||||
+ '\n'
|
||||
+ '-' * 10
|
||||
)
|
||||
logger.exception(e)
|
||||
return EvalOutput(
|
||||
instance_id=instance.instance_id,
|
||||
test_result={},
|
||||
error=error,
|
||||
)
|
||||
except Exception as e:
|
||||
error = str(e)
|
||||
stacktrace = traceback.format_exc()
|
||||
@@ -337,6 +378,7 @@ def run_evaluation(
|
||||
[pd.Series, EvalMetadata, bool], Awaitable[EvalOutput]
|
||||
],
|
||||
max_retries: int = 5, # number of retries for each instance
|
||||
timeout_seconds: int | None = None,
|
||||
):
|
||||
use_multiprocessing = num_workers > 1
|
||||
|
||||
@@ -357,7 +399,14 @@ def run_evaluation(
|
||||
if use_multiprocessing:
|
||||
with mp.Pool(num_workers) as pool:
|
||||
args_iter = (
|
||||
(process_instance_func, instance, metadata, True, max_retries)
|
||||
(
|
||||
process_instance_func,
|
||||
instance,
|
||||
metadata,
|
||||
True,
|
||||
max_retries,
|
||||
timeout_seconds,
|
||||
)
|
||||
for _, instance in dataset.iterrows()
|
||||
)
|
||||
results = pool.imap_unordered(_process_instance_wrapper_mp, args_iter)
|
||||
|
||||
Generated
+2
-2
@@ -1,12 +1,12 @@
|
||||
{
|
||||
"name": "openhands-frontend",
|
||||
"version": "0.14.0",
|
||||
"version": "0.14.1",
|
||||
"lockfileVersion": 3,
|
||||
"requires": true,
|
||||
"packages": {
|
||||
"": {
|
||||
"name": "openhands-frontend",
|
||||
"version": "0.14.0",
|
||||
"version": "0.14.1",
|
||||
"dependencies": {
|
||||
"@monaco-editor/react": "^4.6.0",
|
||||
"@nextui-org/react": "^2.4.8",
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
{
|
||||
"name": "openhands-frontend",
|
||||
"version": "0.14.0",
|
||||
"version": "0.14.1",
|
||||
"private": true,
|
||||
"type": "module",
|
||||
"engines": {
|
||||
|
||||
@@ -185,8 +185,7 @@ class OpenHands {
|
||||
}
|
||||
|
||||
static async getRuntimeId(): Promise<{ runtime_id: string }> {
|
||||
const response = await request("/api/config");
|
||||
const data = await response.json();
|
||||
const data = await request("/api/conversation");
|
||||
|
||||
return data;
|
||||
}
|
||||
|
||||
@@ -10,3 +10,57 @@ The conceptual idea is illustrated below. At each turn, the agent can:
|
||||
- Execute any valid `Python` code with [an interactive Python interpreter](https://ipython.org/). This is simulated through `bash` command, see plugin system below for more details.
|
||||
|
||||

|
||||
|
||||
## Adding New Tools
|
||||
|
||||
The CodeAct agent uses a function calling interface to define tools that the agent can use. Tools are defined in `function_calling.py` using the `ChatCompletionToolParam` class from `litellm`. Each tool consists of:
|
||||
|
||||
1. A description string that explains what the tool does and how to use it
|
||||
2. A tool definition using `ChatCompletionToolParam` that specifies:
|
||||
- The tool's name
|
||||
- The tool's parameters and their types
|
||||
- Required vs optional parameters
|
||||
|
||||
Here's an example of how a tool is defined:
|
||||
|
||||
```python
|
||||
MyTool = ChatCompletionToolParam(
|
||||
type='function',
|
||||
function=ChatCompletionToolParamFunctionChunk(
|
||||
name='my_tool',
|
||||
description='Description of what the tool does and how to use it',
|
||||
parameters={
|
||||
'type': 'object',
|
||||
'properties': {
|
||||
'param1': {
|
||||
'type': 'string',
|
||||
'description': 'Description of parameter 1',
|
||||
},
|
||||
'param2': {
|
||||
'type': 'integer',
|
||||
'description': 'Description of parameter 2',
|
||||
},
|
||||
},
|
||||
'required': ['param1'], # List required parameters here
|
||||
},
|
||||
),
|
||||
)
|
||||
```
|
||||
|
||||
To add a new tool:
|
||||
|
||||
1. Define your tool in `function_calling.py` following the pattern above
|
||||
2. Add your tool to the `get_tools()` function in `function_calling.py`
|
||||
3. Implement the corresponding action handler in the agent to process the tool's invocation
|
||||
|
||||
The agent currently supports several built-in tools:
|
||||
- `execute_bash`: Execute bash commands
|
||||
- `execute_ipython_cell`: Run Python code in IPython
|
||||
- `browser`: Interact with a web browser
|
||||
- `str_replace_editor`: Edit files using string replacement
|
||||
- `edit_file`: Edit files using LLM-based editing
|
||||
|
||||
Tools can be enabled/disabled through configuration parameters:
|
||||
- `codeact_enable_browsing`: Enable browser interaction
|
||||
- `codeact_enable_jupyter`: Enable IPython code execution
|
||||
- `codeact_enable_llm_editor`: Enable LLM-based file editing (if disabled, uses string replacement editor instead)
|
||||
|
||||
@@ -12,6 +12,7 @@ from litellm import (
|
||||
ModelResponse,
|
||||
)
|
||||
|
||||
from openhands.core.exceptions import FunctionCallNotExistsError
|
||||
from openhands.core.logger import openhands_logger as logger
|
||||
from openhands.events.action import (
|
||||
Action,
|
||||
@@ -484,7 +485,9 @@ def response_to_actions(response: ModelResponse) -> list[Action]:
|
||||
elif tool_call.function.name == 'browser':
|
||||
action = BrowseInteractiveAction(browser_actions=arguments['code'])
|
||||
else:
|
||||
raise RuntimeError(f'Unknown tool call: {tool_call.function.name}')
|
||||
raise FunctionCallNotExistsError(
|
||||
f'Tool {tool_call.function.name} is not registered. (arguments: {arguments}). Please check the tool name and retry with an existing tool.'
|
||||
)
|
||||
|
||||
# We only add thought to the first action
|
||||
if i == 0:
|
||||
|
||||
@@ -21,11 +21,9 @@ Here are some instructions for pushing, but ONLY do this if the user asks you to
|
||||
* After opening or updating a pull request, send the user a short message with a link to the pull request.
|
||||
* Do all of the above in as few steps as possible. E.g. you could open a PR with one step by running the following bash commands:
|
||||
```bash
|
||||
git checkout -b create-widget
|
||||
git add .
|
||||
git commit -m "Create widget"
|
||||
git push origin create-widget
|
||||
curl -X POST "https://api.github.com/repos/CodeActOrg/openhands/pulls" \
|
||||
git remote -v && git branch # to find the current org, repo and branch
|
||||
git checkout -b create-widget && git add . && git commit -m "Create widget" && git push -u origin create-widget
|
||||
curl -X POST "https://api.github.com/repos/$ORG_NAME/$REPO_NAME/pulls" \
|
||||
-H "Authorization: Bearer $GITHUB_TOKEN" \
|
||||
-d '{"title":"Create widget","head":"create-widget","base":"openhands-workspace"}'
|
||||
```
|
||||
|
||||
@@ -12,11 +12,13 @@ from openhands.controller.state.state import State, TrafficControlState
|
||||
from openhands.controller.stuck import StuckDetector
|
||||
from openhands.core.config import AgentConfig, LLMConfig
|
||||
from openhands.core.exceptions import (
|
||||
FunctionCallNotExistsError,
|
||||
FunctionCallValidationError,
|
||||
LLMMalformedActionError,
|
||||
LLMNoActionError,
|
||||
LLMResponseError,
|
||||
)
|
||||
from openhands.core.logger import LOG_ALL_EVENTS
|
||||
from openhands.core.logger import openhands_logger as logger
|
||||
from openhands.core.schema import AgentState
|
||||
from openhands.events import EventSource, EventStream, EventStreamSubscriber
|
||||
@@ -488,6 +490,7 @@ class AgentController:
|
||||
LLMNoActionError,
|
||||
LLMResponseError,
|
||||
FunctionCallValidationError,
|
||||
FunctionCallNotExistsError,
|
||||
) as e:
|
||||
self.event_stream.add_event(
|
||||
ErrorObservation(
|
||||
@@ -526,8 +529,7 @@ class AgentController:
|
||||
|
||||
await self.update_state_after_step()
|
||||
|
||||
# Use info level if LOG_ALL_EVENTS is set
|
||||
log_level = 'info' if os.getenv('LOG_ALL_EVENTS') in ('true', '1') else 'debug'
|
||||
log_level = 'info' if LOG_ALL_EVENTS else 'debug'
|
||||
self.log(log_level, str(action), extra={'msg_type': 'ACTION'})
|
||||
|
||||
async def _delegate_step(self):
|
||||
|
||||
@@ -241,6 +241,7 @@ def get_llm_config_arg(
|
||||
|
||||
Args:
|
||||
llm_config_arg: The group of llm settings to get from the config.toml file.
|
||||
toml_file: Path to the configuration file to read from. Defaults to 'config.toml'.
|
||||
|
||||
Returns:
|
||||
LLMConfig: The LLMConfig object with the settings from the config file.
|
||||
@@ -384,7 +385,7 @@ def load_app_config(
|
||||
"""Load the configuration from the specified config file and environment variables.
|
||||
|
||||
Args:
|
||||
set_logger_levels: Whether to set the global variables for logging levels.
|
||||
set_logging_levels: Whether to set the global variables for logging levels.
|
||||
config_file: Path to the config file. Defaults to 'config.toml' in the current directory.
|
||||
"""
|
||||
config = AppConfig()
|
||||
|
||||
@@ -114,3 +114,10 @@ class FunctionCallValidationError(Exception):
|
||||
|
||||
def __init__(self, message):
|
||||
super().__init__(message)
|
||||
|
||||
|
||||
class FunctionCallNotExistsError(Exception):
|
||||
"""Exception raised when an LLM call a tool that is not registered."""
|
||||
|
||||
def __init__(self, message):
|
||||
super().__init__(message)
|
||||
|
||||
@@ -17,6 +17,8 @@ if DEBUG:
|
||||
LOG_TO_FILE = os.getenv('LOG_TO_FILE', 'False').lower() in ['true', '1', 'yes']
|
||||
DISABLE_COLOR_PRINTING = False
|
||||
|
||||
LOG_ALL_EVENTS = os.getenv('LOG_ALL_EVENTS', 'False').lower() in ['true', '1', 'yes']
|
||||
|
||||
ColorType = Literal[
|
||||
'red',
|
||||
'green',
|
||||
@@ -89,8 +91,11 @@ class ColoredFormatter(logging.Formatter):
|
||||
return f'{time_str} - {name_str}:{level_str}: {record.filename}:{record.lineno}\n{msg_type_color}\n{msg}'
|
||||
return f'{time_str} - {msg_type_color}\n{msg}'
|
||||
elif msg_type == 'STEP':
|
||||
msg = '\n\n==============\n' + record.msg + '\n'
|
||||
return f'{msg}'
|
||||
if LOG_ALL_EVENTS:
|
||||
msg = '\n\n==============\n' + record.msg + '\n'
|
||||
return f'{msg}'
|
||||
else:
|
||||
return record.msg
|
||||
return super().format(record)
|
||||
|
||||
|
||||
|
||||
@@ -59,7 +59,8 @@ def create_runtime(
|
||||
"""Create a runtime for the agent to run on.
|
||||
|
||||
config: The app config.
|
||||
sid: The session id.
|
||||
sid: (optional) The session id. IMPORTANT: please don't set this unless you know what you're doing.
|
||||
Set it to incompatible value will cause unexpected behavior on RemoteRuntime.
|
||||
headless_mode: Whether the agent is run in headless mode. `create_runtime` is typically called within evaluation scripts,
|
||||
where we don't want to have the VSCode UI open, so it defaults to True.
|
||||
"""
|
||||
@@ -105,6 +106,8 @@ async def run_controller(
|
||||
Args:
|
||||
config: The app config.
|
||||
initial_user_action: An Action object containing initial user input
|
||||
sid: (optional) The session id. IMPORTANT: please don't set this unless you know what you're doing.
|
||||
Set it to incompatible value will cause unexpected behavior on RemoteRuntime.
|
||||
runtime: (optional) A runtime for the agent to run on.
|
||||
agent: (optional) A agent to run.
|
||||
exit_on_message: quit if agent asks for a message from user (optional)
|
||||
|
||||
@@ -320,7 +320,8 @@ def convert_fncall_messages_to_non_fncall_messages(
|
||||
converted_messages = []
|
||||
first_user_message_encountered = False
|
||||
for message in messages:
|
||||
role, content = message['role'], message['content']
|
||||
role = message['role']
|
||||
content = message.get('content')
|
||||
if content is None:
|
||||
content = ''
|
||||
|
||||
@@ -573,8 +574,10 @@ def convert_non_fncall_messages_to_fncall_messages(
|
||||
|
||||
first_user_message_encountered = False
|
||||
for message in messages:
|
||||
role, content = message['role'], message['content']
|
||||
content = content or '' # handle cases where content is None
|
||||
role = message['role']
|
||||
content = (
|
||||
message.get('content') or ''
|
||||
) # handle cases where content is None or missing
|
||||
# For system messages, remove the added suffix
|
||||
if role == 'system':
|
||||
if isinstance(content, str):
|
||||
@@ -759,7 +762,10 @@ def convert_from_multiple_tool_calls_to_single_tool_call_messages(
|
||||
|
||||
pending_tool_calls: dict[str, dict] = {}
|
||||
for message in messages:
|
||||
role, content = message['role'], message['content']
|
||||
role = message['role']
|
||||
content = message.get(
|
||||
'content'
|
||||
) # Don't set default here as we need to handle function calls
|
||||
if role == 'assistant':
|
||||
if message.get('tool_calls') and len(message['tool_calls']) > 1:
|
||||
# handle multiple tool calls by breaking them into multiple messages
|
||||
|
||||
@@ -7,6 +7,10 @@ on:
|
||||
types: [labeled]
|
||||
issue_comment:
|
||||
types: [created]
|
||||
pull_request_review_comment:
|
||||
types: [created]
|
||||
pull_request_review:
|
||||
types: [submitted]
|
||||
|
||||
permissions:
|
||||
contents: write
|
||||
@@ -16,16 +20,24 @@ permissions:
|
||||
jobs:
|
||||
call-openhands-resolver:
|
||||
if: |
|
||||
${{
|
||||
github.event.label.name == 'fix-me' ||
|
||||
(github.event_name == 'issue_comment' &&
|
||||
startsWith(github.event.comment.body, vars.OPENHANDS_MACRO || '@openhands-agent') &&
|
||||
(github.event.comment.author_association == 'OWNER' || github.event.comment.author_association == 'COLLABORATOR' || github.event.comment.author_association == 'MEMBER'))
|
||||
}}
|
||||
github.event.label.name == 'fix-me' ||
|
||||
|
||||
(
|
||||
((github.event_name == 'issue_comment' || github.event_name == 'pull_request_review_comment') &&
|
||||
(startsWith(github.event.comment.body, inputs.macro || '@openhands-agent') || startsWith(github.event.comment.body, inputs.macro || vars.OPENHANDS_MACRO)) &&
|
||||
(github.event.comment.author_association == 'OWNER' || github.event.comment.author_association == 'COLLABORATOR' || github.event.comment.author_association == 'MEMBER')
|
||||
) ||
|
||||
|
||||
(github.event_name == 'pull_request_review' &&
|
||||
(startsWith(github.event.review.body, inputs.macro || '@openhands-agent') || startsWith(github.event.review.body, inputs.macro || vars.OPENHANDS_MACRO)) &&
|
||||
(github.event.review.author_association == 'OWNER' || github.event.review.author_association == 'COLLABORATOR' || github.event.review.author_association == 'MEMBER')
|
||||
)
|
||||
)
|
||||
|
||||
uses: All-Hands-AI/OpenHands/.github/workflows/openhands-resolver.yml@main
|
||||
with:
|
||||
macro: ${{ vars.OPENHANDS_MACRO || '@openhands-agent' }}
|
||||
max_iterations: 50
|
||||
max_iterations: ${{ vars.OPENHANDS_MAX_ITER || 50 }}
|
||||
secrets:
|
||||
PAT_TOKEN: ${{ secrets.PAT_TOKEN }}
|
||||
PAT_USERNAME: ${{ secrets.PAT_USERNAME }}
|
||||
|
||||
@@ -18,7 +18,9 @@ class IssueHandlerInterface(ABC):
|
||||
issue_type: ClassVar[str]
|
||||
|
||||
@abstractmethod
|
||||
def get_converted_issues(self, comment_id: int | None = None) -> list[GithubIssue]:
|
||||
def get_converted_issues(
|
||||
self, issue_numbers: list[int] | None = None, comment_id: int | None = None
|
||||
) -> list[GithubIssue]:
|
||||
"""Download issues from GitHub."""
|
||||
pass
|
||||
|
||||
@@ -138,13 +140,29 @@ class IssueHandler(IssueHandlerInterface):
|
||||
|
||||
return all_comments if all_comments else None
|
||||
|
||||
def get_converted_issues(self, comment_id: int | None = None) -> list[GithubIssue]:
|
||||
def get_converted_issues(
|
||||
self, issue_numbers: list[int] | None = None, comment_id: int | None = None
|
||||
) -> list[GithubIssue]:
|
||||
"""Download issues from Github.
|
||||
|
||||
Returns:
|
||||
List of Github issues.
|
||||
"""
|
||||
|
||||
if not issue_numbers:
|
||||
raise ValueError('Unspecified issue number')
|
||||
|
||||
all_issues = self._download_issues_from_github()
|
||||
logger.info(f'Limiting resolving to issues {issue_numbers}.')
|
||||
all_issues = [
|
||||
issue
|
||||
for issue in all_issues
|
||||
if issue['number'] in issue_numbers and 'pull_request' not in issue
|
||||
]
|
||||
|
||||
if len(issue_numbers) == 1 and not all_issues:
|
||||
raise ValueError(f'Issue {issue_numbers[0]} not found')
|
||||
|
||||
converted_issues = []
|
||||
for issue in all_issues:
|
||||
if any([issue.get(key) is None for key in ['number', 'title', 'body']]):
|
||||
@@ -153,9 +171,6 @@ class IssueHandler(IssueHandlerInterface):
|
||||
)
|
||||
continue
|
||||
|
||||
if 'pull_request' in issue:
|
||||
continue
|
||||
|
||||
# Get issue thread comments
|
||||
thread_comments = self._get_issue_comments(
|
||||
issue['number'], comment_id=comment_id
|
||||
@@ -486,8 +501,16 @@ class PRHandler(IssueHandler):
|
||||
|
||||
return closing_issues
|
||||
|
||||
def get_converted_issues(self, comment_id: int | None = None) -> list[GithubIssue]:
|
||||
def get_converted_issues(
|
||||
self, issue_numbers: list[int] | None = None, comment_id: int | None = None
|
||||
) -> list[GithubIssue]:
|
||||
if not issue_numbers:
|
||||
raise ValueError('Unspecified issue numbers')
|
||||
|
||||
all_issues = self._download_issues_from_github()
|
||||
logger.info(f'Limiting resolving to issues {issue_numbers}.')
|
||||
all_issues = [issue for issue in all_issues if issue['number'] in issue_numbers]
|
||||
|
||||
converted_issues = []
|
||||
for issue in all_issues:
|
||||
# For PRs, body can be None
|
||||
@@ -576,9 +599,7 @@ class PRHandler(IssueHandler):
|
||||
# Format thread comments if they exist
|
||||
thread_context = ''
|
||||
if issue.thread_comments:
|
||||
thread_context = '\n\nPR Thread Comments:\n' + '\n---\n'.join(
|
||||
issue.thread_comments
|
||||
)
|
||||
thread_context = '\n---\n'.join(issue.thread_comments)
|
||||
images.extend(self._extract_image_urls(thread_context))
|
||||
|
||||
instruction = template.render(
|
||||
|
||||
@@ -3,7 +3,7 @@ The feedback may be addressed to specific code files. In this case the file loca
|
||||
Please update the code based on the feedback for the repository in /workspace.
|
||||
An environment has been set up for you to start working. You may assume all necessary tools are installed.
|
||||
|
||||
# Issues addressed
|
||||
# Issues addressed
|
||||
{{ issues }}
|
||||
|
||||
# Review comments
|
||||
@@ -15,10 +15,13 @@ An environment has been set up for you to start working. You may assume all nece
|
||||
# Review thread files
|
||||
{{ files }}
|
||||
|
||||
# PR Thread Comments
|
||||
{{ thread_context }}
|
||||
|
||||
IMPORTANT: You should ONLY interact with the environment provided to you AND NEVER ASK FOR HUMAN HELP.
|
||||
You SHOULD INCLUDE PROPER INDENTATION in your edit commands.{% if repo_instruction %}
|
||||
|
||||
Some basic information about this repository:
|
||||
{{ repo_instruction }}{% endif %}
|
||||
|
||||
When you think you have fixed the issue through code changes, please finish the interaction.
|
||||
When you think you have fixed the issue through code changes, please finish the interaction.
|
||||
|
||||
@@ -83,11 +83,10 @@ async def resolve_issues(
|
||||
issue_handler = issue_handler_factory(issue_type, owner, repo, token)
|
||||
|
||||
# Load dataset
|
||||
issues: list[GithubIssue] = issue_handler.get_converted_issues()
|
||||
issues: list[GithubIssue] = issue_handler.get_converted_issues(
|
||||
issue_numbers=issue_numbers
|
||||
)
|
||||
|
||||
if issue_numbers is not None:
|
||||
issues = [issue for issue in issues if issue.number in issue_numbers]
|
||||
logger.info(f'Limiting resolving to issues {issue_numbers}.')
|
||||
if limit_issues is not None:
|
||||
issues = issues[:limit_issues]
|
||||
logger.info(f'Limiting resolving to first {limit_issues} issues.')
|
||||
|
||||
@@ -199,7 +199,7 @@ async def process_issue(
|
||||
)
|
||||
config.set_llm_config(llm_config)
|
||||
|
||||
runtime = create_runtime(config, sid=f'{issue.number}')
|
||||
runtime = create_runtime(config)
|
||||
await runtime.connect()
|
||||
|
||||
async def on_event(evt):
|
||||
@@ -339,13 +339,10 @@ async def resolve_issue(
|
||||
|
||||
# Load dataset
|
||||
issues: list[GithubIssue] = issue_handler.get_converted_issues(
|
||||
comment_id=comment_id
|
||||
issue_numbers=[issue_number], comment_id=comment_id
|
||||
)
|
||||
|
||||
# Find the specific issue
|
||||
issue = next((i for i in issues if i.number == issue_number), None)
|
||||
if not issue:
|
||||
raise ValueError(f'Issue {issue_number} not found')
|
||||
issue = issues[0]
|
||||
|
||||
if comment_id is not None:
|
||||
if (
|
||||
|
||||
@@ -203,6 +203,7 @@ def send_pull_request(
|
||||
pr_type: str,
|
||||
fork_owner: str | None = None,
|
||||
additional_message: str | None = None,
|
||||
target_branch: str | None = None,
|
||||
) -> str:
|
||||
if pr_type not in ['branch', 'draft', 'ready']:
|
||||
raise ValueError(f'Invalid pr_type: {pr_type}')
|
||||
@@ -224,12 +225,19 @@ def send_pull_request(
|
||||
attempt += 1
|
||||
branch_name = f'{base_branch_name}-try{attempt}'
|
||||
|
||||
# Get the default branch
|
||||
print('Getting default branch...')
|
||||
response = requests.get(f'{base_url}', headers=headers)
|
||||
response.raise_for_status()
|
||||
default_branch = response.json()['default_branch']
|
||||
print(f'Default branch: {default_branch}')
|
||||
# Get the default branch or use specified target branch
|
||||
print('Getting base branch...')
|
||||
if target_branch:
|
||||
base_branch = target_branch
|
||||
# Verify the target branch exists
|
||||
response = requests.get(f'{base_url}/branches/{target_branch}', headers=headers)
|
||||
if response.status_code != 200:
|
||||
raise ValueError(f'Target branch {target_branch} does not exist')
|
||||
else:
|
||||
response = requests.get(f'{base_url}', headers=headers)
|
||||
response.raise_for_status()
|
||||
base_branch = response.json()['default_branch']
|
||||
print(f'Base branch: {base_branch}')
|
||||
|
||||
# Create and checkout the new branch
|
||||
print('Creating new branch...')
|
||||
@@ -279,7 +287,7 @@ def send_pull_request(
|
||||
'title': pr_title, # No need to escape title for GitHub API
|
||||
'body': pr_body,
|
||||
'head': branch_name,
|
||||
'base': default_branch,
|
||||
'base': base_branch,
|
||||
'draft': pr_type == 'draft',
|
||||
}
|
||||
response = requests.post(f'{base_url}/pulls', headers=headers, json=data)
|
||||
@@ -435,6 +443,7 @@ def process_single_issue(
|
||||
llm_config: LLMConfig,
|
||||
fork_owner: str | None,
|
||||
send_on_failure: bool,
|
||||
target_branch: str | None = None,
|
||||
) -> None:
|
||||
if not resolver_output.success and not send_on_failure:
|
||||
print(
|
||||
@@ -484,6 +493,7 @@ def process_single_issue(
|
||||
llm_config=llm_config,
|
||||
fork_owner=fork_owner,
|
||||
additional_message=resolver_output.success_explanation,
|
||||
target_branch=target_branch,
|
||||
)
|
||||
|
||||
|
||||
@@ -508,6 +518,7 @@ def process_all_successful_issues(
|
||||
llm_config,
|
||||
fork_owner,
|
||||
False,
|
||||
None,
|
||||
)
|
||||
|
||||
|
||||
@@ -573,6 +584,12 @@ def main():
|
||||
default=None,
|
||||
help='Base URL for the LLM model.',
|
||||
)
|
||||
parser.add_argument(
|
||||
'--target-branch',
|
||||
type=str,
|
||||
default=None,
|
||||
help='Target branch to create the pull request against (defaults to repository default branch)',
|
||||
)
|
||||
my_args = parser.parse_args()
|
||||
|
||||
github_token = (
|
||||
@@ -625,6 +642,7 @@ def main():
|
||||
llm_config,
|
||||
my_args.fork_owner,
|
||||
my_args.send_on_failure,
|
||||
my_args.target_branch,
|
||||
)
|
||||
|
||||
|
||||
|
||||
@@ -52,7 +52,7 @@ from openhands.runtime.utils.bash import BashSession
|
||||
from openhands.runtime.utils.files import insert_lines, read_lines
|
||||
from openhands.runtime.utils.runtime_init import init_user_and_working_directory
|
||||
from openhands.runtime.utils.system import check_port_available
|
||||
from openhands.utils.async_utils import wait_all
|
||||
from openhands.utils.async_utils import call_sync_from_async, wait_all
|
||||
|
||||
|
||||
class ActionRequest(BaseModel):
|
||||
@@ -170,7 +170,8 @@ class ActionExecutor:
|
||||
async def run(
|
||||
self, action: CmdRunAction
|
||||
) -> CmdOutputObservation | ErrorObservation:
|
||||
return self.bash_session.run(action)
|
||||
obs = await call_sync_from_async(self.bash_session.run, action)
|
||||
return obs
|
||||
|
||||
async def run_ipython(self, action: IPythonRunCellAction) -> Observation:
|
||||
if 'jupyter' in self.plugins:
|
||||
|
||||
@@ -47,11 +47,19 @@ STATUS_MESSAGES = {
|
||||
}
|
||||
|
||||
|
||||
class RuntimeNotReadyError(Exception):
|
||||
class RuntimeUnavailableError(Exception):
|
||||
pass
|
||||
|
||||
|
||||
class RuntimeDisconnectedError(Exception):
|
||||
class RuntimeNotReadyError(RuntimeUnavailableError):
|
||||
pass
|
||||
|
||||
|
||||
class RuntimeDisconnectedError(RuntimeUnavailableError):
|
||||
pass
|
||||
|
||||
|
||||
class RuntimeNotFoundError(RuntimeUnavailableError):
|
||||
pass
|
||||
|
||||
|
||||
|
||||
@@ -34,7 +34,11 @@ from openhands.events.observation import (
|
||||
)
|
||||
from openhands.events.serialization import event_to_dict, observation_from_dict
|
||||
from openhands.events.serialization.action import ACTION_TYPE_TO_CLASS
|
||||
from openhands.runtime.base import Runtime
|
||||
from openhands.runtime.base import (
|
||||
Runtime,
|
||||
RuntimeDisconnectedError,
|
||||
RuntimeNotFoundError,
|
||||
)
|
||||
from openhands.runtime.builder import DockerRuntimeBuilder
|
||||
from openhands.runtime.impl.eventstream.containers import remove_all_containers
|
||||
from openhands.runtime.plugins import PluginRequirement
|
||||
@@ -424,10 +428,22 @@ class EventStreamRuntime(Runtime):
|
||||
|
||||
@tenacity.retry(
|
||||
stop=tenacity.stop_after_delay(120) | stop_if_should_exit(),
|
||||
reraise=(ConnectionRefusedError,),
|
||||
retry=tenacity.retry_if_exception_type(
|
||||
(ConnectionError, requests.exceptions.ConnectionError)
|
||||
),
|
||||
reraise=True,
|
||||
wait=tenacity.wait_fixed(2),
|
||||
)
|
||||
def _wait_until_alive(self):
|
||||
try:
|
||||
container = self.docker_client.containers.get(self.container_name)
|
||||
if container.status == 'exited':
|
||||
raise RuntimeDisconnectedError(
|
||||
f'Container {self.container_name} has exited.'
|
||||
)
|
||||
except docker.errors.NotFound:
|
||||
raise RuntimeNotFoundError(f'Container {self.container_name} not found.')
|
||||
|
||||
self._refresh_logs()
|
||||
if not self.log_buffer:
|
||||
raise RuntimeError('Runtime client is not ready.')
|
||||
|
||||
@@ -31,6 +31,7 @@ from openhands.events.serialization.action import ACTION_TYPE_TO_CLASS
|
||||
from openhands.runtime.base import (
|
||||
Runtime,
|
||||
RuntimeDisconnectedError,
|
||||
RuntimeNotFoundError,
|
||||
RuntimeNotReadyError,
|
||||
)
|
||||
from openhands.runtime.builder.remote import RemoteRuntimeBuilder
|
||||
@@ -109,7 +110,9 @@ class RemoteRuntime(Runtime):
|
||||
if existing_runtime:
|
||||
self.log('debug', f'Using existing runtime with ID: {self.runtime_id}')
|
||||
elif self.attach_to_existing:
|
||||
raise RuntimeError('Could not find existing runtime to attach to.')
|
||||
raise RuntimeNotFoundError(
|
||||
f'Could not find existing runtime for SID: {self.sid}'
|
||||
)
|
||||
else:
|
||||
self.send_status_message('STATUS$STARTING_CONTAINER')
|
||||
if self.config.sandbox.runtime_container_image is None:
|
||||
|
||||
+43
-21
@@ -11,7 +11,6 @@ import requests
|
||||
from pathspec import PathSpec
|
||||
from pathspec.patterns import GitWildMatchPattern
|
||||
|
||||
from openhands.runtime.impl.remote.remote_runtime import RemoteRuntime
|
||||
from openhands.security.options import SecurityAnalyzers
|
||||
from openhands.server.data_models.feedback import FeedbackDataModel, store_feedback
|
||||
from openhands.server.github import (
|
||||
@@ -35,6 +34,7 @@ from fastapi import (
|
||||
Request,
|
||||
UploadFile,
|
||||
WebSocket,
|
||||
WebSocketDisconnect,
|
||||
status,
|
||||
)
|
||||
from fastapi.responses import FileResponse, JSONResponse
|
||||
@@ -64,7 +64,12 @@ from openhands.events.stream import AsyncEventStreamWrapper
|
||||
from openhands.llm import bedrock
|
||||
from openhands.runtime.base import Runtime
|
||||
from openhands.server.auth.auth import get_sid_from_token, sign_token
|
||||
from openhands.server.middleware import LocalhostCORSMiddleware, NoCacheMiddleware
|
||||
from openhands.server.middleware import (
|
||||
InMemoryRateLimiter,
|
||||
LocalhostCORSMiddleware,
|
||||
NoCacheMiddleware,
|
||||
RateLimitMiddleware,
|
||||
)
|
||||
from openhands.server.session import SessionManager
|
||||
|
||||
load_dotenv()
|
||||
@@ -84,6 +89,15 @@ app.add_middleware(
|
||||
|
||||
|
||||
app.add_middleware(NoCacheMiddleware)
|
||||
app.add_middleware(
|
||||
RateLimitMiddleware, rate_limiter=InMemoryRateLimiter(requests=10, seconds=1)
|
||||
)
|
||||
|
||||
|
||||
@app.get('/health')
|
||||
async def health():
|
||||
return 'OK'
|
||||
|
||||
|
||||
security_scheme = HTTPBearer()
|
||||
|
||||
@@ -239,7 +253,8 @@ async def attach_session(request: Request, call_next):
|
||||
request.state.conversation = await session_manager.attach_to_conversation(
|
||||
request.state.sid
|
||||
)
|
||||
if request.state.conversation is None:
|
||||
if not request.state.conversation:
|
||||
logger.error(f'Runtime not found for session: {request.state.sid}')
|
||||
return JSONResponse(
|
||||
status_code=status.HTTP_404_NOT_FOUND,
|
||||
content={'error': 'Session not found'},
|
||||
@@ -345,7 +360,13 @@ async def websocket_endpoint(websocket: WebSocket):
|
||||
|
||||
latest_event_id = -1
|
||||
if websocket.query_params.get('latest_event_id'):
|
||||
latest_event_id = int(websocket.query_params.get('latest_event_id'))
|
||||
try:
|
||||
latest_event_id = int(websocket.query_params.get('latest_event_id'))
|
||||
except ValueError:
|
||||
logger.warning(
|
||||
f'Invalid latest_event_id: {websocket.query_params.get("latest_event_id")}'
|
||||
)
|
||||
pass
|
||||
|
||||
async_stream = AsyncEventStreamWrapper(
|
||||
session.agent_session.event_stream, latest_event_id + 1
|
||||
@@ -362,7 +383,14 @@ async def websocket_endpoint(websocket: WebSocket):
|
||||
),
|
||||
):
|
||||
continue
|
||||
await websocket.send_json(event_to_dict(event))
|
||||
try:
|
||||
await websocket.send_json(event_to_dict(event))
|
||||
except WebSocketDisconnect:
|
||||
logger.warning(
|
||||
'Websocket disconnected while sending event history, before loop started'
|
||||
)
|
||||
session.close()
|
||||
return
|
||||
|
||||
await session.loop_recv()
|
||||
|
||||
@@ -565,27 +593,21 @@ def sanitize_filename(filename):
|
||||
return filename
|
||||
|
||||
|
||||
@app.get('/api/config')
|
||||
@app.get('/api/conversation')
|
||||
async def get_remote_runtime_config(request: Request):
|
||||
"""Retrieve the remote runtime configuration.
|
||||
|
||||
Currently, this is the runtime ID.
|
||||
"""
|
||||
try:
|
||||
runtime = request.state.conversation.runtime
|
||||
if isinstance(runtime, RemoteRuntime):
|
||||
return JSONResponse(content={'runtime_id': runtime.runtime_id})
|
||||
else:
|
||||
return JSONResponse(
|
||||
status_code=status.HTTP_404_NOT_FOUND,
|
||||
content={'error': 'Runtime ID not available in this environment'},
|
||||
)
|
||||
except Exception as e:
|
||||
logger.error(e)
|
||||
return JSONResponse(
|
||||
status_code=status.HTTP_500_INTERNAL_SERVER_ERROR,
|
||||
content={'error': 'Something went wrong'},
|
||||
)
|
||||
runtime = request.state.conversation.runtime
|
||||
runtime_id = runtime.runtime_id if hasattr(runtime, 'runtime_id') else None
|
||||
session_id = runtime.sid if hasattr(runtime, 'sid') else None
|
||||
return JSONResponse(
|
||||
content={
|
||||
'runtime_id': runtime_id,
|
||||
'session_id': session_id,
|
||||
}
|
||||
)
|
||||
|
||||
|
||||
@app.post('/api/upload-files')
|
||||
|
||||
@@ -1,6 +1,11 @@
|
||||
import asyncio
|
||||
from collections import defaultdict
|
||||
from datetime import datetime, timedelta
|
||||
from urllib.parse import urlparse
|
||||
|
||||
from fastapi import Request
|
||||
from fastapi.middleware.cors import CORSMiddleware
|
||||
from fastapi.responses import JSONResponse
|
||||
from starlette.middleware.base import BaseHTTPMiddleware
|
||||
from starlette.types import ASGIApp
|
||||
|
||||
@@ -41,3 +46,56 @@ class NoCacheMiddleware(BaseHTTPMiddleware):
|
||||
response.headers['Pragma'] = 'no-cache'
|
||||
response.headers['Expires'] = '0'
|
||||
return response
|
||||
|
||||
|
||||
class InMemoryRateLimiter:
|
||||
history: dict
|
||||
requests: int
|
||||
seconds: int
|
||||
sleep_seconds: int
|
||||
|
||||
def __init__(self, requests: int = 2, seconds: int = 1, sleep_seconds: int = 1):
|
||||
self.requests = requests
|
||||
self.seconds = seconds
|
||||
self.sleep_seconds = sleep_seconds
|
||||
self.history = defaultdict(list)
|
||||
|
||||
def _clean_old_requests(self, key: str) -> None:
|
||||
now = datetime.now()
|
||||
cutoff = now - timedelta(seconds=self.seconds)
|
||||
self.history[key] = [ts for ts in self.history[key] if ts > cutoff]
|
||||
|
||||
async def __call__(self, request: Request) -> bool:
|
||||
key = request.client.host
|
||||
now = datetime.now()
|
||||
|
||||
self._clean_old_requests(key)
|
||||
|
||||
self.history[key].append(now)
|
||||
|
||||
if len(self.history[key]) > self.requests * 2:
|
||||
return False
|
||||
elif len(self.history[key]) > self.requests:
|
||||
if self.sleep_seconds > 0:
|
||||
await asyncio.sleep(self.sleep_seconds)
|
||||
return True
|
||||
else:
|
||||
return False
|
||||
|
||||
return True
|
||||
|
||||
|
||||
class RateLimitMiddleware(BaseHTTPMiddleware):
|
||||
def __init__(self, app: ASGIApp, rate_limiter: InMemoryRateLimiter):
|
||||
super().__init__(app)
|
||||
self.rate_limiter = rate_limiter
|
||||
|
||||
async def dispatch(self, request, call_next):
|
||||
ok = await self.rate_limiter(request)
|
||||
if not ok:
|
||||
return JSONResponse(
|
||||
status_code=429,
|
||||
content={'message': 'Too many requests'},
|
||||
headers={'Retry-After': '1'},
|
||||
)
|
||||
return await call_next(request)
|
||||
|
||||
@@ -11,7 +11,7 @@ from openhands.events.action.agent import ChangeAgentStateAction
|
||||
from openhands.events.event import EventSource
|
||||
from openhands.events.stream import EventStream
|
||||
from openhands.runtime import get_runtime_cls
|
||||
from openhands.runtime.base import Runtime
|
||||
from openhands.runtime.base import Runtime, RuntimeUnavailableError
|
||||
from openhands.security import SecurityAnalyzer, options
|
||||
from openhands.storage.files import FileStore
|
||||
|
||||
@@ -194,13 +194,13 @@ class AgentSession:
|
||||
|
||||
try:
|
||||
await self.runtime.connect()
|
||||
except Exception as e:
|
||||
except RuntimeUnavailableError as e:
|
||||
logger.error(f'Runtime initialization failed: {e}', exc_info=True)
|
||||
if self._status_callback:
|
||||
self._status_callback(
|
||||
'error', 'STATUS$ERROR_RUNTIME_DISCONNECTED', str(e)
|
||||
)
|
||||
raise
|
||||
return
|
||||
|
||||
if self.runtime is not None:
|
||||
logger.debug(
|
||||
|
||||
@@ -6,6 +6,7 @@ from fastapi import WebSocket
|
||||
from openhands.core.config import AppConfig
|
||||
from openhands.core.logger import openhands_logger as logger
|
||||
from openhands.events.stream import session_exists
|
||||
from openhands.runtime.base import RuntimeUnavailableError
|
||||
from openhands.server.session.conversation import Conversation
|
||||
from openhands.server.session.session import Session
|
||||
from openhands.storage.files import FileStore
|
||||
@@ -26,7 +27,11 @@ class SessionManager:
|
||||
if not await session_exists(sid, self.file_store):
|
||||
return None
|
||||
c = Conversation(sid, file_store=self.file_store, config=self.config)
|
||||
await c.connect()
|
||||
try:
|
||||
await c.connect()
|
||||
except RuntimeUnavailableError as e:
|
||||
logger.error(f'Error connecting to conversation {c.sid}: {e}')
|
||||
return None
|
||||
end_time = time.time()
|
||||
logger.info(
|
||||
f'Conversation {c.sid} connected in {end_time - start_time} seconds'
|
||||
|
||||
+1
-1
@@ -1,6 +1,6 @@
|
||||
[tool.poetry]
|
||||
name = "openhands-ai"
|
||||
version = "0.14.0"
|
||||
version = "0.14.1"
|
||||
description = "OpenHands: Code Less, Make More"
|
||||
authors = ["OpenHands"]
|
||||
license = "MIT"
|
||||
|
||||
@@ -1,17 +1,18 @@
|
||||
from unittest.mock import patch, MagicMock
|
||||
from openhands.resolver.issue_definitions import IssueHandler, PRHandler
|
||||
from openhands.resolver.github_issue import GithubIssue, ReviewThread
|
||||
from openhands.events.action.message import MessageAction
|
||||
from unittest.mock import MagicMock, patch
|
||||
|
||||
from openhands.core.config import LLMConfig
|
||||
from openhands.events.action.message import MessageAction
|
||||
from openhands.resolver.github_issue import GithubIssue, ReviewThread
|
||||
from openhands.resolver.issue_definitions import IssueHandler, PRHandler
|
||||
|
||||
|
||||
def test_get_converted_issues_initializes_review_comments():
|
||||
# Mock the necessary dependencies
|
||||
with patch("requests.get") as mock_get:
|
||||
with patch('requests.get') as mock_get:
|
||||
# Mock the response for issues
|
||||
mock_issues_response = MagicMock()
|
||||
mock_issues_response.json.return_value = [
|
||||
{"number": 1, "title": "Test Issue", "body": "Test Body"}
|
||||
{'number': 1, 'title': 'Test Issue', 'body': 'Test Body'}
|
||||
]
|
||||
# Mock the response for comments
|
||||
mock_comments_response = MagicMock()
|
||||
@@ -26,10 +27,10 @@ def test_get_converted_issues_initializes_review_comments():
|
||||
] # Need two comment responses because we make two API calls
|
||||
|
||||
# Create an instance of IssueHandler
|
||||
handler = IssueHandler("test-owner", "test-repo", "test-token")
|
||||
handler = IssueHandler('test-owner', 'test-repo', 'test-token')
|
||||
|
||||
# Get converted issues
|
||||
issues = handler.get_converted_issues()
|
||||
issues = handler.get_converted_issues(issue_numbers=[1])
|
||||
|
||||
# Verify that we got exactly one issue
|
||||
assert len(issues) == 1
|
||||
@@ -39,35 +40,35 @@ def test_get_converted_issues_initializes_review_comments():
|
||||
|
||||
# Verify other fields are set correctly
|
||||
assert issues[0].number == 1
|
||||
assert issues[0].title == "Test Issue"
|
||||
assert issues[0].body == "Test Body"
|
||||
assert issues[0].owner == "test-owner"
|
||||
assert issues[0].repo == "test-repo"
|
||||
assert issues[0].title == 'Test Issue'
|
||||
assert issues[0].body == 'Test Body'
|
||||
assert issues[0].owner == 'test-owner'
|
||||
assert issues[0].repo == 'test-repo'
|
||||
|
||||
|
||||
def test_pr_handler_guess_success_with_thread_comments():
|
||||
# Create a PR handler instance
|
||||
handler = PRHandler("test-owner", "test-repo", "test-token")
|
||||
handler = PRHandler('test-owner', 'test-repo', 'test-token')
|
||||
|
||||
# Create a mock issue with thread comments but no review comments
|
||||
issue = GithubIssue(
|
||||
owner="test-owner",
|
||||
repo="test-repo",
|
||||
owner='test-owner',
|
||||
repo='test-repo',
|
||||
number=1,
|
||||
title="Test PR",
|
||||
body="Test Body",
|
||||
thread_comments=["First comment", "Second comment"],
|
||||
closing_issues=["Issue description"],
|
||||
title='Test PR',
|
||||
body='Test Body',
|
||||
thread_comments=['First comment', 'Second comment'],
|
||||
closing_issues=['Issue description'],
|
||||
review_comments=None,
|
||||
thread_ids=None,
|
||||
head_branch="test-branch",
|
||||
head_branch='test-branch',
|
||||
)
|
||||
|
||||
# Create mock history
|
||||
history = [MessageAction(content="Fixed the issue by implementing X and Y")]
|
||||
history = [MessageAction(content='Fixed the issue by implementing X and Y')]
|
||||
|
||||
# Create mock LLM config
|
||||
llm_config = LLMConfig(model="test-model", api_key="test-key")
|
||||
llm_config = LLMConfig(model='test-model', api_key='test-key')
|
||||
|
||||
# Mock the LLM response
|
||||
mock_response = MagicMock()
|
||||
@@ -84,7 +85,7 @@ The changes successfully address the feedback."""
|
||||
]
|
||||
|
||||
# Test the guess_success method
|
||||
with patch("litellm.completion", return_value=mock_response):
|
||||
with patch('litellm.completion', return_value=mock_response):
|
||||
success, success_list, explanation = handler.guess_success(
|
||||
issue, history, llm_config
|
||||
)
|
||||
@@ -92,39 +93,39 @@ The changes successfully address the feedback."""
|
||||
# Verify the results
|
||||
assert success is True
|
||||
assert success_list == [True]
|
||||
assert "successfully address" in explanation
|
||||
assert 'successfully address' in explanation
|
||||
|
||||
|
||||
def test_pr_handler_get_converted_issues_with_comments():
|
||||
# Mock the necessary dependencies
|
||||
with patch("requests.get") as mock_get:
|
||||
with patch('requests.get') as mock_get:
|
||||
# Mock the response for PRs
|
||||
mock_prs_response = MagicMock()
|
||||
mock_prs_response.json.return_value = [
|
||||
{
|
||||
"number": 1,
|
||||
"title": "Test PR",
|
||||
"body": "Test Body fixes #1",
|
||||
"head": {"ref": "test-branch"},
|
||||
'number': 1,
|
||||
'title': 'Test PR',
|
||||
'body': 'Test Body fixes #1',
|
||||
'head': {'ref': 'test-branch'},
|
||||
}
|
||||
]
|
||||
|
||||
# Mock the response for PR comments
|
||||
mock_comments_response = MagicMock()
|
||||
mock_comments_response.json.return_value = [
|
||||
{"body": "First comment"},
|
||||
{"body": "Second comment"},
|
||||
{'body': 'First comment'},
|
||||
{'body': 'Second comment'},
|
||||
]
|
||||
|
||||
# Mock the response for PR metadata (GraphQL)
|
||||
mock_graphql_response = MagicMock()
|
||||
mock_graphql_response.json.return_value = {
|
||||
"data": {
|
||||
"repository": {
|
||||
"pullRequest": {
|
||||
"closingIssuesReferences": {"edges": []},
|
||||
"reviews": {"nodes": []},
|
||||
"reviewThreads": {"edges": []},
|
||||
'data': {
|
||||
'repository': {
|
||||
'pullRequest': {
|
||||
'closingIssuesReferences': {'edges': []},
|
||||
'reviews': {'nodes': []},
|
||||
'reviewThreads': {'edges': []},
|
||||
}
|
||||
}
|
||||
}
|
||||
@@ -138,7 +139,7 @@ def test_pr_handler_get_converted_issues_with_comments():
|
||||
# Mock the response for fetching the external issue referenced in PR body
|
||||
mock_external_issue_response = MagicMock()
|
||||
mock_external_issue_response.json.return_value = {
|
||||
"body": "This is additional context from an externally referenced issue."
|
||||
'body': 'This is additional context from an externally referenced issue.'
|
||||
}
|
||||
|
||||
mock_get.side_effect = [
|
||||
@@ -150,56 +151,56 @@ def test_pr_handler_get_converted_issues_with_comments():
|
||||
]
|
||||
|
||||
# Mock the post request for GraphQL
|
||||
with patch("requests.post") as mock_post:
|
||||
with patch('requests.post') as mock_post:
|
||||
mock_post.return_value = mock_graphql_response
|
||||
|
||||
# Create an instance of PRHandler
|
||||
handler = PRHandler("test-owner", "test-repo", "test-token")
|
||||
handler = PRHandler('test-owner', 'test-repo', 'test-token')
|
||||
|
||||
# Get converted issues
|
||||
prs = handler.get_converted_issues()
|
||||
prs = handler.get_converted_issues(issue_numbers=[1])
|
||||
|
||||
# Verify that we got exactly one PR
|
||||
assert len(prs) == 1
|
||||
|
||||
# Verify that thread_comments are set correctly
|
||||
assert prs[0].thread_comments == ["First comment", "Second comment"]
|
||||
assert prs[0].thread_comments == ['First comment', 'Second comment']
|
||||
|
||||
# Verify other fields are set correctly
|
||||
assert prs[0].number == 1
|
||||
assert prs[0].title == "Test PR"
|
||||
assert prs[0].body == "Test Body fixes #1"
|
||||
assert prs[0].owner == "test-owner"
|
||||
assert prs[0].repo == "test-repo"
|
||||
assert prs[0].head_branch == "test-branch"
|
||||
assert prs[0].title == 'Test PR'
|
||||
assert prs[0].body == 'Test Body fixes #1'
|
||||
assert prs[0].owner == 'test-owner'
|
||||
assert prs[0].repo == 'test-repo'
|
||||
assert prs[0].head_branch == 'test-branch'
|
||||
assert prs[0].closing_issues == [
|
||||
"This is additional context from an externally referenced issue."
|
||||
'This is additional context from an externally referenced issue.'
|
||||
]
|
||||
|
||||
|
||||
def test_pr_handler_guess_success_only_review_comments():
|
||||
# Create a PR handler instance
|
||||
handler = PRHandler("test-owner", "test-repo", "test-token")
|
||||
handler = PRHandler('test-owner', 'test-repo', 'test-token')
|
||||
|
||||
# Create a mock issue with only review comments
|
||||
issue = GithubIssue(
|
||||
owner="test-owner",
|
||||
repo="test-repo",
|
||||
owner='test-owner',
|
||||
repo='test-repo',
|
||||
number=1,
|
||||
title="Test PR",
|
||||
body="Test Body",
|
||||
title='Test PR',
|
||||
body='Test Body',
|
||||
thread_comments=None,
|
||||
closing_issues=["Issue description"],
|
||||
review_comments=["Please fix the formatting", "Add more tests"],
|
||||
closing_issues=['Issue description'],
|
||||
review_comments=['Please fix the formatting', 'Add more tests'],
|
||||
thread_ids=None,
|
||||
head_branch="test-branch",
|
||||
head_branch='test-branch',
|
||||
)
|
||||
|
||||
# Create mock history
|
||||
history = [MessageAction(content="Fixed the formatting and added more tests")]
|
||||
history = [MessageAction(content='Fixed the formatting and added more tests')]
|
||||
|
||||
# Create mock LLM config
|
||||
llm_config = LLMConfig(model="test-model", api_key="test-key")
|
||||
llm_config = LLMConfig(model='test-model', api_key='test-key')
|
||||
|
||||
# Mock the LLM response
|
||||
mock_response = MagicMock()
|
||||
@@ -216,7 +217,7 @@ The changes successfully address the review comments."""
|
||||
]
|
||||
|
||||
# Test the guess_success method
|
||||
with patch("litellm.completion", return_value=mock_response):
|
||||
with patch('litellm.completion', return_value=mock_response):
|
||||
success, success_list, explanation = handler.guess_success(
|
||||
issue, history, llm_config
|
||||
)
|
||||
@@ -224,32 +225,32 @@ The changes successfully address the review comments."""
|
||||
# Verify the results
|
||||
assert success is True
|
||||
assert success_list == [True]
|
||||
assert "successfully address" in explanation
|
||||
assert 'successfully address' in explanation
|
||||
|
||||
|
||||
def test_pr_handler_guess_success_no_comments():
|
||||
# Create a PR handler instance
|
||||
handler = PRHandler("test-owner", "test-repo", "test-token")
|
||||
handler = PRHandler('test-owner', 'test-repo', 'test-token')
|
||||
|
||||
# Create a mock issue with no comments
|
||||
issue = GithubIssue(
|
||||
owner="test-owner",
|
||||
repo="test-repo",
|
||||
owner='test-owner',
|
||||
repo='test-repo',
|
||||
number=1,
|
||||
title="Test PR",
|
||||
body="Test Body",
|
||||
title='Test PR',
|
||||
body='Test Body',
|
||||
thread_comments=None,
|
||||
closing_issues=["Issue description"],
|
||||
closing_issues=['Issue description'],
|
||||
review_comments=None,
|
||||
thread_ids=None,
|
||||
head_branch="test-branch",
|
||||
head_branch='test-branch',
|
||||
)
|
||||
|
||||
# Create mock history
|
||||
history = [MessageAction(content="Fixed the issue")]
|
||||
history = [MessageAction(content='Fixed the issue')]
|
||||
|
||||
# Create mock LLM config
|
||||
llm_config = LLMConfig(model="test-model", api_key="test-key")
|
||||
llm_config = LLMConfig(model='test-model', api_key='test-key')
|
||||
|
||||
# Test that it returns appropriate message when no comments are present
|
||||
success, success_list, explanation = handler.guess_success(
|
||||
@@ -257,29 +258,29 @@ def test_pr_handler_guess_success_no_comments():
|
||||
)
|
||||
assert success is False
|
||||
assert success_list is None
|
||||
assert explanation == "No feedback was found to process"
|
||||
assert explanation == 'No feedback was found to process'
|
||||
|
||||
|
||||
def test_get_issue_comments_with_specific_comment_id():
|
||||
# Mock the necessary dependencies
|
||||
with patch("requests.get") as mock_get:
|
||||
with patch('requests.get') as mock_get:
|
||||
# Mock the response for comments
|
||||
mock_comments_response = MagicMock()
|
||||
mock_comments_response.json.return_value = [
|
||||
{"id": 123, "body": "First comment"},
|
||||
{"id": 456, "body": "Second comment"},
|
||||
{'id': 123, 'body': 'First comment'},
|
||||
{'id': 456, 'body': 'Second comment'},
|
||||
]
|
||||
|
||||
mock_get.return_value = mock_comments_response
|
||||
|
||||
# Create an instance of IssueHandler
|
||||
handler = IssueHandler("test-owner", "test-repo", "test-token")
|
||||
handler = IssueHandler('test-owner', 'test-repo', 'test-token')
|
||||
|
||||
# Get comments with a specific comment_id
|
||||
specific_comment = handler._get_issue_comments(issue_number=1, comment_id=123)
|
||||
|
||||
# Verify only the specific comment is returned
|
||||
assert specific_comment == ["First comment"]
|
||||
assert specific_comment == ['First comment']
|
||||
|
||||
|
||||
def test_pr_handler_get_converted_issues_with_specific_thread_comment():
|
||||
@@ -287,50 +288,50 @@ def test_pr_handler_get_converted_issues_with_specific_thread_comment():
|
||||
specific_comment_id = 123
|
||||
|
||||
# Mock GraphQL response for review threads
|
||||
with patch("requests.get") as mock_get:
|
||||
with patch('requests.get') as mock_get:
|
||||
# Mock the response for PRs
|
||||
mock_prs_response = MagicMock()
|
||||
mock_prs_response.json.return_value = [
|
||||
{
|
||||
"number": 1,
|
||||
"title": "Test PR",
|
||||
"body": "Test Body",
|
||||
"head": {"ref": "test-branch"},
|
||||
'number': 1,
|
||||
'title': 'Test PR',
|
||||
'body': 'Test Body',
|
||||
'head': {'ref': 'test-branch'},
|
||||
}
|
||||
]
|
||||
|
||||
# Mock the response for PR comments
|
||||
mock_comments_response = MagicMock()
|
||||
mock_comments_response.json.return_value = [
|
||||
{"body": "First comment", "id": 123},
|
||||
{"body": "Second comment", "id": 124},
|
||||
{'body': 'First comment', 'id': 123},
|
||||
{'body': 'Second comment', 'id': 124},
|
||||
]
|
||||
|
||||
# Mock the response for PR metadata (GraphQL)
|
||||
mock_graphql_response = MagicMock()
|
||||
mock_graphql_response.json.return_value = {
|
||||
"data": {
|
||||
"repository": {
|
||||
"pullRequest": {
|
||||
"closingIssuesReferences": {"edges": []},
|
||||
"reviews": {"nodes": []},
|
||||
"reviewThreads": {
|
||||
"edges": [
|
||||
'data': {
|
||||
'repository': {
|
||||
'pullRequest': {
|
||||
'closingIssuesReferences': {'edges': []},
|
||||
'reviews': {'nodes': []},
|
||||
'reviewThreads': {
|
||||
'edges': [
|
||||
{
|
||||
"node": {
|
||||
"id": "review-thread-1",
|
||||
"isResolved": False,
|
||||
"comments": {
|
||||
"nodes": [
|
||||
'node': {
|
||||
'id': 'review-thread-1',
|
||||
'isResolved': False,
|
||||
'comments': {
|
||||
'nodes': [
|
||||
{
|
||||
"fullDatabaseId": 121,
|
||||
"body": "Specific review comment",
|
||||
"path": "file1.txt",
|
||||
'fullDatabaseId': 121,
|
||||
'body': 'Specific review comment',
|
||||
'path': 'file1.txt',
|
||||
},
|
||||
{
|
||||
"fullDatabaseId": 456,
|
||||
"body": "Another review comment",
|
||||
"path": "file2.txt",
|
||||
'fullDatabaseId': 456,
|
||||
'body': 'Another review comment',
|
||||
'path': 'file2.txt',
|
||||
},
|
||||
]
|
||||
},
|
||||
@@ -356,30 +357,32 @@ def test_pr_handler_get_converted_issues_with_specific_thread_comment():
|
||||
]
|
||||
|
||||
# Mock the post request for GraphQL
|
||||
with patch("requests.post") as mock_post:
|
||||
with patch('requests.post') as mock_post:
|
||||
mock_post.return_value = mock_graphql_response
|
||||
|
||||
# Create an instance of PRHandler
|
||||
handler = PRHandler("test-owner", "test-repo", "test-token")
|
||||
handler = PRHandler('test-owner', 'test-repo', 'test-token')
|
||||
|
||||
# Get converted issues
|
||||
prs = handler.get_converted_issues(comment_id=specific_comment_id)
|
||||
prs = handler.get_converted_issues(
|
||||
issue_numbers=[1], comment_id=specific_comment_id
|
||||
)
|
||||
|
||||
# Verify that we got exactly one PR
|
||||
assert len(prs) == 1
|
||||
|
||||
# Verify that thread_comments are set correctly
|
||||
assert prs[0].thread_comments == ["First comment"]
|
||||
assert prs[0].thread_comments == ['First comment']
|
||||
assert prs[0].review_comments == []
|
||||
assert prs[0].review_threads == []
|
||||
|
||||
# Verify other fields are set correctly
|
||||
assert prs[0].number == 1
|
||||
assert prs[0].title == "Test PR"
|
||||
assert prs[0].body == "Test Body"
|
||||
assert prs[0].owner == "test-owner"
|
||||
assert prs[0].repo == "test-repo"
|
||||
assert prs[0].head_branch == "test-branch"
|
||||
assert prs[0].title == 'Test PR'
|
||||
assert prs[0].body == 'Test Body'
|
||||
assert prs[0].owner == 'test-owner'
|
||||
assert prs[0].repo == 'test-repo'
|
||||
assert prs[0].head_branch == 'test-branch'
|
||||
|
||||
|
||||
def test_pr_handler_get_converted_issues_with_specific_review_thread_comment():
|
||||
@@ -387,50 +390,50 @@ def test_pr_handler_get_converted_issues_with_specific_review_thread_comment():
|
||||
specific_comment_id = 123
|
||||
|
||||
# Mock GraphQL response for review threads
|
||||
with patch("requests.get") as mock_get:
|
||||
with patch('requests.get') as mock_get:
|
||||
# Mock the response for PRs
|
||||
mock_prs_response = MagicMock()
|
||||
mock_prs_response.json.return_value = [
|
||||
{
|
||||
"number": 1,
|
||||
"title": "Test PR",
|
||||
"body": "Test Body",
|
||||
"head": {"ref": "test-branch"},
|
||||
'number': 1,
|
||||
'title': 'Test PR',
|
||||
'body': 'Test Body',
|
||||
'head': {'ref': 'test-branch'},
|
||||
}
|
||||
]
|
||||
|
||||
# Mock the response for PR comments
|
||||
mock_comments_response = MagicMock()
|
||||
mock_comments_response.json.return_value = [
|
||||
{"body": "First comment", "id": 120},
|
||||
{"body": "Second comment", "id": 124},
|
||||
{'body': 'First comment', 'id': 120},
|
||||
{'body': 'Second comment', 'id': 124},
|
||||
]
|
||||
|
||||
# Mock the response for PR metadata (GraphQL)
|
||||
mock_graphql_response = MagicMock()
|
||||
mock_graphql_response.json.return_value = {
|
||||
"data": {
|
||||
"repository": {
|
||||
"pullRequest": {
|
||||
"closingIssuesReferences": {"edges": []},
|
||||
"reviews": {"nodes": []},
|
||||
"reviewThreads": {
|
||||
"edges": [
|
||||
'data': {
|
||||
'repository': {
|
||||
'pullRequest': {
|
||||
'closingIssuesReferences': {'edges': []},
|
||||
'reviews': {'nodes': []},
|
||||
'reviewThreads': {
|
||||
'edges': [
|
||||
{
|
||||
"node": {
|
||||
"id": "review-thread-1",
|
||||
"isResolved": False,
|
||||
"comments": {
|
||||
"nodes": [
|
||||
'node': {
|
||||
'id': 'review-thread-1',
|
||||
'isResolved': False,
|
||||
'comments': {
|
||||
'nodes': [
|
||||
{
|
||||
"fullDatabaseId": specific_comment_id,
|
||||
"body": "Specific review comment",
|
||||
"path": "file1.txt",
|
||||
'fullDatabaseId': specific_comment_id,
|
||||
'body': 'Specific review comment',
|
||||
'path': 'file1.txt',
|
||||
},
|
||||
{
|
||||
"fullDatabaseId": 456,
|
||||
"body": "Another review comment",
|
||||
"path": "file1.txt",
|
||||
'fullDatabaseId': 456,
|
||||
'body': 'Another review comment',
|
||||
'path': 'file1.txt',
|
||||
},
|
||||
]
|
||||
},
|
||||
@@ -456,14 +459,16 @@ def test_pr_handler_get_converted_issues_with_specific_review_thread_comment():
|
||||
]
|
||||
|
||||
# Mock the post request for GraphQL
|
||||
with patch("requests.post") as mock_post:
|
||||
with patch('requests.post') as mock_post:
|
||||
mock_post.return_value = mock_graphql_response
|
||||
|
||||
# Create an instance of PRHandler
|
||||
handler = PRHandler("test-owner", "test-repo", "test-token")
|
||||
handler = PRHandler('test-owner', 'test-repo', 'test-token')
|
||||
|
||||
# Get converted issues
|
||||
prs = handler.get_converted_issues(comment_id=specific_comment_id)
|
||||
prs = handler.get_converted_issues(
|
||||
issue_numbers=[1], comment_id=specific_comment_id
|
||||
)
|
||||
|
||||
# Verify that we got exactly one PR
|
||||
assert len(prs) == 1
|
||||
@@ -475,17 +480,17 @@ def test_pr_handler_get_converted_issues_with_specific_review_thread_comment():
|
||||
assert isinstance(prs[0].review_threads[0], ReviewThread)
|
||||
assert (
|
||||
prs[0].review_threads[0].comment
|
||||
== "Specific review comment\n---\nlatest feedback:\nAnother review comment\n"
|
||||
== 'Specific review comment\n---\nlatest feedback:\nAnother review comment\n'
|
||||
)
|
||||
assert prs[0].review_threads[0].files == ["file1.txt"]
|
||||
assert prs[0].review_threads[0].files == ['file1.txt']
|
||||
|
||||
# Verify other fields are set correctly
|
||||
assert prs[0].number == 1
|
||||
assert prs[0].title == "Test PR"
|
||||
assert prs[0].body == "Test Body"
|
||||
assert prs[0].owner == "test-owner"
|
||||
assert prs[0].repo == "test-repo"
|
||||
assert prs[0].head_branch == "test-branch"
|
||||
assert prs[0].title == 'Test PR'
|
||||
assert prs[0].body == 'Test Body'
|
||||
assert prs[0].owner == 'test-owner'
|
||||
assert prs[0].repo == 'test-repo'
|
||||
assert prs[0].head_branch == 'test-branch'
|
||||
|
||||
|
||||
def test_pr_handler_get_converted_issues_with_specific_comment_and_issue_refs():
|
||||
@@ -493,50 +498,50 @@ def test_pr_handler_get_converted_issues_with_specific_comment_and_issue_refs():
|
||||
specific_comment_id = 123
|
||||
|
||||
# Mock GraphQL response for review threads
|
||||
with patch("requests.get") as mock_get:
|
||||
with patch('requests.get') as mock_get:
|
||||
# Mock the response for PRs
|
||||
mock_prs_response = MagicMock()
|
||||
mock_prs_response.json.return_value = [
|
||||
{
|
||||
"number": 1,
|
||||
"title": "Test PR fixes #3",
|
||||
"body": "Test Body",
|
||||
"head": {"ref": "test-branch"},
|
||||
'number': 1,
|
||||
'title': 'Test PR fixes #3',
|
||||
'body': 'Test Body',
|
||||
'head': {'ref': 'test-branch'},
|
||||
}
|
||||
]
|
||||
|
||||
# Mock the response for PR comments
|
||||
mock_comments_response = MagicMock()
|
||||
mock_comments_response.json.return_value = [
|
||||
{"body": "First comment", "id": 120},
|
||||
{"body": "Second comment", "id": 124},
|
||||
{'body': 'First comment', 'id': 120},
|
||||
{'body': 'Second comment', 'id': 124},
|
||||
]
|
||||
|
||||
# Mock the response for PR metadata (GraphQL)
|
||||
mock_graphql_response = MagicMock()
|
||||
mock_graphql_response.json.return_value = {
|
||||
"data": {
|
||||
"repository": {
|
||||
"pullRequest": {
|
||||
"closingIssuesReferences": {"edges": []},
|
||||
"reviews": {"nodes": []},
|
||||
"reviewThreads": {
|
||||
"edges": [
|
||||
'data': {
|
||||
'repository': {
|
||||
'pullRequest': {
|
||||
'closingIssuesReferences': {'edges': []},
|
||||
'reviews': {'nodes': []},
|
||||
'reviewThreads': {
|
||||
'edges': [
|
||||
{
|
||||
"node": {
|
||||
"id": "review-thread-1",
|
||||
"isResolved": False,
|
||||
"comments": {
|
||||
"nodes": [
|
||||
'node': {
|
||||
'id': 'review-thread-1',
|
||||
'isResolved': False,
|
||||
'comments': {
|
||||
'nodes': [
|
||||
{
|
||||
"fullDatabaseId": specific_comment_id,
|
||||
"body": "Specific review comment that references #6",
|
||||
"path": "file1.txt",
|
||||
'fullDatabaseId': specific_comment_id,
|
||||
'body': 'Specific review comment that references #6',
|
||||
'path': 'file1.txt',
|
||||
},
|
||||
{
|
||||
"fullDatabaseId": 456,
|
||||
"body": "Another review comment referencing #7",
|
||||
"path": "file2.txt",
|
||||
'fullDatabaseId': 456,
|
||||
'body': 'Another review comment referencing #7',
|
||||
'path': 'file2.txt',
|
||||
},
|
||||
]
|
||||
},
|
||||
@@ -557,13 +562,13 @@ def test_pr_handler_get_converted_issues_with_specific_comment_and_issue_refs():
|
||||
# Mock the response for fetching the external issue referenced in PR body
|
||||
mock_external_issue_response_in_body = MagicMock()
|
||||
mock_external_issue_response_in_body.json.return_value = {
|
||||
"body": "External context #1."
|
||||
'body': 'External context #1.'
|
||||
}
|
||||
|
||||
# Mock the response for fetching the external issue referenced in review thread
|
||||
mock_external_issue_response_review_thread = MagicMock()
|
||||
mock_external_issue_response_review_thread.json.return_value = {
|
||||
"body": "External context #2."
|
||||
'body': 'External context #2.'
|
||||
}
|
||||
|
||||
mock_get.side_effect = [
|
||||
@@ -576,14 +581,16 @@ def test_pr_handler_get_converted_issues_with_specific_comment_and_issue_refs():
|
||||
]
|
||||
|
||||
# Mock the post request for GraphQL
|
||||
with patch("requests.post") as mock_post:
|
||||
with patch('requests.post') as mock_post:
|
||||
mock_post.return_value = mock_graphql_response
|
||||
|
||||
# Create an instance of PRHandler
|
||||
handler = PRHandler("test-owner", "test-repo", "test-token")
|
||||
handler = PRHandler('test-owner', 'test-repo', 'test-token')
|
||||
|
||||
# Get converted issues
|
||||
prs = handler.get_converted_issues(comment_id=specific_comment_id)
|
||||
prs = handler.get_converted_issues(
|
||||
issue_numbers=[1], comment_id=specific_comment_id
|
||||
)
|
||||
|
||||
# Verify that we got exactly one PR
|
||||
assert len(prs) == 1
|
||||
@@ -595,52 +602,52 @@ def test_pr_handler_get_converted_issues_with_specific_comment_and_issue_refs():
|
||||
assert isinstance(prs[0].review_threads[0], ReviewThread)
|
||||
assert (
|
||||
prs[0].review_threads[0].comment
|
||||
== "Specific review comment that references #6\n---\nlatest feedback:\nAnother review comment referencing #7\n"
|
||||
== 'Specific review comment that references #6\n---\nlatest feedback:\nAnother review comment referencing #7\n'
|
||||
)
|
||||
assert prs[0].closing_issues == [
|
||||
"External context #1.",
|
||||
"External context #2.",
|
||||
'External context #1.',
|
||||
'External context #2.',
|
||||
] # Only includes references inside comment ID and body PR
|
||||
|
||||
# Verify other fields are set correctly
|
||||
assert prs[0].number == 1
|
||||
assert prs[0].title == "Test PR fixes #3"
|
||||
assert prs[0].body == "Test Body"
|
||||
assert prs[0].owner == "test-owner"
|
||||
assert prs[0].repo == "test-repo"
|
||||
assert prs[0].head_branch == "test-branch"
|
||||
assert prs[0].title == 'Test PR fixes #3'
|
||||
assert prs[0].body == 'Test Body'
|
||||
assert prs[0].owner == 'test-owner'
|
||||
assert prs[0].repo == 'test-repo'
|
||||
assert prs[0].head_branch == 'test-branch'
|
||||
|
||||
|
||||
def test_pr_handler_get_converted_issues_with_duplicate_issue_refs():
|
||||
# Mock the necessary dependencies
|
||||
with patch("requests.get") as mock_get:
|
||||
with patch('requests.get') as mock_get:
|
||||
# Mock the response for PRs
|
||||
mock_prs_response = MagicMock()
|
||||
mock_prs_response.json.return_value = [
|
||||
{
|
||||
"number": 1,
|
||||
"title": "Test PR",
|
||||
"body": "Test Body fixes #1",
|
||||
"head": {"ref": "test-branch"},
|
||||
'number': 1,
|
||||
'title': 'Test PR',
|
||||
'body': 'Test Body fixes #1',
|
||||
'head': {'ref': 'test-branch'},
|
||||
}
|
||||
]
|
||||
|
||||
# Mock the response for PR comments
|
||||
mock_comments_response = MagicMock()
|
||||
mock_comments_response.json.return_value = [
|
||||
{"body": "First comment addressing #1"},
|
||||
{"body": "Second comment addressing #2"},
|
||||
{'body': 'First comment addressing #1'},
|
||||
{'body': 'Second comment addressing #2'},
|
||||
]
|
||||
|
||||
# Mock the response for PR metadata (GraphQL)
|
||||
mock_graphql_response = MagicMock()
|
||||
mock_graphql_response.json.return_value = {
|
||||
"data": {
|
||||
"repository": {
|
||||
"pullRequest": {
|
||||
"closingIssuesReferences": {"edges": []},
|
||||
"reviews": {"nodes": []},
|
||||
"reviewThreads": {"edges": []},
|
||||
'data': {
|
||||
'repository': {
|
||||
'pullRequest': {
|
||||
'closingIssuesReferences': {'edges': []},
|
||||
'reviews': {'nodes': []},
|
||||
'reviewThreads': {'edges': []},
|
||||
}
|
||||
}
|
||||
}
|
||||
@@ -654,13 +661,13 @@ def test_pr_handler_get_converted_issues_with_duplicate_issue_refs():
|
||||
# Mock the response for fetching the external issue referenced in PR body
|
||||
mock_external_issue_response_in_body = MagicMock()
|
||||
mock_external_issue_response_in_body.json.return_value = {
|
||||
"body": "External context #1."
|
||||
'body': 'External context #1.'
|
||||
}
|
||||
|
||||
# Mock the response for fetching the external issue referenced in review thread
|
||||
mock_external_issue_response_in_comment = MagicMock()
|
||||
mock_external_issue_response_in_comment.json.return_value = {
|
||||
"body": "External context #2."
|
||||
'body': 'External context #2.'
|
||||
}
|
||||
|
||||
mock_get.side_effect = [
|
||||
@@ -673,32 +680,32 @@ def test_pr_handler_get_converted_issues_with_duplicate_issue_refs():
|
||||
]
|
||||
|
||||
# Mock the post request for GraphQL
|
||||
with patch("requests.post") as mock_post:
|
||||
with patch('requests.post') as mock_post:
|
||||
mock_post.return_value = mock_graphql_response
|
||||
|
||||
# Create an instance of PRHandler
|
||||
handler = PRHandler("test-owner", "test-repo", "test-token")
|
||||
handler = PRHandler('test-owner', 'test-repo', 'test-token')
|
||||
|
||||
# Get converted issues
|
||||
prs = handler.get_converted_issues()
|
||||
prs = handler.get_converted_issues(issue_numbers=[1])
|
||||
|
||||
# Verify that we got exactly one PR
|
||||
assert len(prs) == 1
|
||||
|
||||
# Verify that thread_comments are set correctly
|
||||
assert prs[0].thread_comments == [
|
||||
"First comment addressing #1",
|
||||
"Second comment addressing #2",
|
||||
'First comment addressing #1',
|
||||
'Second comment addressing #2',
|
||||
]
|
||||
|
||||
# Verify other fields are set correctly
|
||||
assert prs[0].number == 1
|
||||
assert prs[0].title == "Test PR"
|
||||
assert prs[0].body == "Test Body fixes #1"
|
||||
assert prs[0].owner == "test-owner"
|
||||
assert prs[0].repo == "test-repo"
|
||||
assert prs[0].head_branch == "test-branch"
|
||||
assert prs[0].title == 'Test PR'
|
||||
assert prs[0].body == 'Test Body fixes #1'
|
||||
assert prs[0].owner == 'test-owner'
|
||||
assert prs[0].repo == 'test-repo'
|
||||
assert prs[0].head_branch == 'test-branch'
|
||||
assert prs[0].closing_issues == [
|
||||
"External context #1.",
|
||||
"External context #2.",
|
||||
'External context #1.',
|
||||
'External context #2.',
|
||||
]
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
@@ -322,7 +322,17 @@ def test_update_existing_pull_request(
|
||||
)
|
||||
|
||||
|
||||
@pytest.mark.parametrize('pr_type', ['branch', 'draft', 'ready'])
|
||||
@pytest.mark.parametrize(
|
||||
'pr_type,target_branch',
|
||||
[
|
||||
('branch', None),
|
||||
('draft', None),
|
||||
('ready', None),
|
||||
('branch', 'feature'),
|
||||
('draft', 'develop'),
|
||||
('ready', 'staging'),
|
||||
],
|
||||
)
|
||||
@patch('subprocess.run')
|
||||
@patch('requests.post')
|
||||
@patch('requests.get')
|
||||
@@ -334,14 +344,22 @@ def test_send_pull_request(
|
||||
mock_output_dir,
|
||||
mock_llm_config,
|
||||
pr_type,
|
||||
target_branch,
|
||||
):
|
||||
repo_path = os.path.join(mock_output_dir, 'repo')
|
||||
|
||||
# Mock API responses
|
||||
mock_get.side_effect = [
|
||||
MagicMock(status_code=404), # Branch doesn't exist
|
||||
MagicMock(json=lambda: {'default_branch': 'main'}),
|
||||
]
|
||||
# Mock API responses based on whether target_branch is specified
|
||||
if target_branch:
|
||||
mock_get.side_effect = [
|
||||
MagicMock(status_code=404), # Branch doesn't exist
|
||||
MagicMock(status_code=200), # Target branch exists
|
||||
]
|
||||
else:
|
||||
mock_get.side_effect = [
|
||||
MagicMock(status_code=404), # Branch doesn't exist
|
||||
MagicMock(json=lambda: {'default_branch': 'main'}), # Get default branch
|
||||
]
|
||||
|
||||
mock_post.return_value.json.return_value = {
|
||||
'html_url': 'https://github.com/test-owner/test-repo/pull/1'
|
||||
}
|
||||
@@ -360,10 +378,12 @@ def test_send_pull_request(
|
||||
patch_dir=repo_path,
|
||||
pr_type=pr_type,
|
||||
llm_config=mock_llm_config,
|
||||
target_branch=target_branch,
|
||||
)
|
||||
|
||||
# Assert API calls
|
||||
assert mock_get.call_count == 2
|
||||
expected_get_calls = 2
|
||||
assert mock_get.call_count == expected_get_calls
|
||||
|
||||
# Check branch creation and push
|
||||
assert mock_run.call_count == 2
|
||||
@@ -401,10 +421,41 @@ def test_send_pull_request(
|
||||
assert post_data['title'] == 'Fix issue #42: Test Issue'
|
||||
assert post_data['body'].startswith('This pull request fixes #42.')
|
||||
assert post_data['head'] == 'openhands-fix-issue-42'
|
||||
assert post_data['base'] == 'main'
|
||||
assert post_data['base'] == (target_branch if target_branch else 'main')
|
||||
assert post_data['draft'] == (pr_type == 'draft')
|
||||
|
||||
|
||||
@patch('requests.get')
|
||||
def test_send_pull_request_invalid_target_branch(
|
||||
mock_get, mock_github_issue, mock_output_dir, mock_llm_config
|
||||
):
|
||||
"""Test that an error is raised when specifying a non-existent target branch"""
|
||||
repo_path = os.path.join(mock_output_dir, 'repo')
|
||||
|
||||
# Mock API response for non-existent branch
|
||||
mock_get.side_effect = [
|
||||
MagicMock(status_code=404), # Branch doesn't exist
|
||||
MagicMock(status_code=404), # Target branch doesn't exist
|
||||
]
|
||||
|
||||
# Test that ValueError is raised when target branch doesn't exist
|
||||
with pytest.raises(
|
||||
ValueError, match='Target branch nonexistent-branch does not exist'
|
||||
):
|
||||
send_pull_request(
|
||||
github_issue=mock_github_issue,
|
||||
github_token='test-token',
|
||||
github_username='test-user',
|
||||
patch_dir=repo_path,
|
||||
pr_type='ready',
|
||||
llm_config=mock_llm_config,
|
||||
target_branch='nonexistent-branch',
|
||||
)
|
||||
|
||||
# Verify API calls
|
||||
assert mock_get.call_count == 2
|
||||
|
||||
|
||||
@patch('subprocess.run')
|
||||
@patch('requests.post')
|
||||
@patch('requests.get')
|
||||
@@ -616,6 +667,7 @@ def test_process_single_pr_update(
|
||||
mock_llm_config,
|
||||
None,
|
||||
False,
|
||||
None,
|
||||
)
|
||||
|
||||
mock_initialize_repo.assert_called_once_with(mock_output_dir, 1, 'pr', 'branch 1')
|
||||
@@ -688,6 +740,7 @@ def test_process_single_issue(
|
||||
mock_llm_config,
|
||||
None,
|
||||
False,
|
||||
None,
|
||||
)
|
||||
|
||||
# Assert that the mocked functions were called with correct arguments
|
||||
@@ -704,9 +757,10 @@ def test_process_single_issue(
|
||||
github_username=github_username,
|
||||
patch_dir=f'{mock_output_dir}/patches/issue_1',
|
||||
pr_type=pr_type,
|
||||
llm_config=mock_llm_config,
|
||||
fork_owner=None,
|
||||
additional_message=resolver_output.success_explanation,
|
||||
llm_config=mock_llm_config,
|
||||
target_branch=None,
|
||||
)
|
||||
|
||||
|
||||
@@ -757,6 +811,7 @@ def test_process_single_issue_unsuccessful(
|
||||
mock_llm_config,
|
||||
None,
|
||||
False,
|
||||
None,
|
||||
)
|
||||
|
||||
# Assert that none of the mocked functions were called
|
||||
@@ -863,6 +918,7 @@ def test_process_all_successful_issues(
|
||||
mock_llm_config,
|
||||
None,
|
||||
False,
|
||||
None,
|
||||
),
|
||||
call(
|
||||
'output_dir',
|
||||
@@ -873,6 +929,7 @@ def test_process_all_successful_issues(
|
||||
mock_llm_config,
|
||||
None,
|
||||
False,
|
||||
None,
|
||||
),
|
||||
]
|
||||
)
|
||||
@@ -971,6 +1028,7 @@ def test_main(
|
||||
mock_args.llm_model = 'mock_model'
|
||||
mock_args.llm_base_url = 'mock_url'
|
||||
mock_args.llm_api_key = 'mock_key'
|
||||
mock_args.target_branch = None
|
||||
mock_parser.return_value.parse_args.return_value = mock_args
|
||||
|
||||
# Setup environment variables
|
||||
@@ -994,12 +1052,8 @@ def test_main(
|
||||
api_key=mock_args.llm_api_key,
|
||||
)
|
||||
|
||||
# Assert function calls
|
||||
mock_parser.assert_called_once()
|
||||
mock_getenv.assert_any_call('GITHUB_TOKEN')
|
||||
mock_path_exists.assert_called_with('/mock/output')
|
||||
mock_load_single_resolver_output.assert_called_with('/mock/output/output.jsonl', 42)
|
||||
mock_process_single_issue.assert_called_with(
|
||||
# Use any_call instead of assert_called_with for more flexible matching
|
||||
assert mock_process_single_issue.call_args == call(
|
||||
'/mock/output',
|
||||
mock_resolver_output,
|
||||
'mock_token',
|
||||
@@ -1008,8 +1062,15 @@ def test_main(
|
||||
llm_config,
|
||||
None,
|
||||
False,
|
||||
mock_args.target_branch,
|
||||
)
|
||||
|
||||
# Other assertions
|
||||
mock_parser.assert_called_once()
|
||||
mock_getenv.assert_any_call('GITHUB_TOKEN')
|
||||
mock_path_exists.assert_called_with('/mock/output')
|
||||
mock_load_single_resolver_output.assert_called_with('/mock/output/output.jsonl', 42)
|
||||
|
||||
# Test for 'all_successful' issue number
|
||||
mock_args.issue_number = 'all_successful'
|
||||
main()
|
||||
|
||||
@@ -0,0 +1,33 @@
|
||||
from openhands.llm.fn_call_converter import (
|
||||
convert_fncall_messages_to_non_fncall_messages,
|
||||
)
|
||||
|
||||
|
||||
def test_convert_fncall_messages_no_content():
|
||||
"""Test that messages without content are handled correctly."""
|
||||
messages = [
|
||||
{'role': 'system', 'content': 'You are a helpful assistant.'},
|
||||
{'role': 'user', 'content': 'Hello!'},
|
||||
{
|
||||
'role': 'assistant',
|
||||
'function_call': {'name': 'greet', 'arguments': '{}'},
|
||||
'role': 'assistant',
|
||||
}, # No content
|
||||
]
|
||||
tools = [
|
||||
{
|
||||
'type': 'function',
|
||||
'function': {
|
||||
'name': 'greet',
|
||||
'description': 'Greet the user',
|
||||
'parameters': {'type': 'object', 'properties': {}, 'required': []},
|
||||
},
|
||||
}
|
||||
]
|
||||
|
||||
# This should not raise a KeyError
|
||||
result = convert_fncall_messages_to_non_fncall_messages(
|
||||
messages, tools, add_in_context_learning_example=False
|
||||
)
|
||||
assert isinstance(result, list)
|
||||
assert len(result) == len(messages)
|
||||
Reference in New Issue
Block a user