QA Commitments proposal Q1 2026 (#351)

This commit is contained in:
fbarbu15
2025-12-15 13:56:14 +02:00
committed by GitHub
parent 4585e149e1
commit 5fdb4b5ec5
8 changed files with 835 additions and 0 deletions

View File

@@ -8,6 +8,28 @@ tags:
[[qa/preview|Roadmap Preview]]
## 2026q1 `vac:qa:`
---
### `vac:`
* [[qa/vac/2026q1-nim-libp2p-testing|nim-libp2p-testing ]]
### `waku:`
* [[qa/waku/2026q1-waku-testing|waku-testing ]]
### `status:`
* [[qa/status/2026q1-status-go-functional-testing|status-go-functional-testing ]]
* [[qa/status/2026q1-status-qa-desktop|status-qa-desktop ]]
* [[qa/status/2026q1-status-qa-mobile|status-qa-mobile ]]
### `keycard:`
* [[qa/keycard/2026q1-keycard-testing|keycard-testing ]]
### `logos:`
* [[qa/logos/2026q1-logos-core|logos-core ]]
---
## 2025q4 `vac:qa:`
---

View File

@@ -0,0 +1,30 @@
---
title: Keycard Testing
tags:
- "2026q1"
- "qa"
- "keycard"
draft: false
description: Ensure quality of Keycard applications.
---
`vac:qa:keycard:2026q1-keycard-testing`
## Description
Ensure quality of Keycard applications, in particular Keycard shell.
## Task List
### Keycard Shell Tests
* fully qualified name: `vac:qa:keycard:2026q1-keycard-testing:wallet-compatibilty`
* owner: romanzac
* status: not started
* start-date: 2026/01/01
* end-date: 2026/03/31
#### Description
Rested the Keycard Shell for 3rd party wallet compatibility based on dev requests and existing compatibility matrix.
#### Deliverables
- Results and/or issues

View File

@@ -0,0 +1,55 @@
---
title: Logos Core QA
tags:
- "2026q1"
- "qa"
- "logos"
draft: false
description: Validate the first Logos Core iteration and stand up automated testing foundations.
---
`vac:qa:logos:2026q1-logos-core`
## Description
Exercise the first iteration of Logos Core to understand stability, feature completeness, and integration risks, while putting the automation plumbing in place to keep coverage running in CI.
## Task List
### Evaluate and test first iteration of Logos Core
* fully qualified name: `vac:qa:logos:2026q1-logos-core:evaluate`
* owner: egor
* status: not started
* start-date: 2026/03/01
* end-date: 2026/03/15
#### Description
- Review shipped scope for the first Logos Core iteration and create a focused acceptance checklist.
- Log defects and gaps with priority/severity and expected fixes or RFC clarifications.
#### Deliverables
- Test report summarizing coverage, findings, and confidence level for the initial drop.
- GitHub issues for discovered defects or spec mismatches.
### Establish automated testing framework
* fully qualified name: `vac:qa:logos:2026q1-logos-core:automation-framework`
* owner: egor
* status: not started
* start-date: 2026/03/15
* end-date: 2026/03/31
#### Description
- Select or adapt a harness suitable for Logos Core (test runner, fixtures, and environment orchestration).
- Implement automated scenarios that cover the initial feature set and stability checks.
#### Deliverables
- PR with New repo.

View File

@@ -0,0 +1,285 @@
---
title: Status Go Functional Testing
tags:
- "2026q1"
- "qa"
- "status"
draft: false
description: Enhance functional and e2e testing for status-go features by implementing tests using status-backend.
---
`vac:qa:status:2026q1-status-go-functional-testing`
## Description
Modernize the functional/e2e testing stack for status-go by cleaning up fixtures,
improving the Python SDK, and expanding test coverage as defined [here](https://github.com/orgs/status-im/projects/166/views/4).
## Task List
### Remove direct usage of Anvil pre-generated accounts
* fully qualified name: `vac:qa:status:2026q1-status-go-functional-testing:7086`
* owner: egor
* status: not started
* start-date: 2026/01/19
* end-date: 2026/01/30
#### Description
Eliminate hardcoded Anvil accounts and switch to dynamically managed identities.
#### Deliverables
- PRs and/or Issues
### Deploy contracts as part of `docker compose` pre-requisite
* fully qualified name: `vac:qa:status:2026q1-status-go-functional-testing:7087`
* owner: egor
* status: not started
* start-date: 2026/02/02
* end-date: 2026/02/13
#### Description
Bundle contract deployment into the compose bootstrap to simplify test setup.
#### Deliverables
- PRs and/or Issues
### Remove usage of `setup_backends` fixture approach
* fully qualified name: `vac:qa:status:2026q1-status-go-functional-testing:7088`
* owner: egor
* status: not started
* start-date: 2026/02/16
* end-date: 2026/02/27
#### Description
Refactor tests to drop legacy `setup_backends` fixtures in favor of the new flow.
#### Deliverables
- PRs and/or Issues
### Extract `scan_waku_fleet.py` to a separate container, run as part of waku fleet compose
* fully qualified name: `vac:qa:status:2026q1-status-go-functional-testing:7089`
* owner: egor
* status: not started
* start-date: 2026/03/02
* end-date: 2026/03/13
#### Description
Containerize the fleet scanner and integrate it into the compose workflow.
#### Deliverables
- PRs and/or Issues
### Introduce `asyncio` into Python SDK
* fully qualified name: `vac:qa:status:2026q1-status-go-functional-testing:7090`
* owner: roman
* status: not started
* start-date: 2026/01/05
* end-date: 2026/01/16
#### Description
Add asyncio primitives to the Python SDK to enable async test flows.
#### Deliverables
- PRs and/or Issues
### Simplify `SignalClient`
* fully qualified name: `vac:qa:status:2026q1-status-go-functional-testing:7091`
* owner: roman
* status: not started
* start-date: 2026/01/19
* end-date: 2026/01/30
#### Description
Reduce complexity in `SignalClient` to improve reliability and readability.
#### Deliverables
- PRs and/or Issues
### Remove test classes inheritance to MessengerSteps
* fully qualified name: `vac:qa:status:2026q1-status-go-functional-testing:7098`
* owner: roman
* status: not started
* start-date: 2026/02/02
* end-date: 2026/02/13
#### Description
Uncouple tests from MessengerSteps inheritance to simplify fixtures and setup.
#### Deliverables
- PRs and/or Issues
### Cleanup and simplify Python SDK
* fully qualified name: `vac:qa:status:2026q1-status-go-functional-testing:7084`
* owner: roman
* status: not started
* start-date: 2026/02/16
* end-date: 2026/02/27
#### Description
Perform broader cleanup of the Python SDK to reduce flakiness and maintenance overhead.
#### Deliverables
- PRs and/or Issues
### Community Owner Token Functional Test
* fully qualified name: `vac:qa:status:2026q1-status-go-functional-testing:7128`
* owner: egor
* status: not started
* start-date: 2026/01/19
* end-date: 2026/01/30
#### Description
Validate ownership flows for community owner tokens.
#### Deliverables
- PRs and/or Issues
### Community Token Master Functional Test
* fully qualified name: `vac:qa:status:2026q1-status-go-functional-testing:7129`
* owner: egor
* status: not started
* start-date: 2026/02/02
* end-date: 2026/02/13
#### Description
Cover token master responsibilities and guardrails.
#### Deliverables
- PRs and/or Issues
### Community Admin Functional Test
* fully qualified name: `vac:qa:status:2026q1-status-go-functional-testing:7130`
* owner: egor
* status: not started
* start-date: 2026/02/16
* end-date: 2026/02/27
#### Description
Ensure admin-level permissions behave as expected in communities.
#### Deliverables
- PRs and/or Issues
### Community Ownership Transfer Functional Test
* fully qualified name: `vac:qa:status:2026q1-status-go-functional-testing:7131`
* owner: egor
* status: not started
* start-date: 2026/03/02
* end-date: 2026/03/13
#### Description
Test community ownership transfer workflows and state transitions.
#### Deliverables
- PRs and/or Issues
### Community Control Node Transfer Functional Test
* fully qualified name: `vac:qa:status:2026q1-status-go-functional-testing:7132`
* owner: egor
* status: not started
* start-date: 2026/03/16
* end-date: 2026/03/27
#### Description
Verify control node transfer procedures for communities.
#### Deliverables
- PRs and/or Issues
### Community-Level Permissions Functional Test
* fully qualified name: `vac:qa:status:2026q1-status-go-functional-testing:7133`
* owner: egor
* status: not started
* start-date: 2026/03/09
* end-date: 2026/03/20
#### Description
Validate community-level permission rules and enforcement.
#### Deliverables
- PRs and/or Issues
### Community Channel-Level Permissions Functional Test
* fully qualified name: `vac:qa:status:2026q1-status-go-functional-testing:7134`
* owner: egor
* status: not started
* start-date: 2026/03/18
* end-date: 2026/03/28
#### Description
Test permissions at the channel level within communities.
#### Deliverables
- PRs and/or Issues
### Implement ENS functional tests
* fully qualified name: `vac:qa:status:2026q1-status-go-functional-testing:7093`
* owner: egor
* status: not started
* start-date: 2026/01/12
* end-date: 2026/01/23
#### Description
Create functional coverage for ENS integration paths.
#### Deliverables
- PRs and/or Issues
### Expand nightly benchmarks
* fully qualified name: `vac:qa:status:2026q1-status-go-functional-testing:7094`
* owner: egor
* status: not started
* start-date: 2026/02/02
* end-date: 2026/02/13
#### Description
Broaden nightly benchmark scenarios to track performance and regressions.
#### Deliverables
- PRs and/or Issues
### Implement local notifications functional tests
* fully qualified name: `vac:qa:status:2026q1-status-go-functional-testing:7095`
* owner: egor
* status: not started
* start-date: 2026/02/23
* end-date: 2026/03/06
#### Description
Add functional tests for local notification flows.
#### Deliverables
- PRs and/or Issues
### Maintenance
* fully qualified name: `vac:qa:status:2026q1-status-go-functional-testing:maintenance`
* owner: egor
* status: in progress (30%)
* start-date: 2026/01/01
* end-date: 2026/03/31
#### Description
Ongoing maintenance of Status Functional tests.
This includes updating tests for changes in `status-go`, addressing regressions,
investigating and resolving issues, and implementing minor improvements to the testing framework as needed.
#### Deliverables
- PRs and/or Issues

View File

@@ -0,0 +1,121 @@
---
title: Status QA Desktop
tags:
- "2026q1"
- "qa"
- "status"
draft: false
description: Status QA Desktop
---
`vac:qa:status:2026q1-status-qa-desktop`
## Description
Collaborate with Status team to ensure that the Status Desktop app behaves as expected.
Add new automated tests to the existing e2e testing framework for new features.
Oversee testing strategy around releases.
## Task List
### Maintenance
* fully qualified name: `vac:qa:status:2026q1-status-qa-desktop:maintenance`
* owner: nastya
* status: not started
* start-date: 2026/01/01
* end-date: 2026/03/31
#### Description
- Ongoing maintenance of Status Desktop tests.
This includes updating tests for changes in status, addressing regressions,
investigating and resolving issues, and implementing minor improvements
to the testing framework as needed.
#### Deliverables
- PRs / Issues
### Release Testing
* fully qualified name: `vac:qa:status:2026q1-status-qa-desktop:release-testing`
* owner: nastya
* status: not started
* start-date: 2026/01/01
* end-date: 2026/03/31
#### Description
- Support Q1 releases with testing.
#### Deliverables
- PRs / Issues
### Privacy Mode
* fully qualified name: `vac:qa:status:2026q1-status-qa-desktop:privacy-mode`
* owner: nastya
* status: not started
* start-date: 2026/01/01
* end-date: 2026/03/31
#### Description
- Support new **Privacy Mode** feature in tests.
- Add new tests and update existing ones.
#### Deliverables
- PRs / Issues
### Dapp Browser
* fully qualified name: `vac:qa:status:2026q1-status-qa-desktop:dapp-browser`
* owner: nastya
* status: not started
* start-date: 2026/01/01
* end-date: 2026/03/31
#### Description
- Support Browser feature in tests.
- Add new tests and update existing ones.
#### Deliverables
- PRs / Issues
### Local Backup Opt-in
* fully qualified name: `vac:qa:status:2026q1-status-qa-desktop:local-backup-opt-in`
* owner: nastya
* status: not started
* start-date: 2026/01/01
* end-date: 2026/03/31
#### Description
- Opt-in messages Local Backup feature support in tests.
#### Deliverables
- PRs / Issues
### External Activity
* fully qualified name: `vac:qa:status:2026q1-status-qa-desktop:external-activity`
* owner: nastya
* status: not started
* start-date: 2026/01/01
* end-date: 2026/03/31
#### Description
- Support **Activity fetching** feature in tests.
#### Deliverables
- PRs / Issues
### Emoji Reactions
* fully qualified name: `vac:qa:status:2026q1-status-qa-desktop:emoji-reactions`
* owner: nastya
* status: not started
* start-date: 2026/01/01
* end-date: 2026/03/31
#### Description
- Maintenance for full emoji list in **Reactions** feature.
#### Deliverables
- PRs / Issues

View File

@@ -0,0 +1,153 @@
---
title: Status QA Mobile
tags:
- "2026q1"
- "qa"
- "status"
draft: false
description: Status QA Mobile
---
`vac:qa:status:2026q1-status-qa-mobile`
## Description
Continue building mobile/tablet test automation coverage for the Status app.
**Areas for Q1:**
- Wallet test coverage (account editing, receive modal, settings)
- Messaging test suite (1x1 advanced features, group chat)
- Communities testing ground work
- iOS testing pilot
**Current Coverage (End of Q4 2025):**
- 7 tests
- 61/298 discrete features covered (20%)
- Multi-device infrastructure added (2-device validated)
- BrowserStack CI integration nearing completion
## Task List
### Wallet test expansion
- fully qualified name: `vac:qa:status:2026q1-status-qa-mobile:test-wallet`
- owner: magnus
- status: not started
- start-date: 2026/01/01
- end-date: 2026/02/15
#### Description
Round out wallet automation to cover account edit, restart, receive, and settings flows.
#### Deliverables
- Account rename + restart path automated in `test_wallet_accounts_basic.py`
- Receive modal page object with QR/address assertions
- `test_add_delete_account_from_settings.py` ported (settings navigation + details view)
### iOS testing pilot
- fully qualified name: `vac:qa:status:2026q1-status-qa-mobile:ios-pilot`
- owner: magnus
- status: not started
- start-date: 2026/01/20
- end-date: 2026/02/15
#### Description
Investigate feasibility of adding iOS coverage to framework.
#### Deliverables
- Assessment for Q2 planning
### Messaging 1x1 additional features
- fully qualified name: `vac:qa:status:2026q1-status-qa-mobile:test-messaging-1x1`
- owner: magnus
- status: not started
- start-date: 2026/02/01
- end-date: 2026/02/21
#### Description
Bring the 1x1 messaging test to desktop parity, including edit/reply/react, media, and history flows.
#### Deliverables
- Messaging context menu + reaction/emoji helpers
- Media/emoji/reaction coverage added to `test_messaging_1x1_chat.py`
- Edit, reply, delete, clear-history assertions implemented
### Messaging group chat
- fully qualified name: `vac:qa:status:2026q1-status-qa-mobile:test-messaging-group`
- owner: magnus
- status: not started
- start-date: 2026/02/15
- end-date: 2026/03/15
#### Description
Stand up the first 3-device group chat test covering Activity Center acceptance, member management, and leave flows.
#### Deliverables
- Activity Center + group chat page objects
- `test_messaging_group_chat.py` ported with 3-device execution
- Member management, link preview, and leave-chat assertions validated
### Communities foundation
- fully qualified name: `vac:qa:status:2026q1-status-qa-mobile:test-communities`
- owner: magnus
- status: not started
- start-date: 2026/03/01
- end-date: 2026/03/31
#### Description
Lay the groundwork for communities tests with page objects and a basic create/invite/join flow.
#### Deliverables
- Community overview/settings/channel page objects
- Smoke test covering create - invite - join (stretch goal)
- Documented gaps for permissions, categories, and pinning (Q2 follow-up)
### Maintenance
- fully qualified name: `vac:qa:status:2026q1-status-qa-mobile:maintenance`
- owner: magnus
- status: not started
- start-date: 2026/01/01
- end-date: 2026/03/31
#### Description
Keep the framework healthy while the app changes.
#### Deliverables
- Stability of tests monitored and flakey tests triaged
- Tests maintained through Status app refactors
### Release testing
- fully qualified name: `vac:qa:status:2026q1-status-qa-mobile:release-testing`
- owner: magnus
- status: not started
- start-date: 2026/01/01
- end-date: 2026/03/31
#### Description
Support mobile release testing efforts:
- Exploratory testing on mobile builds
- Regression test execution
#### Deliverables
PRs and Issues

View File

@@ -0,0 +1,108 @@
---
title: Nim Libp2p Testing
tags:
- "2026q1"
- "qa"
- "vac"
draft: false
description: Expand nim-libp2p testing coverage with focus on new protocols, test plans, and stability improvements.
---
`vac:qa:vac:2026q1-nim-libp2p-testing`
## Description
Expand nim-libp2p testing coverage, documentation, and tooling with focus on new features under development.
Create test plans for Kad DHT, Mix, Autotls and AutonatV2.
Extend coverage for Mix, Kad DHT, Autotls, Identify/Push and Connectivity protocols.
## Task List
### Test Plans
* fully qualified name: `vac:qa:vac:2026q1-nim-libp2p-testing:test-plans`
* owner: radek
* status: not started
* start-date: 2026/01/01
* end-date: 2026/03/31
#### Description
Develop test plans for features currently under development:
- Mix
- Kad DHT
- Autotls
#### Deliverables
- Test plan docs
### Mix Protocol Testing
* fully qualified name: `vac:qa:vac:2026q1-nim-libp2p-testing:mix`
* owner: radek
* status: not started
* start-date: 2026/01/01
* end-date: 2026/01/25
#### Description
Implement unit and integration tests for the Mix protocol.
#### Deliverables
* PRs with links to added tests
### Kad DHT Protocol Testing
* fully qualified name: `vac:qa:vac:2026q1-nim-libp2p-testing:kad-dht`
* owner: radek
* status: not started
* start-date: 2026/01/25
* end-date: 2026/02/15
#### Description
Implement unit and integration tests for the Kad DHT protocol.
#### Deliverables
* PRs with links to added tests
### Autotls Protocol Testing
* fully qualified name: `vac:qa:vac:2026q1-nim-libp2p-testing:autotls`
* owner: radek
* status: not started
* start-date: 2026/02/15
* end-date: 2026/03/01
#### Description
Implement unit and integration tests for the Autotls protocol.
#### Deliverables
* PRs with links to added tests
### Identify/Push Protocol Testing
* fully qualified name: `vac:qa:vac:2026q1-nim-libp2p-testing:identify-push`
* owner: radek
* status: not started
* start-date: 2026/03/01
* end-date: 2025/03/15
#### Description
Implement unit and integration tests for the Identify/Push protocol,
covering peer identification, metadata exchange, push updates, and error handling.
#### Deliverables
* PRs with links to added tests
### Connectivity Protocol Testing
* fully qualified name: `vac:qa:vac:2026q1-nim-libp2p-testing:connectivity`
* owner: radek
* status: not started
* start-date: 2026/03/15
* end-date: 2025/03/31
#### Description
Implement tests for the Connectivity protocol to validate connection management,
connection limits, peer lifecycle handling, and resilience under different network conditions.
#### Deliverables
* PRs with links to added tests

View File

@@ -0,0 +1,61 @@
---
title: Waku Testing
tags:
- "2026q1"
- "qa"
- "waku"
draft: false
description: Maintain and ensure the reliability of Waku tests.
---
`vac:qa:waku:2026q1-waku-testing`
## Description
Ensure the ongoing reliability of the Waku by enhancing and maintaining existing testing frameworks.
This includes addressing regressions, adapting to changes in waku components,
and applying minor improvements to keep the frameworks functional and effective.
## Task List
### Waku Extended E2E Network Conditions Tests
* fully qualified name: `vac:qa:waku:2026q1-waku-testing:network-conditions`
* owner: aya
* status: not started
* start date: 2026/01/01
* end date: 2026/02/15
#### Description
Extend Waku end-to-end tests with network condition scenarios (high latency, low bandwidth, packet loss) for up to 7 nodes.
#### Deliverables
- PRs and issues
### Maintenance
* fully qualified name: `vac:qa:waku:2026q1-waku-testing:maintenance`
* owner: aya
* status: not started
* start-date: 2026/01/01
* end-date: 2026/03/31
#### Description
Ongoing maintenance of Waku testing frameworks.
#### Deliverables
- PRs and issues
### Waku Sonda Tool extension
* fully qualified name: `vac:qa:waku:2026q1-waku-testing:sonda-extension`
* owner: aya
* status: not started
* start date: 2026/02/15
* end date: 2026/03/31
#### Description
Extend Sonda tool to allow more advanced testing scenarios for the Store protocol, then add new advanced tests.
#### Deliverables
- PRs and issues