QA Updates - Week 11 of Q4 (#48)

This commit is contained in:
fbarbu15
2024-12-09 13:50:47 +02:00
committed by GitHub
parent d97f69ead1
commit 5e4b6062ec
8 changed files with 63 additions and 46 deletions

View File

@@ -12,7 +12,7 @@ description: Extend existing integration tests for the Codex project
---
`vac:qa:codex:integration-testing-2024q4`
`vac:qa:codex:2024q4-integration-testing`
## Description
Extend existing integration tests for the Codex project
@@ -32,7 +32,7 @@ and improving the project's reliability.
### Marketplace Endpoints
* fully qualified name: `vac:qa:codex:integration-testing-2024q4:marketplace-endpoints`
* fully qualified name: `vac:qa:codex:2024q4-integration-testing:marketplace-endpoints`
* owner: fbarbu15
* status: not started
* start-date: 2024/11/07
@@ -48,7 +48,7 @@ to ensure all key functionalities are thoroughly tested.
### Data Endpoints
* fully qualified name: `vac:qa:codex:integration-testing-2024q4:data-endpoints`
* fully qualified name: `vac:qa:codex:2024q4-integration-testing:data-endpoints`
* owner: fbarbu15
* status: not started
* start-date: 2024/11/21
@@ -65,7 +65,7 @@ perform correctly under different conditions.
### Node and Debug Endpoints
* fully qualified name: `vac:qa:codex:integration-testing-2024q4:node-and-debug-endpoints`
* fully qualified name: `vac:qa:codex:2024q4-integration-testing:node-and-debug-endpoints`
* owner: fbarbu15
* status: not started
* start-date: 2024/12/04

View File

@@ -10,7 +10,7 @@ description: Document existing QA strategy for IFT projects.
---
`vac:qa:ift:projects-qa-strategy-2024q4`
`vac:qa:ift:2024q4-projects-qa-strategy`
## Description
Document existing QA strategy for IFT projects.
@@ -31,7 +31,7 @@ any identified gaps, and recommendations for improvement.
### Waku
* fully qualified name: `vac:qa:ift:projects-qa-strategy-2024q4:waku`
* fully qualified name: `vac:qa:ift:2024q4-projects-qa-strategy:waku`
* owner: fbarbu15
* status: done
* start-date: 2024/10/07
@@ -48,7 +48,7 @@ identify gaps, and provide recommendations for improvements.
### Nomos
* fully qualified name: `vac:qa:ift:projects-qa-strategy-2024q4:nomos`
* fully qualified name: `vac:qa:ift:2024q4-projects-qa-strategy:nomos`
* owner: fbarbu15
* status: done
* start-date: 2024/10/21
@@ -63,7 +63,7 @@ identify gaps, and provide recommendations for improvements.
### Status
* fully qualified name: `vac:qa:ift:projects-qa-strategy-2024q4:status`
* fully qualified name: `vac:qa:ift:2024q4-projects-qa-strategy:status`
* owner: fbarbu15
* status: done
* start-date: 2024/11/04
@@ -78,7 +78,7 @@ identify gaps, and provide recommendations for improvements.
### Keycard
* fully qualified name: `vac:qa:ift:projects-qa-strategy-2024q4:keycard`
* fully qualified name: `vac:qa:ift:2024q4-projects-qa-strategy:keycard`
* owner: fbarbu15
* status: not started
* start-date: 2024/11/22
@@ -93,7 +93,7 @@ identify gaps, and provide recommendations for improvements.
### Nimbus
* fully qualified name: `vac:qa:ift:projects-qa-strategy-2024q4:nimbus`
* fully qualified name: `vac:qa:ift:2024q4-projects-qa-strategy:nimbus`
* owner: fbarbu15
* status: not started
* start-date: 2024/12/02

View File

@@ -5,24 +5,24 @@ tags:
- vac
---
## `vac:qa:`
## 2024q4 `vac:qa:`
---
### `ift:`
* [[qa/ift/projects-qa-strategy-2024q4|projects-qa-strategy-2024q4 ]]
* [[qa/ift/2024q4-projects-qa-strategy|projects-qa-strategy ]]
### `vac:`
* [[qa/vac/nim-libp2p-testing-2024q4|nim-libp2p-testing-2024q4 ]]
* [[qa/vac/2024q4-nim-libp2p-testing|nim-libp2p-testing ]]
### `waku:`
* [[qa/waku/interop-testing-2024q4|interop-testing-2024q4 ]]
* [[qa/waku/status-go-functional-testing-2024q4|status-go-functional-testing-2024q4 ]]
* [[qa/waku/2024q4-interop-testing|interop-testing ]]
* [[qa/waku/2024q4-status-go-functional-testing|status-go-functional-testing ]]
### `nomos:`
* [[qa/nomos/da-testing-2024q4|da-testing-2024q4 ]]
* [[qa/nomos/2024q4-da-testing|da-testing ]]
### `codex:`
* [[qa/codex/integration-testing-2024q4|integration-testing-2024q4 ]]
* [[qa/codex/2024q4-integration-testing|integration-testing ]]
### archive

View File

@@ -11,7 +11,7 @@ description: Implement data availability test plans for the Nomos project
---
`vac:qa:nomos:da-testing-2024q4`
`vac:qa:nomos:2024q4-da-testing`
## Description
Implement data availability test plans for the Nomos project
@@ -35,7 +35,7 @@ the test cases will need to be regularly updated to reflect those changes.
### Basic Functionality Tests
* fully qualified name: `vac:qa:nomos:da-testing-2024q4:basic-functionality-tests`
* fully qualified name: `vac:qa:nomos:2024q4-da-testing:basic-functionality-tests`
* owner: romanzac
* status: done
* start-date: 2024/10/07
@@ -71,7 +71,7 @@ Issues Found:
### Dispersal and Storage Tests
* fully qualified name: `vac:qa:nomos:da-testing-2024q4:dispersal-storage-tests`
* fully qualified name: `vac:qa:nomos:2024q4-da-testing:dispersal-storage-tests`
* owner: romanzac
* status: done
* start-date: 2024/10/21
@@ -94,7 +94,7 @@ Issues Found:
### Certification and Verification Tests
* fully qualified name: `vac:qa:nomos:da-testing-2024q4:certification-verification-tests`
* fully qualified name: `vac:qa:nomos:2024q4-da-testing:certification-verification-tests`
* owner: romanzac
* status: not started
* start-date: 2024/11/04
@@ -109,9 +109,9 @@ Add integration tests focusing on certificate completeness.
### Data Integrity Tests
* fully qualified name: `vac:qa:nomos:da-testing-2024q4:data-integrity-tests`
* fully qualified name: `vac:qa:nomos:2024q4-da-testing:data-integrity-tests`
* owner: romanzac
* status: in progress (5%)
* status: in progress (20%)
* start-date: 2024/11/22
* end-date: 2024/12/02
@@ -125,7 +125,7 @@ to reconstruct or retrieve data.
### Edge Cases
* fully qualified name: `vac:qa:nomos:da-testing-2024q4:edge-cases`
* fully qualified name: `vac:qa:nomos:2024q4-da-testing:edge-cases`
* owner: romanzac
* status: in progress (50%)
* start-date: 2024/10/01
@@ -142,7 +142,7 @@ Test edge cases for behaviours implemented for dispersal, replication and sampli
### Test Optimization
* fully qualified name: `vac:qa:nomos:da-testing-2024q4:test-optimization`
* fully qualified name: `vac:qa:nomos:2024q4-da-testing:test-optimization`
* owner: romanzac
* status: not started
* start-date: 2024/12/13
@@ -157,3 +157,19 @@ to simplify existing code.
* PR link with redesigned tests
* CI runs showing successful or failed executions with detailed reports
### Outline Small Scale Distributed Test Framework
* fully qualified name: `vac:qa:nomos:2024q4-da-testing:outline-distributed-test-framework`
* owner: romanzac
* status: not started
* start-date: 2024/12/09
* end-date: 2024/12/20
#### Description
Create basic structure of small scale distributed test framework and
use runtime without added virtualization layer as the initial PoC.
#### Deliverables
* PR link with the initial framework structure and one sample test
* CI runs showing successful or failed executions with detailed reports

View File

@@ -10,7 +10,7 @@ description: Extend nim-libp2p testing coverage, documentation and tooling.
---
`vac:qa:vac:nim-libp2p-testing-2024q4`
`vac:qa:vac:2024q4-nim-libp2p-testing`
## Description
Extend nim-libp2p testing coverage, documentation, and tooling.
@@ -34,7 +34,7 @@ Improve tooling around nim libp2p testing.
### Gossipsub Core
* fully qualified name: `vac:qa:vac:nim-libp2p-testing-2024q4:gossipsub-core`
* fully qualified name: `vac:qa:vac:2024q4-nim-libp2p-testing:gossipsub-core`
* owner: alex
* status: in progress (40%)
* start-date:

View File

@@ -10,7 +10,7 @@ description: Extend nim-libp2p testing coverage, documentation and tooling.
---
`vac:qa:vac:nim-libp2p-testing-2025q1`
`vac:qa:vac:2025q1-nim-libp2p-testing`
## Description
Extend nim-libp2p testing coverage, documentation, and tooling.
@@ -34,7 +34,7 @@ Improve tooling around nim libp2p testing.
### Gossipsub Extended
* fully qualified name: `vac:qa:vac:nim-libp2p-testing-2025q1:gossipsub-extended`
* fully qualified name: `vac:qa:vac:2025q1-nim-libp2p-testing:gossipsub-extended`
* owner: fbarbu15
* status: not started
* start-date:
@@ -54,7 +54,7 @@ and aim to improve overall test completeness.
### Pubsub
* fully qualified name: `vac:qa:vac:nim-libp2p-testing-2025q1:pubsub`
* fully qualified name: `vac:qa:vac:2025q1-nim-libp2p-testing:pubsub`
* owner: fbarbu15
* status: not started
* start-date:
@@ -69,7 +69,7 @@ checking whats not covered, and implementing new tests for those scenarios.
### Floodsub
* fully qualified name: `vac:qa:vac:nim-libp2p-testing-2025q1:floodsub`
* fully qualified name: `vac:qa:vac:2025q1-nim-libp2p-testing:floodsub`
* owner: fbarbu15
* status: not started
* start-date:
@@ -84,7 +84,7 @@ checking whats not covered, and implementing new tests for those scenarios.
### Test Plans
* fully qualified name: `vac:qa:vac:nim-libp2p-testing-2025q1:test-plans`
* fully qualified name: `vac:qa:vac:2025q1-nim-libp2p-testing:test-plans`
* owner: fbarbu15
* status: not started
* start-date:

View File

@@ -8,7 +8,7 @@ draft: false
description: Extend Waku interop tests with focus on more advanced scenarios
---
`vac:qa:waku:interop-testing-2024q4`
`vac:qa:waku:2024q4-interop-testing`
## Description
Extend Waku interop tests with focus on more advanced scenarios
@@ -42,7 +42,7 @@ ensuring PR-level validation.
### Edge Cases
* fully qualified name: `vac:qa:waku:interop-testing-2024q4:edge-cases`
* fully qualified name: `vac:qa:waku:2024q4-interop-testing:edge-cases`
* owner: aya
* status: done
* start-date: 2024/10/07
@@ -70,7 +70,7 @@ Issues found:
### E2E Scenarios
* fully qualified name: `vac:qa:waku:interop-testing-2024q4:e2e-scenarios`
* fully qualified name: `vac:qa:waku:2024q4-interop-testing:e2e-scenarios`
* owner: aya
* status: done
* start-date: 2024/10/28
@@ -101,7 +101,7 @@ Issues found:
### Known Issues
* fully qualified name: `vac:qa:waku:interop-testing-2024q4:known-issues`
* fully qualified name: `vac:qa:waku:2024q4-interop-testing:known-issues`
* owner: aya
* status: done
* start-date: 2024/11/06
@@ -136,7 +136,7 @@ Issues found:
### Faster Runners
* fully qualified name: `vac:qa:waku:interop-testing-2024q4:faster-runners`
* fully qualified name: `vac:qa:waku:2024q4-interop-testing:faster-runners`
* owner: aya
* status: in progress (50%)
* start-date: 2024/11/18
@@ -154,9 +154,9 @@ without compromising coverage.
### CI Integration
* fully qualified name: `vac:qa:waku:interop-testing-2024q4:ci-integration`
* fully qualified name: `vac:qa:waku:2024q4-interop-testing:ci-integration`
* owner: aya
* status: in progress (50%)
* status: in progress (80%)
* start-date: 2024/12/02
* end-date: 2024/12/09
@@ -173,7 +173,7 @@ without adding significant overhead to CI.
### Network Conditions
* fully qualified name: `vac:qa:waku:interop-testing-2024q4:network-conditions`
* fully qualified name: `vac:qa:waku:2024q4-interop-testing:network-conditions`
* owner: fbarbu15
* status: not started
* start-date: 2024/12/09
@@ -195,7 +195,7 @@ to catch issues that may arise under suboptimal network conditions.
### Maintenance
* fully qualified name: `vac:qa:waku:interop-testing-2024q4:maintenace`
* fully qualified name: `vac:qa:waku:2024q4-interop-testing:maintenace`
* owner: fbarbu15
* status: started (50%)
* start-date: 2024/10/01
@@ -219,13 +219,14 @@ PRs:
* https://github.com/waku-org/waku-interop-tests/pull/82
* https://github.com/waku-org/waku-interop-tests/pull/84
* https://github.com/waku-org/waku-interop-tests/pull/91
* https://github.com/waku-org/waku-interop-tests/pull/93
Issues found:
* https://github.com/waku-org/go-waku/issues/1255
### Libwaku Discovery
* fully qualified name: `vac:qa:waku:interop-testing-2024q4:discover-libwaku`
* fully qualified name: `vac:qa:waku:2024q4-interop-testing:discover-libwaku`
* owner: aya
* status: started (50%)
* start-date: 2024/11/25

View File

@@ -9,7 +9,7 @@ description: Collaborate with Status QA in creating a test framework that uses s
to do functional testing for status go, by integrating existing Status CLI tests into it.
---
`vac:qa:waku:status-go-functional-testing-2024q4`
`vac:qa:waku:2024q4-status-go-functional-testing`
## Description
Collaborate with Status QA in creating a test framework that uses status-backend
@@ -37,9 +37,9 @@ We will track test coverage to measure progress.
### Migrate to Status Backend
* fully qualified name: `vac:qa:waku:status-go-functional-testing-2024q4:migrate-to-status-backend`
* fully qualified name: `vac:qa:waku:2024q4-status-go-functional-testing:migrate-to-status-backend`
* owner: fbarbu15
* status: in progress (60% - delayed because of handover of work from a different CC and updates needed to be done to the Status Backend Framework)
* status: in progress (80%)
* start-date: 2024/10/07
* end-date: 2024/11/11
@@ -59,7 +59,7 @@ since Status QA has started a similar effort using Python.
### Message tests
* fully qualified name: `vac:qa:waku:status-go-functional-testing-2024q4:message-tests`
* fully qualified name: `vac:qa:waku:2024q4-status-go-functional-testing:message-tests`
* owner: fbarbu15
* status: not started
* start-date: 2024/11/11